Software Engineer-Data Engineering

Overview

Remote
Hybrid
Depends on Experience
Full Time

Skills

Azure
Azure Data Factory
Business Intelligence
C #
Data Engineering
Data LakeWork
ETL
SQL
T - SQL
Kafka
Python
Scala
Software Engineer
Azure Blob
data access

Job Details

Position Summary:

The IT Division is responsible for the development and operations of information systems for the State and Federal agencies doing business related to or using information from the administration of motor vehicles and driver licenses. 

The Data Engineer position has core responsibilities for the design, development, maintenance, optimization, and operational support of components which move and ingest data from sources into the analytics systems.  

 

Essential Duties and Responsibilities:

We are seeking a skilled Data Engineer with expertise in designing and deploying robust, scalable data flow solutions. You will leverage cutting-edge analytics techniques and technologies on the Microsoft Azure platform, including SQL Server, Synapse, Azure Event Hubs, and Azure Data Lake Storage. Your responsibilities will span across processing structured and unstructured data from various sources, constructing intricate analyses, and implementing data flow solutions that utilize Apache Spark and Azure Synapse Analytics for reporting and ad-hoc analysis.

As a detail-oriented professional, you have a strong track record of independently managing projects and driving them to successful completion. Your exceptional business acumen and communication skills enable you to collaborate effectively with stakeholders, identify vital business questions, and make informed, data-driven decisions.

Direct Reports:

None

 

QUALIFICATIONS 

Formal Education:

College degree in computer sciences from an accredited college. Equivalent work experience may be substituted.

 

Knowledge, Skills, and Abilities:

 Basic Qualifications

  • Minimum of 2 years of relevant data engineering experience
  • Proficiency in data modeling, warehousing, and building ETL pipelines
  • Experience with T-SQL programming language
  • Familiarity with Python and .NET frameworks

Preferred Qualifications

  • Experience with Azure Synapse Analytics, Data Factory, and Databricks
  • Exposure to big data technologies such as Hadoop, Hive, Spark, Scala, Snowflake, and Redshift
  • Experience with ETL tools like SQL Server Integration Services (or Talend, Informatica, ODI, Glue, Datafow)
  • Proficiency in reporting and visualization tools, including SSRS, Power BI, and Tableau
  • Hands-on experience deploying solutions to the cloud within Azure or AWS

 

Disclaimer Statement: The preceding job description has been written to reflect management’s assignment of essential functions. It does not prescribe or restrict the tasks that may be assigned.

AAMVA is an Equal Opportunity Employer—M/F/D/V