Senior Software Engineer-Data Engineering
Arlington, VA, US • Posted 60+ days ago • Updated 9 hours ago

American Association Of Motor Vehicle Admin.
Dice Job Match Score™
✨ Finding the perfect fit...
Job Details
Skills
- Information Systems
- Optimization
- Reporting
- Business Acumen
- Communication
- Collaboration
- Streaming
- Data Processing
- Data Storage
- Microsoft
- Data Analysis
- Business Intelligence
- Workflow
- Computer Science
- Data Science
- Data Engineering
- Database Design
- Version Control
- Git
- Conflict Resolution
- Problem Solving
- Attention To Detail
- Data Modeling
- Dimensional Modeling
- Continuous Integration
- Continuous Delivery
- Statistics
- Machine Learning (ML)
- Time Series
- Dashboard
- Analytics
- Apache Spark
- Python
- SQL
- PySpark
- C#
- Transact-SQL
- Stored Procedures
- Microsoft SQL Server
- Databricks
- Snow Flake Schema
- Visualization
- Microsoft Power BI
- Microsoft Azure
- DevOps
- Continuous Integration and Development
- Management
Summary
The IT Division is responsible for the development and operations of information systems for the State and Federal agencies doing business related to or using information from the administration of motor vehicles and driver licenses.
The Data Engineer position has core responsibilities for the design, development, maintenance, optimization, and operational support of components which move and ingest data from sources into the analytics systems.
Essential Duties and Responsibilities:
You will work with cutting-edge technologies to build and maintain our data platform, focusing on batch and stream processing workflows. You will leverage the Microsoft Azure ecosystem, particularly Azure Synapse Analytics, Microsoft Fabric, Apache Spark, and Delta Lake, to create efficient and reliable data solutions that power our analytics and reporting capabilities.
As a detail-oriented professional, you have a strong track record of independently managing projects and driving them to successful completion. Your exceptional business acumen and communication skills enable you to collaborate effectively with stakeholders, identify vital business questions, and make informed, data-driven decisions.
Key responsibilities include:
- Designing and implementing scalable data pipelines using Synapse, Fabric, and Apache Spark
- Building and maintaining streaming and batch solutions using Azure Event Hubs
- Developing and maintaining Python applications for data processing and integration
- Implementing Delta Lake architecture for reliable data storage and processing
- Leveraging Microsoft platform capabilities for end-to-end data analytics solutions
- Creating reports and data visualizations to support business intelligence needs
- Optimizing data workflows for performance and cost efficiency
- Collaborating with cross-functional teams to understand data requirements and deliver solutions
Direct Reports:
None
QUALIFICATIONS
Formal Education:
Bachelor's degree in computer science, Data Science, or related field. Equivalent work experience may be substituted.
Knowledge, Skills, and Abilities:
Basic Qualifications
- 3-5 years of hands-on experience in data engineering
- Strong proficiency with Fabric, Azure Synapse Analytics and Apache Spark
- Hands-on experience with Azure Event Hubs and stream processing
- Experience building and maintaining data pipelines using Delta Lake
- Strong understanding of relational database design
- Proficiency in Python and SQL
- Experience with version control systems (Git) and CI/CD practices
- Strong problem-solving skills and attention to detail
Preferred Qualifications
- Knowledge of data modeling and dimensional modeling concepts
- Familiarity with operations and monitoring of mission critical data platform
- Experience with CI/CD deployment of data pipelines
- Experience with statistics, machine learning, time-series, anomaly detection
- Experience with Power BI or similar visualization tools
- Experience creating reports and dashboards for business stakeholders
- Azure or Databricks certifications
Technical Stack
- Core Technologies: Fabric, Azure Synapse Analytics, Apache Spark, Delta Lake, Azure Event Hubs
- Languages: Python, SQL, PySpark, C#
- T-SQL, Stored Procedures, SQL Server Availability Groups
- Azure Functions, Azure Data Factory, Azure Key Vault
- Optional: Databricks, Snowflake, Lakehouse Architecture
- Visualization: Power BI
- Development: Azure DevOps, CICD
Disclaimer Statement: The preceding job description has been written to reflect management's assignment of essential functions. It does not prescribe or restrict the tasks that may be assigned.
AAMVA is an Equal Opportunity Employer/Veterans/Disabled
- Dice Id: RTX117de3
- Position Id: 1407_3
- Posted 30+ days ago
Company Info
The American Association of Motor Vehicle Administrators (AAMVA) is a tax-exempt, nonprofit organization developing model programs in motor vehicle administration, law enforcement and highway safety. The association also serves as an information clearinghouse in these areas, and acts as the international spokesman for these interests.
Founded in 1933, AAMVA represents the state and provincial officials in the United States and Canada who administer and enforce motor vehicle laws. AAMVA's programs encourage uniformity and reciprocity among the states and provinces. The association also serves as a liaison with other levels of government and the private sector. Its development and research activities provide guidelines for more effective public service. AAMVA s membership includes associations, organizations and businesses that share an interest in the association s goals.
Similar Jobs
It looks like there aren't any Similar Jobs for this job yet.
Search all similar jobs
