Job Title: Python Data Engineer
Location: Dallas, TX (Hybrid)
Job Summary Seeking a skilled Python Data Engineer with expertise in ETL pipeline design, AWS data services, and data quality engineering to support scalable data solutions.
Key Responsibilities
- Develop, maintain, and optimize ETL pipelines and data workflows following schema-driven and configuration-driven approaches.
- Build and maintain data models for hierarchical and dimensional datasets to support analytics and reporting.
- Manage and utilize AWS data services to store, secure, and process large datasets.
- Perform rigorous data validation and quality checks to ensure data integrity.
- Collaborate with cross-functional teams to integrate SQL queries and Databricks JDBC data feeds.
- Work with columnar data formats and optimize data storage and retrieval.
- Handle time-series data processing and analysis tasks.
- Write unit and integration tests to guarantee reproducibility and reliability of data code.
- Use version control tools and automation workflows to maintain codebases and infrastructure.
- Support integration of machine learning endpoints such as SageMaker and Chronos.
- Implement and enforce secure data handling and compliance standards.
Required Skills
- Strong proficiency in Python data engineering using Pandas and NumPy.
- Design and implementation of ETL/data pipelines that are schema-driven and configuration-driven.
- Data modeling for hierarchical and dimensional data structures.
- Experience with AWS data services, including:
- AWS Glue
- Amazon S3
- IAM
- DynamoDB
- AWS Systems Manager (SSM)
- Expertise in data validation and data quality engineering.
- Strong SQL skills.
- Experience working with Databricks JDBC feeds.
- Knowledge of columnar and analytics file formats, including Parquet and CSV.
- Experience handling and processing time-series data.
- Experience implementing testing practices and ensuring reproducibility of data code.
- Proficiency with Git, GitHub Actions, and Terraform.
- Integration experience with SageMaker and Chronos endpoints at the interface level.
- Understanding of secure data handling practices throughout the data lifecycle.
Qualifications
- Experience developing scalable data engineering solutions using Python and AWS technologies.
- Ability to work with large datasets and modern data processing frameworks.
- Strong collaboration and problem-solving skills.
- Experience supporting analytics, reporting, and data quality initiatives.
We are an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, sexual orientation, or gender identity), national origin, citizenship status, age, disability, genetic information, protected veteran status, or any other characteristic protected by applicable law.
