Job Summary: We are seeking a skilled Data Engineer with a strong background in Python and AWS to design, build, and maintain scalable data pipelines and data infrastructure. The ideal candidate will have hands-on experience working with large datasets, cloud-based architectures, and modern data engineering tools. Key Responsibilities: Design, develop, and optimize scalable data pipelines using Python Build and manage data infrastructure on the AWS cloud platform Develop ETL/ELT processes for ingesting, transforming, and loading data from multiple sources Work with large-scale structured and unstructured datasets Implement data quality, validation, and monitoring frameworks Collaborate with data scientists, analysts, and cross-functional teams Optimize data workflows for performance and cost efficiency Ensure data security, governance, and compliance standards are followed Required Qualifications: Strong programming experience in Python Hands-on experience with AWS services such as S3, Lambda, Glue, Redshift, EMR, and Athena Experience with ETL tools and data pipeline frameworks Solid understanding of SQL and database systems (RDBMS and NoSQL) Familiarity with data modeling and data warehousing concepts Experience with version control systems such as Git Strong problem-solving and analytical skills Preferred Qualifications: Experience with big data technologies such as Spark or Hadoop Experience with orchestration tools such as Airflow Exposure to containerization tools such as Docker or Kubernetes Knowledge of CI/CD pipelines and DevOps practices Experience working in Agile environments Experience with real-time data processing technologies such as Kafka or Kinesis Exposure to machine learning pipelines or analytics platforms AWS certifications such as AWS Certified Data Analytics or Solutions Architect Bachelors or Masters degree in Computer Science, Engineering, or a related field Education: Bachelors Degree Certification: AWS Certified Data Analytics , Solutions Architect
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
- Dice Id: compun
- Position Id: GOEDC5782685
- Posted 3 hours ago
Never miss an opportunity! Create an alert based on the job you applied for.
