Job Title: Senior Data Engineer

Experience: 12+ Years
Job Type: W2 Contract

Job Description

We are looking for an experienced Senior Data Engineer with 12+ years of experience in designing, developing, and maintaining scalable data pipelines, data integration solutions, and cloud-based data platforms. The ideal candidate should have strong expertise in Python, SQL, ETL/ELT, big data technologies, and cloud platforms.

Key Responsibilities

• Design, develop, and optimize scalable data pipelines and ETL/ELT workflows.

• Build and maintain data integration solutions for structured and unstructured data.

• Develop complex SQL queries, stored procedures, and performance-tuned data models.

• Work with large datasets using Python, PySpark, Spark, and distributed processing frameworks.

• Design and implement data solutions using AWS, Azure, or Google Cloud Platform.

• Develop and maintain data warehouses and lakehouse architectures.

• Work with Snowflake, Databricks, Redshift, Azure Synapse, or similar platforms.

• Implement data quality checks, data validation, monitoring, and error-handling mechanisms.

• Collaborate with data architects, analysts, developers, and business stakeholders.

• Ensure data security, governance, reliability, and compliance with enterprise standards.

• Troubleshoot production issues and optimize pipeline performance.

• Mentor junior engineers and contribute to technical design and architecture decisions.

Required Skills

• 12+ years of experience in Data Engineering, ETL development, or Data Integration.

• Strong proficiency in Python, SQL, PySpark, and Apache Spark.

• Hands-on experience with ETL/ELT tools such as Informatica, Azure Data Factory, or similar platforms.

• Experience with cloud technologies such as AWS, Azure, or Google Cloud Platform.

• Strong knowledge of data warehousing, dimensional modeling, and data lake architecture.

• Experience with Snowflake, Databricks, or other modern data platforms.

• Experience with data pipeline orchestration tools such as Airflow, Azure Data Factory, or equivalent.

• Knowledge of Git, CI/CD pipelines, and Agile development methodologies.

• Strong analytical, troubleshooting, communication, and problem-solving skills.

Preferred Qualifications

• Experience with Kafka or other streaming technologies.

• Knowledge of dbt, Delta Lake, and real-time data processing.

• Experience with data governance, metadata management, and data security.

• Relevant cloud or data engineering certifications are a plus.