Overview
Skills
Job Details
Senior Data Engineer
Location: Bloomfield, CT or Woodbridge, NJ (open to 100% remote candidates )
Duration: 8 months base contract; possible extensions
Notes:
100% remote is fine
MUST HAVE strong Python, SQL, Pyspark, and Databricks
Job Description:
Job Summary:
We are seeking a highly skilled and experienced Senior Data Engineer with a strong background in Databricks, SQL, and Python, pyspark to join our data engineering team. The ideal candidate will have a proven track record of designing, building, and deploying scalable data pipelines and solutions in cloud environments. You will be responsible for end-to-end development, from data ingestion to deployment, ensuring high performance and reliability.
Required Qualifications:
5+ years of professional experience in data engineering or related roles.
Strong proficiency in Databricks, SQL, and Python, Pyspark.
Experience with end-to-end deployment of data solutions in cloud environments (e.g., Azure, AWS, Google Cloud Platform).
Solid understanding of ETL/ELT processes, data modeling, and data warehousing concepts.
Familiarity with CI/CD pipelines, version control (Git), and workflow orchestration tools (e.g., Airflow).
Experience with structured and unstructured data formats (e.g., Parquet, JSON, CSV).
Strong problem-solving skills and attention to detail.
Excellent communication and collaboration skills.
Preferred Qualifications:
Experience with Delta Lake or other Databricks ecosystem tools.
Knowledge of data governance, security, and compliance standards.
Familiarity with containerization (Docker) and Kubernetes.
Exposure to real-time data processing (e.g., Kafka, Spark Streaming).