Overview
Skills
Job Details
Job Title: Data Engineer
Location: New York, NY (Hybrid/Onsite as required)
Job Type: Full-Time / Contract
Visa: and s (Minimum 10+ years for H1B candidates)
We are looking for a highly skilled Data Engineer to join our data team in New York. The ideal candidate will have deep experience building data pipelines, managing data infrastructure, and working with big data technologies. This role will focus on enabling data-driven decision-making by ensuring the availability, integrity, and scalability of data systems.
Responsibilities:-
Design, build, and maintain scalable ETL/ELT pipelines.
-
Develop and optimize data models for analytics and reporting.
-
Collaborate with data scientists, analysts, and other engineers to integrate diverse data sources.
-
Implement best practices for data governance, quality, and security.
-
Monitor data workflows, identify bottlenecks, and troubleshoot performance issues.
-
Work with cloud-based data platforms (AWS, Azure, or Google Cloud Platform) for data storage and processing.
-
8 10+ years of experience in data engineering (10+ for H1B candidates).
-
Strong proficiency in SQL, Python, or Scala.
-
Experience with big data tools such as Apache Spark, Kafka, Hadoop, etc.
-
Expertise in ETL frameworks and data orchestration tools like Airflow, DBT, or NiFi.
-
Hands-on experience with cloud platforms like AWS (S3, Redshift, Glue, EMR), Azure Data Factory, or Google Cloud Platform BigQuery.
-
Strong understanding of data warehousing concepts and OLAP/OLTP systems.
-
Experience with Snowflake, Databricks, or Delta Lake.
-
Familiarity with containerization tools like Docker and orchestration with Kubernetes.
-
Knowledge of DevOps practices and CI/CD pipelines for data workflows.
-
Domain experience in finance, healthcare, or retail is a plus.