Senior Data Engineer

New York, NY, US • Posted 12 hours ago • Updated 12 hours ago
Contract W2
12 Months
No Travel Required
On-site
Depends on Experience
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Microsoft Azure
  • Extract, Transform, Load
  • Good Clinical Practice
  • Google Cloud
  • Google Cloud Platform
  • Data Quality
  • Data Warehouse
  • Database
  • Databricks
  • IaaS
  • Data Architecture
  • Data Engineering
  • Data Modeling
  • Data Processing
  • Git
  • Collaboration
  • Communication
  • Continuous Delivery
  • Continuous Integration
  • Apache Kafka
  • Apache Spark
  • Automated Testing
  • Cloud Computing
  • Amazon Redshift
  • Amazon Web Services
  • Terraform
  • Version Control
  • Real-time
  • Snow Flake Schema
  • Streaming
  • Technical Drafting
  • Workflow
  • Mentorship
  • Orchestration
  • Performance Tuning
  • PySpark
  • Python
  • Agile
  • Analytics
  • Apache Airflow
  • ELT
  • Leadership
  • Management
  • SQL

Summary

Job Title: Senior Data Engineer

Experience: 12+ Years
Employment Type: W2

Job Summary

We are seeking an experienced Senior Data Engineer with 12+ years of IT experience to design, develop, and maintain scalable data engineering solutions. The ideal candidate will have strong expertise in cloud data platforms, ETL/ELT pipelines, distributed data processing, and data warehousing.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines for batch and real-time data processing.
  • Build and optimize ETL/ELT workflows using Python, SQL, and Apache Spark.
  • Develop data solutions using AWS, Azure, or Google Cloud Platform (Google Cloud Platform).
  • Implement data processing frameworks using PySpark, Databricks, Apache Kafka, and Spark Structured Streaming.
  • Design and manage data warehouses and lakehouse architectures.
  • Work with Snowflake, Amazon Redshift, Google BigQuery, or Azure Synapse Analytics.
  • Implement data quality, validation, governance, security, and monitoring processes.
  • Optimize complex SQL queries and improve pipeline performance.
  • Collaborate with data scientists, architects, business analysts, and application teams.
  • Mentor junior engineers and participate in technical design and code reviews.
  • Implement CI/CD, version control, and automated testing for data engineering solutions.

Required Skills

  • 12+ years of overall IT experience, with strong hands-on data engineering experience.
  • Advanced Python, PySpark, and SQL skills.
  • Strong experience with ETL/ELT pipeline development.
  • Experience with Apache Spark and distributed data processing.
  • Hands-on experience with at least one major cloud platform: AWS, Azure, or Google Cloud Platform.
  • Experience with data warehousing and database technologies.
  • Knowledge of data modeling, performance tuning, and data architecture.
  • Experience with Git, CI/CD, and Agile methodologies.

Preferred Skills

  • Apache Kafka and real-time streaming.
  • Snowflake, Databricks, Delta Lake, or BigQuery.
  • Apache Airflow or similar workflow orchestration tools.
  • Terraform and cloud infrastructure automation.
  • Experience with large-scale enterprise data platforms.
  • Leadership, mentoring, and stakeholder communication skills.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10477291
  • Position Id: 9114238
  • Posted 12 hours ago
Contact the job poster
RC

Rahul Chourasia

Recruiter @ Raas Infotek LLC

Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.