Overview
Skills
Job Details
Position :- Senior Business Analyst
Contract :- W2
About the Role
We are seeking an experienced Senior Data Engineer to design, build, and optimize scalable data pipelines and platforms. The role involves working closely with data architects, analysts, and business stakeholders to enable data-driven decision-making, while ensuring the reliability, performance, and governance of enterprise data systems.
Key Responsibilities
Design, build, and maintain scalable ETL/ELT pipelines and data workflows for structured and unstructured data.
Develop and optimize data models (OLTP, OLAP, data lakes, and warehouses) to support analytics and reporting.
Implement data quality, data validation, and data governance frameworks.
Collaborate with cross-functional teams (data scientists, BI developers, business analysts) to provide reliable datasets.
Manage and optimize cloud-based data infrastructure (AWS, Azure, or Google Cloud Platform).
Monitor, troubleshoot, and improve the performance of data pipelines and data platforms.
Ensure security, compliance, and best practices for enterprise data solutions.
Mentor junior engineers and contribute to defining engineering standards and best practices.
Required Skills & Qualifications
Bachelor s/Master s degree in Computer Science, Engineering, Information Systems, or related field.
8+ years of experience in data engineering, data integration, and data platform development.
Strong expertise in SQL, Python, or Scala.
Experience with Big Data technologies: Spark, Hadoop, Kafka, Databricks, etc.
Hands-on experience with cloud data platforms: AWS (Redshift, Glue, S3, EMR), Azure (Synapse, Data Factory, Databricks), or Google Cloud Platform (BigQuery, Dataflow).
Proficiency in data warehouse design and data modeling techniques (Kimball, Inmon).
Experience with workflow orchestration tools (Airflow, Prefect, Dagster, etc.).
Familiarity with DevOps, CI/CD, and Infrastructure-as-Code tools (Terraform, Jenkins, Git).
Strong problem-solving, analytical, and communication skills.
Preferred Qualifications
Knowledge of machine learning data pipelines and model deployment support.
Experience in real-time streaming data and event-driven architectures.
Exposure to Data Governance & MDM tools (Collibra, Informatica, Alation).
Strong understanding of data security, privacy, and compliance regulations (GDPR, HIPAA, etc.).