Azure Data Engineer
OR Data Engineer with DevOps
Long Term Contract
Remote--NYC, NY What You Will Do:
Assist in building a cloud-based Big Data platform to process large-scale data, support machine learning, and enable advanced analytics.
Handle large volumes of data and integrate with internal and external systems.
Work in an Agile team with business teams, testers, architects, and project managers.
Develop and maintain complex data integrations, data pipelines, and workflows.
Maintain code quality, documentation, performance, monitoring, and support production systems.
As a Senior team member, mentor junior team members and guide technical solutions.
Work on CI/CD pipelines, automation, infrastructure setup, and containerized deployments.
What You Need:
Experience in Data Engineering, Data Warehousing, Data Lakes, and ETL pipelines.
Strong programming skills in Python, SQL, Java, or Scala.
Experience with Spark, Airflow, or similar data pipeline tools.
Experience with Cloud platforms like AWS, Azure, or Google Cloud Platform.
Hands-on experience with CI/CD pipelines, Jenkins, Terraform, and Infrastructure as Code.
Experience with Docker, Kubernetes, containerized applications, and cluster management.
Experience building and managing data workflows, ingestion, and data integration.
Knowledge of monitoring, logging, alerting, and performance tuning.
Experience with Power BI, Tableau, or other visualization tools is a plus.
Good documentation and communication skills.
Never miss an opportunity! Create an alert based on the job you applied for.
