Overview
Hybrid
Depends on Experience
Contract - W2
Contract - 12 Month(s)
25% Travel
Skills
Artificial Intelligence
Data Warehouse
Data Flow
Data Governance
Data Modeling
Data Storage
Analytical Skill
Databricks
Data Visualization
Data Engineer
Machine Learning (ML)
ETL
Microsoft Azure
Python
SQL
PyTorch
Kubernetes
ELT
Docker
GCP
Vertex
Job Details
Job Title: Data Engineer
Location: Charlotte, NC (Hybrid)
Employment: W2 Only (NO C2C)
Duration: 12+ Months
Job Summary:
We are seeking a skilled Data Engineer with AI/ML experience to design and implement scalable data solutions and machine learning pipelines.
Key Responsibilities:
- Design and build data pipelines on Azure (Data Factory, Synapse, Databricks) and Google Cloud Platform (BigQuery, Dataflow, Composer)
- Develop ETL/ELT processes for structured and unstructured data
- Implement data warehousing solutions using Azure Synapse or BigQuery
- Create and optimize machine learning pipelines for model training and deployment
- Integrate AI/ML services (Azure ML, Google Cloud Platform Vertex AI) into data workflows
- Design and implement data governance and security measures
- Collaborate with data scientists to operationalize ML models
- Optimize data storage and processing for performance and cost
- Automate data pipeline monitoring and alerting
- Implement MLOps practices for model versioning and deployment
Required Skills & Qualifications:
- 13+ years of experience in data engineering
- Strong expertise in Azure Data Factory, Synapse, Databricks or Google Cloud Platform BigQuery, Dataflow
- Experience with Python, SQL, and PySpark
- Knowledge of data modeling and warehousing concepts
- Hands-on experience with AI/ML pipelines and frameworks
- Understanding of MLOps principles and tools
- Experience with containerization (Docker, Kubernetes)
- Familiarity with CI/CD pipelines for data projects
- Strong problem-solving and analytical skills
Nice-to-Have Skills:
- Azure or Google Cloud Platform certifications
- Experience with TensorFlow, PyTorch, or scikit-learn
- Knowledge of streaming data technologies
- Understanding of data visualization tools
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.