Data Engineer-ONly W2-NY,NJ
Full Time
75% Travel Required
Able to Sponsor
On-site
$60+
cloudingest inc
Fitment
Dice Job Match Score™
🔢 Crunching numbers...
Job Details
Skills
- Azure
- AI
- Python
Summary
Role: Data Engineer (AI & Data Pod)
Location: NY (Hybrid 3 days a week in the office)
Experience: 8-12 years
Role Summary: Builds and maintains reliable data pipelines and platforms on-site, working with the Data Architect and AI team to deliver high-quality data for analytics and AI solutions.
Key Responsibilities
- Design, build, and optimize batch and streaming data pipelines
- Implement data models and transformations defined by the Data Architect
- Ingest and integrate data from multiple source systems and APIs
- Implement data quality checks, monitoring and alerting
- Optimize performance and cost of data workloads
- Collaborate with AI Developers and analysts to provision datasets
- Maintain documentation, version control and CI/CD for data code
- Work with offshore data engineers on knowledge transfer and delivery
Required Qualifications
- 5+ years in data engineering
- Strong SQL and Python (or Scala) skills
- Experience with orchestration tools such as Airflow or Azure Data Factory
- Hands-on experience with cloud data services and big data frameworks such as Spark
- Understanding of data warehousing and lakehouse concepts
- Familiarity with Git, CI/CD, and infrastructure-as-code
- Experience supporting ML/AI data needs is a plus
Key Skills
SQL | Python | Spark | Airflow / ADF | Cloud data services | CI/CD
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
- Dice Id: RTX1bc3ac
- Position Id: 9112437
- Posted 1 day ago
Company Info
About cloudingest inc
CloudIngest is a full-service tech software firm. We possess extensive practical experience in Management, Business, and Economics. We stay up-to-date on emerging trends in terms of both the evolving cloud-based tech stack and client considerations in terms of Financial Billing and Payments. Our team consists of Client Intake Managers, Project Managers, Software Developers, Quality Assurance, and Integrative Solution and NLP Specialists all of whom are fully-equipped and ready to interface with members of your existing team. We are experienced working with client-side Project Managers as well as Designers and C-Suite business executives.
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.