Data Engineering Contractor

 

We are seeking an experienced Data Engineering contractor to join a rapidly expanding AI-focused data engineering team. The successful candidate will play a key role in designing and building database models, batch processing workflows, and robust data pipelines covering ingestion, transformation, and delivery using Python. Current initiatives involve integrating AI applications with newly developed and continuously evolving data sources. This is a hands-on technical position ideal for a professional who thrives at the intersection of data infrastructure and application integration.

Key Responsibilities

• Develop and fine-tune SQL queries for extracting, transforming, and loading both structured and semi-structured datasets.

• Deliver end-to-end project support including scoping, effort estimation, planning, design, build, and ongoing maintenance.

• Build, configure, and deploy Python-based scripts and services that power AI-driven initiatives.

• Partner with the cloud engineering team on AWS infrastructure, leveraging S3 for data lake storage and AWS Glue for pipeline orchestration.

• Enhance and maintain Python-based front-end tools, while helping prepare the platform for a future transition toward Angular.

• Participate in the full development lifecycle — design, coding, testing, and deployment of production-grade application code.

• Monitor project progress, proactively flag blockers, and coordinate with stakeholders to keep deliverables on track.

• Triage, resolve, or escalate incidents across both development and production environments.

• Stay current on emerging tools, frameworks, and best practices in data engineering and AI tooling.

Required Skills

• Minimum 4+ years of hands-on Data Engineering development experience.

• Proven expertise building ETL pipelines using Python and PySpark.

• Working knowledge of AWS services including Glue, RDS, S3, Step Functions, EventBridge, Lambda, MSK (Kafka), and EKS.

• Strong experience with relational databases such as PostgreSQL, SQL Server, Oracle, and Sybase.

• Advanced SQL skills — programming, query tuning, relational modeling, stored procedures, views, functions, and triggers.

• Solid design and development background including mapping specifications, HLD/LLD documentation, coding, and unit testing.

• Familiarity with CI/CD pipelines and DevOps tooling such as Bitbucket, GitHub, and Jenkins.

• Strong grounding in data modeling, data warehousing, data mining, analysis, and profiling.

• Comfortable operating within Agile / SCRUM delivery frameworks.

• Effective written and verbal communication skills.

Preferred / Nice to Have

• Exposure to AI/ML data workflows or LLM-adjacent tooling and frameworks.

• Experience with Python-based UI frameworks such as Flask or Dash, and/or familiarity with Angular.