Mid-level Data Engineer (SQL, Python and Databricks)

***Candidates willing to work on W2 only accepted for this role.

Our Client is seeking a Dat Engineer who will be responsible for implementing data solution for ad-hoc requests from end-to-end including but not limited to requirement gathering, gap analysis of the existing data platform and deploying the solution into the production environment. This role also includes coordinating with the DevOps team and functional leads to ensure conformity to existing standards

Responsibilities:

• Lead the design, architecture, and implementation of ad-hoc data initiatives and platform capabilities while ensuring alignment with business needs and scalability requirements.
• Enhance existing data workflows and systems to improve performance, cost-efficiency, to implement innovative solutions.
• Lead cross-functional projects, collaborating with product managers, analysts, solutions architects, and other stakeholders to define requirements, prioritize tasks, and deliver high-quality solutions.
• Communicate effectively with non-technical stakeholders to understand business needs, translate them into technical specifications, and present technical concepts in a clear and concise manner

Skills:

• 4+ years of hands-on experience in data engineering, including data lake infrastructure, data warehousing, and data analytics tools.
• Cloud data engineering experience on Azure. Deep understanding of Azure services like Data Factory, Databricks, and Machine Learning. Azure certification is a plus.
• Strong proficiency in SQL, Python and PySpark. Proven ability to optimize SQL queries and performance tune data pipelines.
• Experience in building and operating highly available, distributed data pipelines for large-scale data ingestion, processing, and extraction.
• Experience integrating multi-cloud services with on-premises technologies. Strong understanding of data modeling processes.
• Proven ability to solve complex data problems, collaborate effectively with cross-functional teams, and deliver high-quality solutions.

Nice to have:

Agile experience, Dataiku, Power BI

Rate: $50-$60/hr (depends on experience level).

About The Company

Peterson Technology Partners (PTP) is an Equal Opportunity Employer committed to creating a transparent, inclusive, and human-centered hiring experience.

For more than 28 years, PTP has operated as one of the top IT staffing and recruiting firms in the USA built on trust, long-term partnerships, and technical excellence.

Based in the Chicago suburb of Park Ridge, IL, our team of more than 500 employees and consultants is dedicated to:

Helping every client make the best hiring decisions possible

Matching professionals with the right IT jobs and career opportunities

As part of that commitment, we believe in providing clear information about how our hiring technologies work and how your data is used. The following section outlines our AI-assisted interview process and your rights as a candidate.

AI-Assisted Interview Experience (Pete & Gabi Rebecca)

To provide a consistent, fair, and flexible experience for all candidates, we use AI-assisted tools to support parts of the interview process. This includes our proprietary AI platform Pete & Gabi, which includes AI recruiter Rebecca.

These AI hiring tools help us:

• Transcribe interviews
• Summarize candidate responses
• Generate job-related insights
• Streamline communication and scheduling

Please note that:

The AI does NOT make hiring decisions; all decisions are made by our human recruiters, hiring managers, or client partners.

The AI does not evaluate facial expressions, emotions, or physical traits; it is used only to support fairness, consistency, and efficiency.

If you prefer a non-AI interview format, we will gladly provide an alternative.

Technical or Case Interviews (Role-Dependent):

When applying for certain tech jobs, you may participate in:

• A technical interview
• A coding challenge
• A case study
• A client-specific assessment

We will always explain what to expect in advance so you can prepare with confidence.

Human Review & Selection:

Every candidate's profile including interviews, conversations, and assessments is reviewed by experienced recruiters and hiring leaders.

AI insights may assist with organization and evaluation, but final decisions are always human-driven.

Your Rights as a Candidate:

At PTP, every candidate has the right to:

Request a non-AI interview path

Ask how your data is being used

Request access to transcripts or interview recordings

Request deletion of your AI-recorded interview

Receive clear, timely communication

Our goal is to ensure you feel respected, informed, and supported throughout your experience.

Our Commitment:

For more than 28 years, PTP has focused on putting people first candidates, consultants, employees, and clients.

We're committed to a hiring process that is:

• Transparent
• Compliant
• Equitable
• Powered by innovative technology that enhances not replaces human judgment

Welcome to the future of hiring at Peterson Technology Partners.

We're excited to learn more about you.

Equal Employment Opportunity:

Peterson Technology Partners is an Equal Opportunity Employer. All qualified applicants will receive consideration without regard to race, color, religion, national origin, gender identity, sexual orientation, disability, veteran status, or any other protected characteristic.