Jr. Data Engineer – Databricks / PySpark / Power BI

Role: Jr. Data Engineer – Databricks / PySpark / Power BI
Location: Lincolnshire, IL – Onsite
Duration: 12 Months

Job Overview:

We are seeking an experienced Data Engineer to take ownership of enterprise data engineering, analytics, and production support initiatives. This is a hands-on technical role requiring strong expertise in SQL, Databricks, PySpark, and Power BI, along with the ability to work directly with client stakeholders and coordinate distributed/offshore engineering teams.

The ideal candidate will be responsible for the full lifecycle of data solutions—from requirements and architecture through development, production support, troubleshooting, optimization, and continuous improvement.

Key Responsibilities:

• Design, develop, enhance, and support enterprise-scale data pipelines and data-driven business solutions.
• Build and optimize robust ETL/ELT pipelines using Databricks, PySpark, and advanced SQL.
• Develop efficient data models and perform SQL query optimization, performance tuning, and troubleshooting.
• Develop and maintain Power BI dashboards, reports, semantic/data models, and analytics solutions, including DAX.
• Translate business and functional requirements into scalable technical data solutions.
• Partner directly with client stakeholders to understand requirements, communicate technical solutions, and manage expectations.
• Take ownership of production support, including incident investigation, troubleshooting, problem resolution, and root cause analysis (RCA).
• Drive continuous improvement initiatives focused on performance, reliability, automation, scalability, and operational efficiency.
• Coordinate with offshore development/support teams, monitor delivery, and ensure solutions meet quality and timeline expectations.
• Identify opportunities to automate repetitive processes and improve development and operational workflows.
• Support data platform enhancements, releases, and production deployments while maintaining platform stability.
• Provide technical guidance and ensure end-to-end ownership of assigned data engineering initiatives.

Required Qualifications:

• 5+ years of overall IT experience, with at least 4+ years in Data Engineering and Analytics.
• Expert-level SQL skills, including query optimization, complex queries, data modeling, and performance tuning.
• Strong hands-on experience with Databricks, preferably in a Google Cloud Platform environment; experience must be with non-Azure Databricks.
• Strong development experience using PySpark for large-scale data processing and transformation.
• Advanced Power BI experience, including DAX, dashboard development, reporting, and data modeling.
• Proven experience designing, developing, and supporting large-scale ETL/ELT pipelines and enterprise data platforms.
• Hands-on experience with production support, incident management, troubleshooting, and RCA.
• Strong client-facing communication and stakeholder management skills.
• Experience working in an onsite/offshore delivery model and coordinating distributed engineering teams.
• Strong analytical and problem-solving skills with the ability to bridge business requirements and technical implementation.

Preferred Skills:

• Google BigQuery
• Python
• Delta Lake
• Data Lakehouse architecture
• CI/CD
• DataOps
• Data pipeline automation and performance optimization