Pyspark jobs in lincolnshire, il

Jr. Data Engineer – Databricks / PySpark / Power BI

Lincolnshire, Illinois

•

4d ago

Role: Jr. Data Engineer Databricks / PySpark / Power BI Location: Lincolnshire, IL Onsite Duration: 12 Months Job Overview:We are seeking an experienced Data Engineer to take ownership of enterprise data engineering, analytics, and production support initiatives. This is a hands-on technical role requiring strong expertise in SQL, Databricks, PySpark, and Power BI, along with the ability to work directly with client stakeholders and coordinate distributed/offshore engineering teams. The ideal

Easy Apply

Contract

Depends on Experience

Senior Data Software Engineer with AWS, LLM, PySpark

Remote

•

Today

We are seeking a highly motivated Senior Data Software Engineer to design, build, and maintain modern cloud-based data platforms while enabling the next generation of AI and Copilot solutions. The ideal candidate will have strong expertise in AWS data ecosystems, PySpark, and experience developing AI-powered solutions using large language models and Generative AI applications. Responsibilities Design and implement scalable ETL/ELT pipelines Build and optimize data ingestion frameworks from APIs,

Full-time

Solution Architect – Microsoft Fabric (Azure Data Platform)

Chicago, Illinois

•

5d ago

Solution Architect Microsoft Fabric (Azure Data Platform) Chicago, IL (Day 1 Onsite) Contract Opportunity Role Summary Looking for a Solution Architect to design modern data platforms using Microsoft Fabric. Strong Azure data experience is mandatory; Fabric experience is optional. Mandatory Skills 1. Data Architecture Medallion architecture (Bronze/Silver/Gold) Data modeling (star schema, semantic layer) End-to-end data platform design 2. Azure Data Services (hands-on) Experience with multiple

Easy Apply

Contract

Depends on Experience

Senior Data Engineer

Chicago, Illinois

•

Today

Join a growing, data-driven organization that is investing heavily in its modern cloud data platform and analytics capabilities. We are seeking a Senior Databricks Data Engineer to design, build, and optimize enterprise-scale data solutions using Databricks, Azure, PySpark, Delta Lake, SQL, and modern cloud technologies. This is a full-time opportunity for an engineer who is passionate about building scalable data products and shaping the future of data architecture. You'll have the opportunity

Easy Apply

Full-time

$140000 - $170000

Data Platform Operations Engineer - Performance

Chicago, Illinois

•

Today

We are looking for a data-focused engineer with a strong operational focus to support the Performance Team's data platform at IMC. This role is responsible for the reliability, correctness, and performance of data systems that directly support performance analysis and decision-making. The role is production-facing and works closely with the Performance team and aligned stakeholders to ensure data workflows are robust, observable, and efficient. What you'll do: Own the operational health of th

Full-time

USD 185,000.00 - 225,000.00 per year

Data Platform Operations Engineer - Performance

Chicago, Illinois

•

11d ago

Full-time

USD 185,000.00 - 225,000.00 per year

Data Platform Engineer

Remote or Toronto, Ontario

•

Today

Job Title: Data Platform Engineer Location: Remote (Canada) Employment Type: Full-Time Contract Job Summary We are seeking an experienced Data Platform Engineer to design, build, and enhance a cloud-native data platform on AWS and Snowflake. The ideal candidate will have strong expertise in data ingestion, transformation, orchestration, metadata management, and data quality, while building scalable and reliable data pipelines that support enterprise analytics and reporting. Key Responsibiliti

Easy Apply

Third Party, Contract

Azure Data Architect

Remote

•

4d ago

Sr. Data Architect- Remote- US, Canada, LATAM location are all ok We are seeking a highly skilled and experienced Sr Data Architect to join our team. As a Sr Data Architect, you will be responsible for designing, implementing, and managing data architecture on cloud platforms for our clients. Your expertise will play a critical role for our clients in shaping data strategy, ensuring efficient data integration, storage, and accessibility while maintaining data security and compliance. Key Respons

Easy Apply

Full-time

$180,000 - $190,000

Solution Architect/Data Engineer

Wood Dale, Illinois

•

Today

Description We are seeking a Solution Architect & Data Engineer to help design, build, and scale a strategic market analytics platform serving the global aerospace aftermarket. This role blends solution architecture, data engineering, analytics, and stakeholder engagement. The successful candidate will be responsible for translating business requirements into scalable technical solutions while remaining hands-on in the development of data pipelines, data models, analytics products, and AI-enable

Full-time

USD 150,000.00 - 170,000.00 per year

Palantir Forward Deployed Engineer

Remote

•

Today

JOB DETAILS: Job Title: Palantir Forward Deployed Engineer Location: 100% Remote Contract Duration: 06 plus months contract with extensions (long -term contract) Job Description: Key Responsibilities Technical Leadership & Architecture Design, build, and deploy end-to-end data integration pipelines using Palantir Foundry, including complex transforms, incremental pipelines, and multi-source data connectorsArchitect and maintain the Ontology layer defining object types, link types, action typ

Easy Apply

Contract

$90 - $114

System Development Engineer

Remote

•

Today

Position: System Development EngineerLocation: RemoteThe common nature of the work:Every one is a System Development Engineer (Contractor) position, Seattle-based, L5L6 equivalent, 1 opening each, sitting on the Region Flexibility Migration (RFM) team inside the clients Intelligent Cloud Hosting (ICON) organization. They all serve a single 2026 initiative: DRAM (memory) footprint reduction across the clients production service fleet essentially cost/efficiency and performance engineering, not n

Easy Apply

Contract

Depends on Experience

Senior Fabric ETL Developer

Remote

•

24d ago

Title: Senior Fabric ETL Developer Location: Remote Contract SUMMARY:Our client would like us to provide them with a Senior Developer with extensive experience in Microsoft Fabric, specializing in Lakehouse-based data processing and Fabric Notebooks utilizing PySpark. This role focuses on transforming curated Lakehouse data into standardized and custom text file extracts (e.g., CSV, TXT, pipe-delimited) for secure delivery to external vendors and partners. Additionally, the Developer will part

Easy Apply

Contract, Third Party

Depends on Experience

Databricks developer

Remote

•

Today

Required Skills 10+ years of experience with Databricks. Strong experience in PySpark, Spark SQL, and Python. Hands-on experience with Delta Lake and Databricks Workflows. Strong SQL and data modeling skills. Experience with Azure Databricks or AWS Databricks. Knowledge of Azure Data Factory (ADF), ADLS Gen2, or AWS S3. Experience with Git, Azure DevOps, or Jenkins. Understanding of data warehousing concepts and ETL best practices. Preferred Skills Experience with Unity Catalog, MLflow, and Delt

Easy Apply

Contract

50+

Lead Microsoft Fabric Architect & Administrator

Remote

•

12d ago

Job Title: Lead Microsoft Fabric Architect & Administrator Work Location: 100% Remote Long Term Contract If you find this opportunity suitable, kindly share your updated resume. Also, please let me know a good time to connect with you for a quick discussion. Looking forward to hearing from you! Job Description We are seeking a visionary Microsoft Fabric Architect & Administrator to lead our transition into a unified, AI-ready data ecosystem. In this role, you will be the primary owner of our Mi

Easy Apply

Full-time

Depends on Experience

Lead Data Engineer (Azure, Snowflake, DB) !!! Remote

Remote

•

4d ago

Role: Lead Data Engineer (Azure, Snowflake, DB) Location: Remote Duration: Long Term Skill Focus Azure , Snowflake, DB, ETL, Python, Pyspark, SnowSQL Key Responsibilities: Design and develop ETL/ELT pipelines using Azure Data Factory, Snowflake, and DBT. Build and maintain data integration workflows from various data sources to Snowflake. Write efficient and optimized SQL queries for data extraction and transformation. Work with stakeholders to understand business requirements and translate t

Easy Apply

Contract

Depends on Experience

Multiple Databricks Positions

Remote

•

5d ago

Location: Nationwide United States Employment Type: W2 Only C2C: Not Available Job Description CodeForce 360 is hiring Databricks professionals for multiple positions with our Fortune 1000, system integrator, and enterprise clients across the United States. Opportunities may be available onsite, hybrid, or remote, depending on client requirements. We are seeking candidates with knowledge or experience across various Databricks technologies, modules, and cloud environments. Posit

Easy Apply

Full-time, Third Party

$50 - $150

Data Analytics Technical Lead with Power BI

Remote

•

24d ago

Holds Databricks Certified Data Engineer Professional certification along with strong expertise across modern analytics ecosystems and cloud-native data platforms. Data Analytics Technical Lead with extensive hands-on experience in Databricks, including advanced data engineering, lakehouse architecture, and performance optimization, supported by relevant Databricks certifications. Proven expertise leading enterprise-scale analytics initiatives across modern cloud and big data platforms. Well-rou

Easy Apply

Full-time

Depends on Experience

Senior Databricks Solution Architect

Remote

•

6d ago

Senior Databricks Solution Architect 100% RemoteLong Term Contract Overview: We are seeking an experienced and dedicated Senior Solutions Architect to lead technical engagements and provide strategic guidance for our strategic client accounts. This high-impact role requires deep expertise in the Databricks Platform, acting as the client's primary technical advisor for complex data, analytics, and AI initiatives. You will bridge business objectives with technical execution, designing and deliver

Easy Apply

Third Party, Contract

$70 - $80

Databricks Data Engineer, Risk Technology

Chicago, Illinois

•

Today

We're building a relationship-oriented bank for the modern world. We need talented, passionate professionals who are dedicated to doing what's right for our clients. At CIBC, we embrace your strengths and your ambitions, so you are empowered at work. Our team members have what they need to make a meaningful impact and are truly valued for who they are and what they contribute. To learn more about CIBC, please visit CIBC.com What You'll Be Doing As a Databricks Data Engineer on the US Risk Te

Full-time

USD 120,000.00 - 160,000.00 per year

Data Engineer with Palantir Experience

Remote

•

3d ago

1+ years hands-on in Foundry, focused on a supply chain use case. 7+ in enterprise data engineering. Proficient in Pipeline Builder, Ontology, OSDK & Code Repo. Includes knowledge in Python, Pyspark, SQL. Has some full stack capability with React. Master''s in computer science.Palantir Foundry Aware Professional certification.RegardsRohit

Easy Apply

Contract

60,000 - 70,000

Pyspark jobs in Lincolnshire, IL, USA