Pyspark jobs in lake forest, il

Remote

•

Today

Job Description We are seeking a highly skilled Senior PySpark Developer to support a large-scale cloud transformation initiative focused on building modern data platforms on Cloudera, Apache Iceberg, Airflow, and AWS. The role will be responsible for designing, developing, and optimizing scalable data pipelines that ingest, transform, and process large volumes of enterprise data. The successful candidate will work closely with data architects, business analysts, cloud engineers, and applicatio

Easy Apply

Contract

50 - 60

Sr PySpark Developer

Remote

•

Today

Senior PySpark Developer (Cloudera, Iceberg, Airflow & AWS) Location: Remote Job Description We are seeking a highly skilled Senior PySpark Developer to support a large-scale cloud transformation initiative focused on building modern data platforms on Cloudera, Apache Iceberg, Airflow, and AWS. The role will be responsible for designing, developing, and optimizing scalable data pipelines that ingest, transform, and process large volumes of enterprise data. The successful candidate will work clos

Easy Apply

Contract

Depends on Experience

Senior Data Software Engineer with AWS, LLM, PySpark

Remote

•

Today

We are seeking a highly motivated Senior Data Software Engineer to design, build, and maintain modern cloud-based data platforms while enabling the next generation of AI and Copilot solutions. The ideal candidate will have strong expertise in AWS data ecosystems, PySpark, and experience developing AI-powered solutions using large language models and Generative AI applications. Responsibilities Design and implement scalable ETL/ELT pipelines Build and optimize data ingestion frameworks from APIs,

Full-time

Jr. Data Engineer – Databricks / PySpark / Power BI

Lincolnshire, Illinois

•

4d ago

Role: Jr. Data Engineer Databricks / PySpark / Power BI Location: Lincolnshire, IL Onsite Duration: 12 Months Job Overview:We are seeking an experienced Data Engineer to take ownership of enterprise data engineering, analytics, and production support initiatives. This is a hands-on technical role requiring strong expertise in SQL, Databricks, PySpark, and Power BI, along with the ability to work directly with client stakeholders and coordinate distributed/offshore engineering teams. The ideal

Easy Apply

Contract

Depends on Experience

Solution Architect – Microsoft Fabric (Azure Data Platform)

Chicago, Illinois

•

5d ago

Solution Architect Microsoft Fabric (Azure Data Platform) Chicago, IL (Day 1 Onsite) Contract Opportunity Role Summary Looking for a Solution Architect to design modern data platforms using Microsoft Fabric. Strong Azure data experience is mandatory; Fabric experience is optional. Mandatory Skills 1. Data Architecture Medallion architecture (Bronze/Silver/Gold) Data modeling (star schema, semantic layer) End-to-end data platform design 2. Azure Data Services (hands-on) Experience with multiple

Easy Apply

Contract

Depends on Experience

Senior Data Engineer

Chicago, Illinois

•

Today

Join a growing, data-driven organization that is investing heavily in its modern cloud data platform and analytics capabilities. We are seeking a Senior Databricks Data Engineer to design, build, and optimize enterprise-scale data solutions using Databricks, Azure, PySpark, Delta Lake, SQL, and modern cloud technologies. This is a full-time opportunity for an engineer who is passionate about building scalable data products and shaping the future of data architecture. You'll have the opportunity

Easy Apply

Full-time

$140000 - $170000

Data Platform Operations Engineer - Performance

Chicago, Illinois

•

Today

We are looking for a data-focused engineer with a strong operational focus to support the Performance Team's data platform at IMC. This role is responsible for the reliability, correctness, and performance of data systems that directly support performance analysis and decision-making. The role is production-facing and works closely with the Performance team and aligned stakeholders to ensure data workflows are robust, observable, and efficient. What you'll do: Own the operational health of th

Full-time

USD 185,000.00 - 225,000.00 per year

Data Platform Operations Engineer - Performance

Chicago, Illinois

•

11d ago

Full-time

USD 185,000.00 - 225,000.00 per year

Data Platform Engineer

Remote or Toronto, Ontario

•

Today

Job Title: Data Platform Engineer Location: Remote (Canada) Employment Type: Full-Time Contract Job Summary We are seeking an experienced Data Platform Engineer to design, build, and enhance a cloud-native data platform on AWS and Snowflake. The ideal candidate will have strong expertise in data ingestion, transformation, orchestration, metadata management, and data quality, while building scalable and reliable data pipelines that support enterprise analytics and reporting. Key Responsibiliti

Easy Apply

Contract, Third Party

Azure Data Architect

Remote

•

5d ago

Sr. Data Architect- Remote- US, Canada, LATAM location are all ok We are seeking a highly skilled and experienced Sr Data Architect to join our team. As a Sr Data Architect, you will be responsible for designing, implementing, and managing data architecture on cloud platforms for our clients. Your expertise will play a critical role for our clients in shaping data strategy, ensuring efficient data integration, storage, and accessibility while maintaining data security and compliance. Key Respons

Easy Apply

Full-time

$180,000 - $190,000

Palantir Forward Deployed Engineer

Remote

•

Today

JOB DETAILS: Job Title: Palantir Forward Deployed Engineer Location: 100% Remote Contract Duration: 06 plus months contract with extensions (long -term contract) Job Description: Key Responsibilities Technical Leadership & Architecture Design, build, and deploy end-to-end data integration pipelines using Palantir Foundry, including complex transforms, incremental pipelines, and multi-source data connectorsArchitect and maintain the Ontology layer defining object types, link types, action typ

Easy Apply

Contract

$90 - $114

System Development Engineer

Remote

•

Today

Position: System Development EngineerLocation: RemoteThe common nature of the work:Every one is a System Development Engineer (Contractor) position, Seattle-based, L5L6 equivalent, 1 opening each, sitting on the Region Flexibility Migration (RFM) team inside the clients Intelligent Cloud Hosting (ICON) organization. They all serve a single 2026 initiative: DRAM (memory) footprint reduction across the clients production service fleet essentially cost/efficiency and performance engineering, not n

Easy Apply

Contract

Depends on Experience

Databricks developer

Remote

•

Today

Required Skills 10+ years of experience with Databricks. Strong experience in PySpark, Spark SQL, and Python. Hands-on experience with Delta Lake and Databricks Workflows. Strong SQL and data modeling skills. Experience with Azure Databricks or AWS Databricks. Knowledge of Azure Data Factory (ADF), ADLS Gen2, or AWS S3. Experience with Git, Azure DevOps, or Jenkins. Understanding of data warehousing concepts and ETL best practices. Preferred Skills Experience with Unity Catalog, MLflow, and Delt

Easy Apply

Contract

50+

Lead Microsoft Fabric Architect & Administrator

Remote

•

12d ago

Job Title: Lead Microsoft Fabric Architect & Administrator Work Location: 100% Remote Long Term Contract If you find this opportunity suitable, kindly share your updated resume. Also, please let me know a good time to connect with you for a quick discussion. Looking forward to hearing from you! Job Description We are seeking a visionary Microsoft Fabric Architect & Administrator to lead our transition into a unified, AI-ready data ecosystem. In this role, you will be the primary owner of our Mi

Easy Apply

Full-time

Depends on Experience

Lead Data Engineer (Azure, Snowflake, DB) !!! Remote

Remote

•

4d ago

Role: Lead Data Engineer (Azure, Snowflake, DB) Location: Remote Duration: Long Term Skill Focus Azure , Snowflake, DB, ETL, Python, Pyspark, SnowSQL Key Responsibilities: Design and develop ETL/ELT pipelines using Azure Data Factory, Snowflake, and DBT. Build and maintain data integration workflows from various data sources to Snowflake. Write efficient and optimized SQL queries for data extraction and transformation. Work with stakeholders to understand business requirements and translate t

Easy Apply

Contract

Depends on Experience

Multiple Databricks Positions

Remote

•

5d ago

Location: Nationwide United States Employment Type: W2 Only C2C: Not Available Job Description CodeForce 360 is hiring Databricks professionals for multiple positions with our Fortune 1000, system integrator, and enterprise clients across the United States. Opportunities may be available onsite, hybrid, or remote, depending on client requirements. We are seeking candidates with knowledge or experience across various Databricks technologies, modules, and cloud environments. Posit

Easy Apply

Full-time, Third Party

$50 - $150

Data Analytics Technical Lead with Power BI

Remote

•

24d ago

Holds Databricks Certified Data Engineer Professional certification along with strong expertise across modern analytics ecosystems and cloud-native data platforms. Data Analytics Technical Lead with extensive hands-on experience in Databricks, including advanced data engineering, lakehouse architecture, and performance optimization, supported by relevant Databricks certifications. Proven expertise leading enterprise-scale analytics initiatives across modern cloud and big data platforms. Well-rou

Easy Apply

Full-time

Depends on Experience

Senior Databricks Solution Architect

Remote

•

7d ago

Senior Databricks Solution Architect 100% RemoteLong Term Contract Overview: We are seeking an experienced and dedicated Senior Solutions Architect to lead technical engagements and provide strategic guidance for our strategic client accounts. This high-impact role requires deep expertise in the Databricks Platform, acting as the client's primary technical advisor for complex data, analytics, and AI initiatives. You will bridge business objectives with technical execution, designing and deliver

Easy Apply

Third Party, Contract

$70 - $80

Data Engineer with Palantir Experience

Remote

•

3d ago

1+ years hands-on in Foundry, focused on a supply chain use case. 7+ in enterprise data engineering. Proficient in Pipeline Builder, Ontology, OSDK & Code Repo. Includes knowledge in Python, Pyspark, SQL. Has some full stack capability with React. Master''s in computer science.Palantir Foundry Aware Professional certification.RegardsRohit

Easy Apply

Contract

60,000 - 70,000

Junior Python AI / Data Engineer

Remote

•

4d ago

Core Focus: Building robust data pipelines, feature stores, and model-serving infrastructure using Python and SQL. Build, and optimize scalable ETL/ELT data workflows using Python, PySpark Pipeline Development: Design, build, and optimize scalable ETL/ELT data workflows using Python, PySpark

Easy Apply

Contract

60 - 70

Pyspark jobs in Lake Forest, IL, USA