apache spark Jobs in chicago, il

Refine Results
281 - 300 of 337 Jobs

Senior Full Stack Developer Lead - Inventory Management - JERSEY CITY

Citi

Remote or Jersey City, New Jersey, USA

Full-time

As part of the Inventory Management Applications Suite, Senior Application Developer is responsible for leading very high volume / low latency enterprise multi-tiered Java applications to provide cutting edge solutions for the Stock Record and related Application in the Capital Markets domain while following the industry best practices and Citi standards. The primary responsibility will be leading the design and development and providing Level 3 support for these applications. Coordination betwe

Senior Data Engineer

iSpace, Inc

Remote

Contract

JOB DETAILS: Title: Senior Data Engineer Location: Remote Work (Team is based out in Century City, CA and NYC, NY) Type: 06 -12 plus months contract (extendable) Job Description: Looking for Senior Data Engineer with a passion for building robust, scalable, efficient, and high-quality Data Engineering solutions to join our Engineering team. If you enjoy designing and building innovative data engineering solutions using the latest tech stack in a fast-paced environment, this role is for you. P

Principal Data/Information Architect

CVS Health

Remote or Dallas, Texas, USA

Full-time

At CVS Health, we're building a world of health around every consumer and surrounding ourselves with dedicated colleagues who are passionate about transforming health care. As the nation's leading health solutions company, we reach millions of Americans through our local presence, digital channels and more than 300,000 purpose-driven colleagues - caring for people where, when and how they choose in a way that is uniquely more connected, more convenient and more compassionate. And we do it all w

Full Stack Engineer(Java)-Data Modeling - VP - TAMPA

Citi

Remote or Tampa, Florida, USA

Full-time

Citi: Citi, the leading global bank, has approximately 200 million customer accounts and does business in more than 160 countries and jurisdictions. Citi provides consumers, corporations, governments, and institutions with a broad range of financial products and services, including consumer banking and credit, corporate and investment banking, securities brokerage, transaction services, and wealth management. As a bank with a brain and a soul, Citi creates economic value that is systemically r

REMOTE: Senior Lead Consultant (Databricks Architect)

Apex Systems

Remote or Glen Allen, Virginia, USA

Full-time

Job#: 2036578 Job Description: SENIOR LEAD CONSULTANT (DATABRICKS ARCHITECT) WHO WE ARE Apex Systems is a leading global technology services firm that incorporates industry insights and experience to deliver solutions that fulfill our clients' digital visions. We provide a continuum of services, including strategy and enablement, innovation and productivity, and technology foundations to drive better results and bring more value to our clients.?Apex transforms our customers with modern enterpr

Solutions Engineer (Pharmacy Business Domain)

Helishores Inc

Deerfield, Illinois, USA

Contract, Third Party

Role: Solutions Engineer (Pharmacy Business Domain) Location: Deerfield, IL (Hybrid - 3 days/week onsite) Visa: No Transfers, GC Required: 10+ years in full-stack or backend software development. Experience with Python, Spark, Databricks, Azure Event Hub, ADF, Delta Tables Strong understanding of Spark and Azure data services. Experience with cloud platforms, preferably Azure. Familiarity with integrations, SDKs, and system architecture design. Knowledge of databases (SQL and/or NoSQL) and data

Data Engineer

VC5 Consulting

Bolingbrook, Illinois, USA

Contract

Were looking for a mid-to-senior level Data Engineer to support advanced AI and personalization initiatives in the retail space. Youll be part of a cross-functional team focused on delivering high-impact customer experiences powered by machine learning. This role will focus on building scalable, production-ready data pipelines using tools like Google Cloud Platform, Databricks, Python, and Spark. Ideal candidates have experience supporting ML pipelines and are comfortable in fast-paced, high-vi

ML Engineer

VC5 Consulting

Bolingbrook, Illinois, USA

Contract

Machine Learning Engineer Contract to Hire Were working with an innovative retail brand thats transforming its customer experience through AI and machine learning. Theyre looking for a Machine Learning Engineer to join their team and help scale their personalization initiatives. In this role, youll work closely with data scientists and engineering teams to build and deploy models on modern cloud and data platforms. Youll need strong skills in: Python TensorFlow Spark Experience with GCP and

Director of Java Kafka Software Engineering

Request Technology, LLC

Chicago, Illinois, USA

Full-time

We are unable to sponsor for this permanent full-time role Position is bonus eligible Prestigious Financial Institution is currently seeking a Director of Software Engineering with strong Java and Kafka experience. Candidate will be responsible for leading a team of skilled software engineers designing and delivering scalable and resilient hybrid and Cloud-based applications and data solutions supporting critical financial market clearing and risk activities; helping to drive the strategy of tra

Hadoop Developer

Innova Solutions, Inc

Chicago, Illinois, USA

Contract

A client of Innova Solutions is looking for a Hadoop Developer Position type: Contract Duration: Long Term Location: Chicago, IL/Denver, CO As a Hadoop Developer, you will: Strong SQL Skills one or more of MySQL, HIVE, Impala, SPARK SQLData ingestion experience from message queue, file share, REST API, relational database, etc. and experience with data formats like json, csv, xmlExperience working with SPARK Structured steamingExperience working with Hadoop/Big Data and Distributed SystemsWork

Big Data Engineer - (Remote / Only for W2)

Primus Software Corp

US

Contract

Job Title: Big Data Platform Development Engineer Duration: 6 - 7+ months Contract Possibility of extension Locations: Remote - Texas *Only W2 Candidates* Discription: You will evolve the data cloud platform and building pipelines that are scalable, robust and resilient, to validate, ingest, normalize/enrich and support business rule processing of data. You will provide leadership in big data and cloud technologies. 5+ years of experience with Big Data pipelines with Spark in Java, Scala, Pyth

Senior .Net Developer - Asset Management Investments

LTIMindtree

Chicago, Illinois, USA

Full-time

About Us: LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700+ clients, LTIMindtree brings extensive domain and technology expertise to help drive superior competitive differentiation, customer experiences, and business outcomes in a converging world. Powered by nearly 9

Google Cloud Platform Data Migration Consultant

TekDallas

Remote

Contract

Position: Google Cloud Platform Data Migration Consultant Location: 100% Remote (EST time zone) Contract Duration: long Term Only W2 Qualifications: 8+ years of overall IT ExperiencePrior migration experience from Snowflake DB to Google Cloud PlatformMust have basic ETL tasks and Python, PySpark, SQL experience. Strong with PySpark (esp. Spark SQL) for complex transformation pipelinesHands-on with Airflow for orchestration and BigQuery SQL for querying and data modelingGood experience in Goog

Databricks Platform Architect

People Force Consulting Inc

Remote

Contract

This role offers candidates the opportunity to work with cutting-edge cloud and data technologies, gain expertise in Databricks architecture, optimize performance and costs, and contribute to building a scalable global platform. It s a great chance to enhance skills in data engineering, security, and multi-region deployments while collaborating with industry professionals. Job Description Deep understanding of Databricks architecture, including clusters, notebooks, jobs, and the underlying compu

Data Engineer

Charter Solutions Inc.

Remote

Full-time

Data Engineer Information Technology Job Description: Data Engineer Data Engineer Roles and Responsibilities: Collect and process raw data at scale for a variety of projects and initiatives Design and develop data applications using selected tools and frameworks as required and requested for a variety of teams and projects Read, extract, transform, stage and load data to selected tools and frameworks as required and requested Perform tasks such as writing scripts, web scraping, calling API

Azure Data Engineer

Zealogics

Remote

Contract

Responsibilities: Able to participate in business discussions and assist gathering data requirements. Good analytical and problem-solving skills to help address data challenges. Proficiency in writing complex SQL queries for data extraction, transformation, and analysis. Knowledge of SQL functions, joins, subqueries, and performance tuning. Able to navigate source systems with minimal guidance to understand how data is related and use like data profiling to gain a better understanding of the

Google Cloud Platform Engineer

SGS Consulting

Remote

Contract

Title: Google Cloud Platform Engineer Location: 100% Remote Job ID: Google Cloud Platform0513 Job Duration: 06 Months (High Chances of Extension) The incumbent is responsible for the definition, development, and implementation of new systems, and major enhancements to existing systems, as well as production support for systems with high complexity. The incumbent is capable of providing project leadership for major feasibility or business systems analysis studies. Required Qualifications: Bachel

QA/QC Data Validation Consultant_Remote

Libsys, Inc.

Remote

Contract

Responsibilities Data Validation: Analyze and validate data for accuracy, completeness, and consistency.Quality Assurance: Develop and implement data quality standards and processes.Issue Resolution: Identify and resolve data quality issues, ensuring compliance with regulations.Collaboration: Work with IT and data management teams to design and implement data strategies.Reporting: Generate data reports and presentations for management. Skill Strong experience in data validation and data quality

data engineer with ML

Impetus IT

Remote or Seattle, Washington, USA

Full-time

We are partnering with one of our staffing partners who is searching for a Data engineer with Machine learning experience to design, develop, and optimize scalable data pipelines and infrastructure for ML-driven applications. The ideal candidate will have experience in big data technologies, ETL processes, and model deployment to support advanced analytics and AI initiatives.Salary $50k-70k slight flexibility for a good candidate.Due to low rates only direct applicants no c2c candidates please.

GenAI Architect

MASH Pro Tech

Remote

Contract, Third Party

Role : GenAI Architect Location: Remote Primary Skills: (AI Data Scientist)Deep Expertise in the following:Large Language Models (LLMs) and Multimodels Foundation Model Architectures (Transformers, Encoder/Decoder) API integration from providers like (e.g., OpenAI, Cohere). Model tuning pipeline development Prompt engineering Reinforcement learning from human feedback (RLHF). Frameworks : PyTorch, TensorFlow,LangChain, LlamaIndex Strong programming skills in Python, and experience with data en