Pyspark jobs in boston, ma

Remote

•

Today

Job Description We are seeking a highly skilled Senior PySpark Developer to support a large-scale cloud transformation initiative focused on building modern data platforms on Cloudera, Apache Iceberg, Airflow, and AWS. The role will be responsible for designing, developing, and optimizing scalable data pipelines that ingest, transform, and process large volumes of enterprise data. The successful candidate will work closely with data architects, business analysts, cloud engineers, and applicatio

Easy Apply

Contract

50 - 60

Sr PySpark Developer

Remote

•

Today

Senior PySpark Developer (Cloudera, Iceberg, Airflow & AWS) Location: Remote Job Description We are seeking a highly skilled Senior PySpark Developer to support a large-scale cloud transformation initiative focused on building modern data platforms on Cloudera, Apache Iceberg, Airflow, and AWS. The role will be responsible for designing, developing, and optimizing scalable data pipelines that ingest, transform, and process large volumes of enterprise data. The successful candidate will work clos

Easy Apply

Contract

Depends on Experience

Senior Data Software Engineer with AWS, LLM, PySpark

Remote

•

Today

We are seeking a highly motivated Senior Data Software Engineer to design, build, and maintain modern cloud-based data platforms while enabling the next generation of AI and Copilot solutions. The ideal candidate will have strong expertise in AWS data ecosystems, PySpark, and experience developing AI-powered solutions using large language models and Generative AI applications. Responsibilities Design and implement scalable ETL/ELT pipelines Build and optimize data ingestion frameworks from APIs,

Full-time

Databricks Engineer (Hybrid Onsite & In Person Interview)

Hybrid in Boston, Massachusetts

•

3d ago

Job Title : Databricks Engineer Location: Boston, MA (3- 4 days a week Hybrid onsite) Duration : Long term contract Contract: W2 / C2C Interview: In Person Core Skills: AWS, Databricks, Scala-Spark Programming, SQL Overall experience 7 to 8 years in Scala-Spark data engineering and Data pipeline designExperience in databricks is requiredHands on experience in Design and development of Ingestion pipeline, ETL pipeline and jobs in Databricks. Databricks workspace and cluster configuration and Job

Easy Apply

Contract

65 - 75

Senior Data Engineer

Boston, Massachusetts

•

Today

At WHOOP, we're on a mission to unlock human performance and healthspan. WHOOP empowers members to perform at a higher level through a deeper understanding of their bodies and daily lives. WHOOP is hiring a Senior Data Engineer to lead the design, development, and evolution of the data systems that power analytics, experimentation, machine learning, and business decision-making across the company. In this role, you will own complex data engineering initiatives from design through production, pa

Full-time

USD 150,000.00 - 215,000.00 per year

Senior Data Scientist - Marketing & Consumer Analytics

Wellesley, Massachusetts

•

Today

We're building a world of health around every individual - shaping a more connected, convenient and compassionate health experience. At CVS Health , you'll be surrounded by passionate colleagues who care deeply, innovate with purpose, hold ourselves accountable and prioritize safety and quality in everything we do. Join us and be part of something bigger - helping to simplify health care one person, one family and one community at a time. Position Summary We're hiring a Senior Data Scientist to

Full-time

USD 111,240.00 - 222,480.00 per year

Lead AI/ML Engineer-Remote Nationwide or Hybrid in MN/DC

Remote or Boston, Massachusetts

•

Today

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health op

Full-time

USD 145,500.00 - 249,500.00 per year

Software Test Automation Engineer

Quincy, Massachusetts

•

11d ago

Software Test Automation Engineer (State Street Bank and Trust Company; Quincy, MA): The Software Testing Automation Engineer will play a key role in the quality assurance of AML Transaction Monitoring suite of applications. This role will be responsible for developing and maintaining the automation framework including Cloud technologies like Databricks, AWS, Python, PySpark, Airflow, ETL. Adopt and implement the new automated tools and technologies which will be suitable for AML program to impr

Full-time

Software Test Automation Engineer

Quincy, Massachusetts

•

Today

Full-time

T26-9724; Software Engineering & Development, VP

Boston, Massachusetts

•

Today

We are seeking a experienced Development Lead with expertise in Java and Spring Boot backend development, combined with knowledge in Databricks and modern data engineering technologies. This role is focused on hands-on development, technical leadership, and delivery execution for large-scale, production-grade platforms. The Lead will actively contribute to development while guiding teams, ensuring high code quality, performance, and reliability. The role works closely with Business, QA, DevOps,

Full-time

USD 120,000.00 - 202,500.00 per year

T26-9724; Software Engineering & Development, VP

Boston, Massachusetts

•

5d ago

Full-time

USD 120,000.00 - 202,500.00 per year

Software Engineering Lead - Investment Analytics, VP - State Street Investment Management

Boston, Massachusetts

•

9d ago

Who We Are Looking For State Street Investment Management is seeking a highly experienced Software Engineering Lead to join our Investment Analytics Application Development team. The ideal candidate brings strong financial domain knowledge and deep technical expertise, with experience building and supporting systems that process, analyze, and deliver investment and financial data for portfolio management, research, risk, and reporting use cases. While experience with performance measurement and

Full-time

USD 110,000.00 - 188,750.00 per year

Data Engineer, Officer - State Street Investment Management

Quincy, Massachusetts

•

3d ago

Who we are looking for State Street Investment Management's Data, Analytics & AI Services (DAAIS) team is looking for a Data Engineer - Officer to be part of the architecture, engineering execution, modernization strategy, and technology roadmap supporting the investment management business. The successful candidate will bring hands-on development expertise in large-scale data platform architecture, distributed computing, data pipeline engineering, and modern cloud architecture. Why this role i

Full-time

USD 70,000.00 - 118,750.00 per year

Data Engineer, Officer - State Street Investment Management

Quincy, Massachusetts

•

Today

Full-time

USD 70,000.00 - 118,750.00 per year

Tech Enterprise Data Governance - Sr Developer AVP

Quincy, Massachusetts

•

Today

Description Enterprise Data Governance organization is recruiting a Data Governance Senior Developer to help drive Collibra Data Intelligence platform implementation. As a Senior Developer will collaborate with Architects and Business unit data governance leads and solutions team to rollout the solution capabilities for the data governance platform. The Engineer should have good understanding of using AI in Data Governance , Data Products, Data Contracts design to implement Data Governance on

Full-time

USD 90,000.00 - 157,500.00 per year

Data Platform Engineer

Remote or Toronto, Ontario

•

Today

Job Title: Data Platform Engineer Location: Remote (Canada) Employment Type: Full-Time Contract Job Summary We are seeking an experienced Data Platform Engineer to design, build, and enhance a cloud-native data platform on AWS and Snowflake. The ideal candidate will have strong expertise in data ingestion, transformation, orchestration, metadata management, and data quality, while building scalable and reliable data pipelines that support enterprise analytics and reporting. Key Responsibiliti

Easy Apply

Contract, Third Party

Azure Data Architect

Remote

•

5d ago

Sr. Data Architect- Remote- US, Canada, LATAM location are all ok We are seeking a highly skilled and experienced Sr Data Architect to join our team. As a Sr Data Architect, you will be responsible for designing, implementing, and managing data architecture on cloud platforms for our clients. Your expertise will play a critical role for our clients in shaping data strategy, ensuring efficient data integration, storage, and accessibility while maintaining data security and compliance. Key Respons

Easy Apply

Full-time

$180,000 - $190,000

Platform Engineering Lead, VP

Quincy, Massachusetts

•

Today

Who we are looking for We're looking for a dynamic and forward-thinking leader who's passionate about shaping the future of technology at scale. If you thrive at the intersection of innovation and execution, and enjoy turning cutting-edge trends into practical enterprise solutions, this role is for you. As a hands-on strategist, you'll guide the development and evaluation of advanced capabilities across diverse business domains, while mentoring teams and influencing stakeholders. The ideal cand

Full-time

USD 120,000.00 - 217,500.00 per year

Data Engineering and Development VP

Quincy, Massachusetts

•

Today

Full-time

USD 120,000.00 - 217,500.00 per year

Palantir Forward Deployed Engineer

Remote

•

Today

JOB DETAILS: Job Title: Palantir Forward Deployed Engineer Location: 100% Remote Contract Duration: 06 plus months contract with extensions (long -term contract) Job Description: Key Responsibilities Technical Leadership & Architecture Design, build, and deploy end-to-end data integration pipelines using Palantir Foundry, including complex transforms, incremental pipelines, and multi-source data connectorsArchitect and maintain the Ontology layer defining object types, link types, action typ

Easy Apply

Contract

$90 - $114

Pyspark jobs in Boston, MA, USA