PySpark jobs in Cambridge, MA

Senior Data Software Engineer/ AWS, Databricks, PySpark

Remote

•

Today

We are looking for a Senior Data Software Engineer to join a team that builds and maintains data infrastructure and platform tooling for a large engineering organization. The work spans cross-region data exchange solutions, Databricks-based data sharing infrastructure, and backend integrations used daily by engineers across multiple regions. Responsibilities Design and implement solutions for cross-region data exchange in environments with strict regulatory and security requirements Build and ma

Full-time

Senior Data Software Engineer/ Databricks, Apache Spark, PySpark

Remote

•

Today

We are seeking a skilled Senior Data Software Engineer with strong expertise in PySpark , SQL , and unit testing to join our data engineering team. The ideal candidate will have hands-on experience with Apache Spark , preferably within the Databricks environment, and will be responsible for building scalable data pipelines, optimizing data workflows, and ensuring code quality through rigorous testing practices. Responsibilities Design, develop, and maintain scalable data pipelines using Apache S

Full-time

Senior Data Engineer/ Databricks, PySpark, Python

Remote

•

Today

We are looking for an experienced Senior Data Engineer / Databricks Engineer to join a project focused on collecting, processing, and analyzing vehicle telemetry data for a major European automotive manufacturer. The platform operates at a significant scale, processing tens of terabytes of telemetry data in Azure Databricks and running approximately 200 Databricks jobs. The solution is currently in the production maintenance and evolution phase and is deployed across multiple regions, including

Full-time

IT Engineer (Python, PySpark, AWS, RestAPI)

Remote

•

7d ago

Systems Engineering Services is seeking a IT Engineer based in the Washington DC area to work on site 3-4 Days a week in the Reston Town Center Area. Top 5 Technical Skills: PythonPysparkRest APIAWSGenerative AI and LLMSQLJob Description: Description: Local candidates preferred, with an expectation to be in RTC 3-5 days per weekExcellent communication and written skillsAbility to work independentlyHands-on Generative AI and LLM expertise, including AI agents, Retrieval-Augmented Generation (RAG)

Easy Apply

Full-time

Depends on Experience

Databrick Engineer

Boston, Massachusetts

•

Today

Job Requirements Databrick Eng - Pyspark, Databricks, AWS

Full-time

ETL Tester

Boston, Massachusetts

•

12d ago

Excellent understanding and hands on experience in PySpark Automation and API AutomationHands on experience on PySpark and Analytical Functions and complex queries.Must have Knowledge on Databricks, PySpark, Spark SQL.Strong understanding of Entity Resolution concepts.Should have excellent knowledge in STLC process -include creating, maintaining, and executing automation/functional test plans, writing test scripts against software platforms, communicating test results, defect tracking and partic

Contract

BI/Microsoft Fabric Engineer

Boston, Massachusetts

•

Today

Key Responsibilities Build and implement solutions within a newer Microsoft Fabric environment Develop data pipelines for data ingestion and processing Design scalable data architectures using OneLake and Lakehouse architecture Deliver business intelligence solutions using Power BI Perform data modeling to support BI and analytics needs Apply data governance practices within the Fabric environment Work with Snowflake, Spark/PySpark, Dataverse, DAX, and Fabric pipelines as needed Required

Easy Apply

Contract

DOE

Databricks Admin

Marlborough, Massachusetts

•

24d ago

Role: Data Bricks Admin Jobtype:Fulltime Location: Marlborough, MA - Onsite Job Description Databricks Administration, Terraform, AWS cloud services, MLflow, Workflows, Databricks Asset Bundles, AWS IAM, VPC, private endpoints, firewalls, S3, SQL + PySpark, dbx CLIDatabricks Platform Administration including environment setup, user and group management, Access control configuration and familiarity with networking and firewall rules Cluster and Resource ManagementOperational Support strong troub

Easy Apply

Full-time

100,000 - 130,000

Data Scientist Graduate Co-op

Cambridge, Massachusetts

•

Today

MORSE Corp is an employee owned, small business based in Cambridge, MA, Arlington, VA, and Seattle, WA with a history of fielding cutting-edge technology. MORSE boasts a specially selected team of scientists, engineers, and software developers to deliver best-in-class technical solutions that solve difficult multidisciplinary problems faced by the US National Security Ecosystem. MORSE Corp is seeking Data Scientist Graduate co-ops to help develop analysis and application software for artificial

Full-time

USD 28.00 - 37.00 per hour

SSB-Databrick Eng

Boston, Massachusetts

•

Today

Job Requirements .Data Engineer (Databricks & AWS) - Realty Data Platform Role Summary We are seeking a Data Engineer to help design, build, and scale a modern Realty Data Platform on AWS and Databricks. This role will be responsible for developing data pipelines, integrating data from multiple internal and external sources, and creating trusted datasets that support analytics, reporting, and AI/ML-driven insights across the Real Estate organization. The ideal candidate combines strong hands-o

Full-time

ETL Tester || Boston MA

Boston, Massachusetts

•

23d ago

ETL Tester 5 Days onsite Please submit the resumes on the below positions ID only Target Company : BlackRock: The largest asset manager, direct competitor in ETFs and index funds.Vanguard Group: A dominant force in index investing and passive management.Fidelity Investments: A major competitor in investment management and services.Amundi: A large European asset manager with a strong global presence Primary Skillset Secondary Skillset Strong Spark SQL/PySpark, Data Bricks , AWS Concepts , Agile

Easy Apply

Contract

Depends on Experience

Senior Associate, Data Analyst/Data Engineer

Quincy, Massachusetts

•

Today

We are currently seeking an entry level data analyst/data engineer to help us collect, transform and extract meaning from data for the Global Technology Services (GTS) Control Tower team at State Street. The position performs a wide range of activities with experts from GTS, business intelligence, business analysis, data engineering, process engineering, governance, and data analysts to collaboratively solve a wide array of complex technical problems. About the GTS Control Tower team The GTS C

Full-time

Senior Associate, Data Analyst/Data Engineer

Quincy, Massachusetts

•

6d ago

Full-time

Data Engineer

Somerville, Massachusetts

•

Today

Site: Mass General Brigham Incorporated Mass General Brigham relies on a wide range of professionals, including doctors, nurses, business people, tech experts, researchers, and systems analysts to advance our mission. As a not-for-profit, we support patient care, research, teaching, and community service, striving to provide exceptional care. We believe that high-performing teams drive groundbreaking medical discoveries and invite all applicants to join us and experience what it means to be par

Full-time

USD 75,275.20 - 109,553.60 per year

Data Engineer Role

Remote

•

11d ago

Role- Data Engineer Location- New York Job Description We are seeking an experienced Data Engineerto join our team and build robust, scalable data pipelines. In this role, you will: Design and implement scalable PySpark data pipelines for batch and streaming workloads Optimize Spark jobs and queries for performance and cost efficiency Build and maintain ETL/ELT processes following data engineering best practices Troubleshoot and resolve complex data pipeline and processing issues Collaborate wi

Easy Apply

Full-time

Depends on Experience

Data Engineering Career Opportunity

Remote

•

28d ago

Hi, Are you looking to start a career in Data Engineering, transition from another IT role, or strengthen your existing data skills? Explore a structured, industry-focused Data Engineering careerdesigned around the technologies and skills commonly used in modern cloud data environments. What Youll Explore Programming & Databases Python programming Advanced SQL Data structures and data processing concepts Relational databases and query optimization Cloud & Data Platforms Microsoft Azure

Easy Apply

Full-time, Third Party

Depends on Experience

Databricks Engineer

Remote

•

7d ago

Employment Type: W2 Only Desired Skills Experience with the Databricks Lakehouse Platform Strong knowledge of Apache Spark, PySpark, Python, SQL, or Scala Experience developing and optimizing data pipelines Knowledge of Delta Lake, Delta Live Tables, Unity Catalog, and Databricks Workflows Experience with data warehousing, data lakes, ETL, and ELT processes Understanding of data governance, security, access controls, and platform administration Experience integrating Databricks with AWS, M

Easy Apply

Full-time, Third Party

$70 - $80

Data Architect

Remote

•

7d ago

About the Company Blackstraw.ai is an end-to-end technology services company specializing in Artificial Intelligence (AI) and Engineering solutions across Data Science, Data Engineering, LLM/GenAI and LLMOps. Founded in 2018, we help global enterprises across North America, Europe and Asia to build and operationalize AI systems that create measurable business impact. Our mission is to make AI adoption simpler, faster and scalable through a blend of deep domain expertise, reusable accelerators an

Easy Apply

Full-time

Depends on Experience

Senior Data Lakehouse Architect (Databricks), Vice President

Quincy, Massachusetts

•

10d ago

Senior Data Lakehouse Architect (Databricks), Vice President Corporate Functions Technology Who We Are Looking For We are seeking a Senior Data Lakehouse Architect to design and lead the build-out of a Legal Data Lakehouse platform on AWS and Databricks . This role will drive the architecture, engineering, and governance of scalable, secure, and compliant data capabilities supporting legal operations, contract intelligence, eDiscovery, and AI/ML use cases. The ideal candidate brings deep expe

Full-time

USD 120,000.00 - 202,500.00 per year

Databricks Consultant ---- 12+ year experience required

Remote

•

16d ago

Need W2 independent candidate'sJob Overview: Seeking an experienced Databricks Consultant with 12+ years of data engineering and analytics experience. The ideal candidate will have strong expertise in Databricks, SQL, Apache Spark, and modern data platforms, with experience designing and implementing scalable data solutions.Key Skills:12+ years of IT/Data Engineering experienceStrong hands-on experience with Databricks, Spark & SQLExpertise in PySpark and data pipeline developmentExperience with

Easy Apply

Contract

Depends on Experience

PySpark jobs in Cambridge, MA, USA