PySpark jobs in Greenwich, CT

Senior Data Software Engineer/ AWS, Databricks, PySpark

Remote

•

Today

We are looking for a Senior Data Software Engineer to join a team that builds and maintains data infrastructure and platform tooling for a large engineering organization. The work spans cross-region data exchange solutions, Databricks-based data sharing infrastructure, and backend integrations used daily by engineers across multiple regions. Responsibilities Design and implement solutions for cross-region data exchange in environments with strict regulatory and security requirements Build and ma

Full-time

Senior Data Engineer/ Databricks, PySpark, Python

Remote

•

Today

We are looking for an experienced Senior Data Engineer / Databricks Engineer to join a project focused on collecting, processing, and analyzing vehicle telemetry data for a major European automotive manufacturer. The platform operates at a significant scale, processing tens of terabytes of telemetry data in Azure Databricks and running approximately 200 Databricks jobs. The solution is currently in the production maintenance and evolution phase and is deployed across multiple regions, including

Full-time

IT Engineer (Python, PySpark, AWS, RestAPI)

Remote

•

7d ago

Systems Engineering Services is seeking a IT Engineer based in the Washington DC area to work on site 3-4 Days a week in the Reston Town Center Area. Top 5 Technical Skills: PythonPysparkRest APIAWSGenerative AI and LLMSQLJob Description: Description: Local candidates preferred, with an expectation to be in RTC 3-5 days per weekExcellent communication and written skillsAbility to work independentlyHands-on Generative AI and LLM expertise, including AI agents, Retrieval-Augmented Generation (RAG)

Easy Apply

Full-time

Depends on Experience

Databricks Senior Data Engineer -Pyspark

New York, New York

•

17d ago

Hiring: Senior Data Engineer Databricks/PySpark Location: New York, NY Onsite Requirements: 7+ years of Data Engineering experience 4+ years hands-on with Databricks & Spark/PySpark Strong Python, SQL, Delta Lake Experience with AWS (S3, Glue) and Google Cloud Platform (BigQuery, GCS) Strong ETL/ELT, Spark optimization & data pipeline development Experience with CI/CD, Git, pytest Excellent communication and technical documentation skills Consulting/project delivery experience

Easy Apply

Contract, Third Party

Depends on Experience

Senior Data Software Engineer/ Databricks, Apache Spark, PySpark

Remote

•

Today

We are seeking a skilled Senior Data Software Engineer with strong expertise in PySpark , SQL , and unit testing to join our data engineering team. The ideal candidate will have hands-on experience with Apache Spark , preferably within the Databricks environment, and will be responsible for building scalable data pipelines, optimizing data workflows, and ensuring code quality through rigorous testing practices. Responsibilities Design, develop, and maintain scalable data pipelines using Apache S

Full-time

Azure Data Engineer

Hybrid in Montvale, New Jersey

•

Today

5+ years of experience in application support, technical leadership, or data-platform troubleshooting Hands-on Azure data engineering and Python experience Working knowledge of Databricks and PySpark, including notebooks, data transformations, and read/write operations Advanced T-SQL and data warehouse skills, including stored procedures, functions, execution plans, indexing, and query optimization Experience troubleshooting ETL pipelines, large datasets, data-quality issues, and performance or

Easy Apply

Contract

Depends on Experience

Senior Databricks Architect with MS Fabric

Hybrid in New York, New York

•

Yesterday

Mandatory Technologies: MS Fabric, Databricks, PySPark, Azure DevOPS, Databricks Genie, Agent Bricks & Insurance domain exp is preferred and plus. Responsibilities: Responsible for designing and implementing secure, scalable, and highly available cloud-based solutions in MS FabricExperience in enterprise adoption ensures the integration of modern, AI-driven capabilities and aligns architecture with key business outcomesMS Fabric, Databricks Architect to lead the design, architecture, and impleme

Easy Apply

Third Party, Contract

$80

Database Engineer

New York, New York

•

6d ago

A client of Innova Solutions is immediately hiring for a Database Engineer Position type: Full-time Contract (W2) Role: Database Engineer Duration: 4+ months Contract Location : New York, NY Remote role Must have Skills Python, Spark / PySpark, RESTful APIs, API versioning, input validation, pagination, and error standards in Python using FastAPI / Django / Flask, Airflow, Dagster, or similar Primary Skill Required for the Role: 5+ years of experience in Data Engineering or equivalent comb

Easy Apply

Contract

Depends on Experience

Data Engineer

Remote or New York, New York

•

Today

RESPONSIBILITIES: Kforce's client in NYC is seeking a highly skilled Data Engineer with strong hands-on experience in Apache Spark/PySpark, AWS EMR, Databricks, and Snowflake. The Data Engineer will be responsible for designing and building scalable, high-volume data pipelines, optimizing distributed data processing workloads, implementing data quality and observability frameworks, and resolving complex performance and production challenges across cloud-based data platforms. REQUIREMENTS: * Str

Contract

$74 - $74 hourly

Palantir Engineer / Foundry Engineer

New York, New York

•

24d ago

Role: Palantir Foundry EngineerWe are looking for a strong Palantir Foundry Engineer with hands-on experience building data solutions, applications, and workflows on the Palantir platform. Required Skills: Strong hands-on experience with Palantir Foundry Experience working with Foundry Ontology Objects, Links & Actions Strong Python / SQL / PySpark skills Experience building and maintaining data pipelines in Foundry Hands-on experience with Pipeline Builder / Code Repositories Experience with

Easy Apply

Full-time

$40,000 - $200,000

Data Modeler / Developer

Rutherford, New Jersey

•

Today

Grow your career with an innovative global bank in East Rutherford, NJ as a Data Modeler / Developer with strong SQL & PySpark. Contract role with strong possibility of extension. Will require working a hybrid schedule 3 days onsite per week. Join one of the world's most renowned global banks and trusted brand with over 200 years of continuously evolving financial services worldwide. You will work alongside some of the smartest minds in the industry who are excited to share their knowledge and t

Easy Apply

Contract

$86 - $94

Data/Database Administration - Data Engineer

Hybrid in Montvale, New Jersey

•

30+d ago

Data/Database Administration - Data Engineer - Montvale, NJ - Contract W2/C2C - $55-65 per HRJoin our team as a Data Engineer in a dynamic contract role based in Montvale, NJ. This position involves managing data platforms, supporting application operations, and troubleshooting data-related issues. You'll work with a variety of data technologies to ensure optimal data flow and integrity. DescriptionProvide technical support and leadership for application operations.Engage in troubleshooting and

Easy Apply

Third Party, Contract

$55 - $65

Data Engineer

Montvale, New Jersey

•

Today

Job Requirements .30354-1 Required Skillset: 5+ years of experience in application support, technical leadership, or data-platform troubleshooting Hands-on Azure data engineering and Python experience Working knowledge of Databricks and PySpark, including notebooks, data transformations, and read/write operations Advanced T-SQL and data warehouse skills, including stored procedures, functions, execution plans, indexing, and query optimization Experience troubleshooting ETL pipelines, large dat

Full-time

Data Science Manager

Remote or Queens, New York

•

Today

RESPONSIBILITIES: Kforce has a client that is seeking a Data Science Manager in Long Island City, NY. Summary: We are seeking a Data Science Manager to lead the development of advanced machine learning and optimization solutions that drive critical business decisions. This role combines data science leadership, operations research, product delivery, and stakeholder collaboration to solve complex operational challenges through predictive modeling, optimization, and workflow automation. Duties I

Contract

$75 - $90 hourly

Staff/Senior Data Scientist, Entity Resolution Team

New York, New York

•

Today

The Opportunity This is an exciting time at Enigma. We're on the cusp of releasing our next generation of small business intelligence products built on years of learnings in the space. We are seeking an experienced Data Scientist to join our Entity Resolution team and help shape the trajectory of these products. Your work will directly impact the accuracy, scalability, and predictive capabilities of our data platform, influencing key business decisions for our customers. The Role Data is at th

Full-time

USD 180,000.00 - 270,000.00 per year

Data Engineer Role

Remote

•

11d ago

Role- Data Engineer Location- New York Job Description We are seeking an experienced Data Engineerto join our team and build robust, scalable data pipelines. In this role, you will: Design and implement scalable PySpark data pipelines for batch and streaming workloads Optimize Spark jobs and queries for performance and cost efficiency Build and maintain ETL/ELT processes following data engineering best practices Troubleshoot and resolve complex data pipeline and processing issues Collaborate wi

Easy Apply

Full-time

Depends on Experience

Senior Technology Consultant - Data / AI Native Engineer

New York, New York

•

Today

NTT Data is looking for a Data / AI Native Engineer to join their team! Job Description: Job Title: Senior Technology Consultant - Data / AI Native Engineer Location: Arlington, VA, New York, NY and St. Louis, MO; Hybrid work model Overall Experience: 7+ Years Role Summary We are seeking a hands-on Senior Data / AI Native Engineer with strong expertise in Databricks, AWS, PySpark, and modern Lakehouse architecture. The ideal candidate combines deep Data Engineering expertise with strong

Full-time

USD 70.00 - 80.00 per hour

Data Engineering Career Opportunity

Remote

•

28d ago

Hi, Are you looking to start a career in Data Engineering, transition from another IT role, or strengthen your existing data skills? Explore a structured, industry-focused Data Engineering careerdesigned around the technologies and skills commonly used in modern cloud data environments. What Youll Explore Programming & Databases Python programming Advanced SQL Data structures and data processing concepts Relational databases and query optimization Cloud & Data Platforms Microsoft Azure

Easy Apply

Full-time, Third Party

Depends on Experience

Databricks Engineer

Remote

•

7d ago

Employment Type: W2 Only Desired Skills Experience with the Databricks Lakehouse Platform Strong knowledge of Apache Spark, PySpark, Python, SQL, or Scala Experience developing and optimizing data pipelines Knowledge of Delta Lake, Delta Live Tables, Unity Catalog, and Databricks Workflows Experience with data warehousing, data lakes, ETL, and ELT processes Understanding of data governance, security, access controls, and platform administration Experience integrating Databricks with AWS, M

Easy Apply

Full-time, Third Party

$70 - $80

Data Architect

Remote

•

7d ago

About the Company Blackstraw.ai is an end-to-end technology services company specializing in Artificial Intelligence (AI) and Engineering solutions across Data Science, Data Engineering, LLM/GenAI and LLMOps. Founded in 2018, we help global enterprises across North America, Europe and Asia to build and operationalize AI systems that create measurable business impact. Our mission is to make AI adoption simpler, faster and scalable through a blend of deep domain expertise, reusable accelerators an

Easy Apply

Full-time

Depends on Experience

PySpark jobs in Greenwich, CT, USA