python pyspark Jobs in new york

Refine Results
21 - 40 of 94 Jobs

Senior Administrator - Azure Databricks

Kforce Technology Staffing

New York, New York, USA

Full-time

RESPONSIBILITIES: Kforce is working with a client in search of a Senior Administrator - Azure Databricks to join their team in NY! This position is full time, direct hire and on-site 1-day a week. Summary: As an Azure Databricks Administrator, you will be responsible for managing and maintaining the Databricks platform, ensuring optimal performance and security. This role is crucial in overseeing user administration, managing Azure storage solutions, and implementing CI/CD pipelines using Azure

MLOps Architect (Databricks Specialist)

Amiseq Inc.

Remote

Contract

Job Description: * 12+ years in IT experience with a minimum 10+ Years of experience in data engineering, data platform, and analytics. * Projects delivered with hands-on experience in development on Databricks. * Working knowledge of any one cloud platform (AWS, Azure, or Google Cloud Platform). * Deep experience with distributed computing with Spark, including knowledge of Spark runtime internals. * Familiarity with CI/CD for production deployments. * Working knowledge of MLOps. * Current know

Sr. AWS Glue ETL Developer

ServIT Consulting LLC

Remote

Third Party, Contract

Sr. AWS Glue ETL Developer Job Description: Sr. AWS Glue ETL Developer with strong systems, software, and AWS cloud experience to support a major mainframe systems modernization initiative for federal customer. Based in DevOps framework, participate in and/or direct major deliverables of projects through all aspects of the software development lifecycle including scope and work estimation, architecture and design, coding, unit testing, support deployments and testing in higher environments. Prim

Snowflake/Big Data/Cloud Tech Lead-Onsite in NYC NY-3-6 months

Suncap Technology

New York, New York, USA

Contract

Position: Snowflake/Big Data/Cloud Tech Lead Duration : 3-6 months Onsite in NYC NY Job description - Principal Consultant - Snowflake/Big Data/Cloud Tech Lead: Technical Leadership: 1. Very good at Architecting and designing complex data solutions on Snowflake, Data Sharing, Data Exchange, Snowflake Internal Marketplace, including data models, data ingestion pipelines, and data transformations, ensuring best practices and scalability. 2. Good at Snowflake internals for any customization us

***Sr. AWS Glue ETL Developer***W2****Remote*****

SmartIMS Inc.

Remote

Contract

Title: Sr. AWS Glue ETL Developer Location: Remote Duration: Contract Required skills: Candidate must have bachelor s with 12 years of prior relevant experience or master s with 6-10 years of prior relevant experience Re-engineer mainframe batch jobs to equivalent ETL batch processes, preferably using Cloud-Native tools like AWS Glue. Leverage serverless cloud services to prepare (extract and transform) and load large numbers of datasets for data processing. Coordinate closely with mainframe res

Staff Data Engineer

FanDuel

New York, New York, USA

Full-time

ABOUT FANDUEL FanDuel Group is the premier mobile gaming company in the United States and Canada. FanDuel Group consists of a portfolio of leading brands across mobile wagering including: America's #1 Sportsbook, FanDuel Sportsbook; its leading iGaming platform, FanDuel Casino; the industry's unquestioned leader in horse racing and advance-deposit wagering, FanDuel Racing; and its daily fantasy sports product. In addition, FanDuel Group operates FanDuel TV, its broadly distributed linear cable

Azure Architect - Data, AI/ML, Cloud Transformation & Security

Milestone Technologies, Inc.

Remote

Contract

Azure Architect with extensive Data, AI/ML, Cloud Transformation & Security experience. Initially: Two month W2 Contract (no C2C) 100% remote Estimated rate: $100 - 110/hr. Please review and let me know if you, or someone you know, may be interested in discussing. We are looking for aseasoned Azure Architectwith a robust foundation inData and AI/MLto lead the end-to-end design and implementation ofscalable, secure, and high-performance cloud-native solutions. This role requires a deep understa

Azure Data Engineer Remote

Georgia IT

Remote

Contract

Azure Data Engineer Remote Duration: 10 months Rate: DOE Tech screening -Interview after 3 PM PST Core skills needed MS Fabric's hands-on experience is a must to have. Just having POC experience is not good enough.AzureSQLDax-Fabric-SynapseETL-SparkPySpark-PythonAzure Databricks -MUST HAVEData Lake

Data Engineer

RIIM

New York, New York, USA

Contract

Data Engineer - Contract W2 Only NYC, NY 10020 - Onsite (5 Days) Primary Skills: Overall 10+ years of experience in IT domainStrong on Snowflake & Databricks, SQL, Python, PySpark

Senior Data Engineer

Zachary Piper Solutions, LLC

Remote

Full-time

Piper Companies is seeking a Senior Data Engineer to join a leading shipping and logistics organization. The Senior Data Engineer will handle operational aspects of the data ecosystem, including monitoring, automation, and data flow. Responsibilities of the Senior Data Engineer include: Work with Azure Databricks to develop and deploy solutions for reporting and analytics. Create real-time streaming pipelines. Data movement and orchestration using Azure Data Factory. Work with internal custom

Senior Data Engineer (Snowflake/Python)

Synechron Inc.

Woodbridge Township, New Jersey, USA

Full-time

We are At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development in

Oliver Wyman -Senior Lead Data Engineer

Marsh & McLennan Companies

Remote or New York, New York, USA

Full-time

Company: Oliver Wyman Description: Boston, New York, Toronto Sr. Lead Data Engineer WHO WE ARE Oliver Wyman Digital is a ground-breaking division within Oliver Wyman delivering world-class solutions to give our clients a competitive edge. We work across the full technology stack from databases and analytics to APIs and web and mobile applications. With a mixture of over 300 consultants, specialists and support professionals in 16 major cities across the world, we're committed to growth that

Solution Architect (PySpark)

KPI Partners, Inc.

Remote

Contract

KPI Partners, A global consulting firm focused on strategy, technology, and digital transformation. We help companies tackle their most ambitious projects and build new capabilities. We provide solutions in Cloud, Data, Application Development & BI spaces. We enable your growth At KPI, you can become who you want to be and learn skills that will take you further in your career Continuously upgrade yourself Develop as a future leader Drive cloud enablement around the world Engineering Excellence

Deloitte Technology |Product Engineering |Fullstack Sof

Deloitte

New York, New York, USA

Full-time

Full-Stack Software Engineer - CL4 Role Overview: As a Full-stack Software Engineer , you will actively engage in your engineering craft, taking a hands-on approach to multiple high-visibility projects. Your expertise will be pivotal in delivering solutions that delight customers and users, while also driving tangible value for Deloitte's business investments. You will leverage your extensive engineering craftmanship across multiple programming languages and modern frameworks, consistently demo

Deloitte Technology |Product Engineering |Fullstack Sof

Deloitte

Jersey City, New Jersey, USA

Full-time

Full-Stack Software Engineer - CL4 Role Overview: As a Full-stack Software Engineer , you will actively engage in your engineering craft, taking a hands-on approach to multiple high-visibility projects. Your expertise will be pivotal in delivering solutions that delight customers and users, while also driving tangible value for Deloitte's business investments. You will leverage your extensive engineering craftmanship across multiple programming languages and modern frameworks, consistently demo

MLOps Engineer GovCloud Exp - 100% Remote ()

Smart Caliber Technology

Remote

Contract, Third Party

Location: Atlanta, GA (Remote) Duration: 9+ Months, with extension or Possible Contract To Hire after 3 Months If Strong in MLOps, NLP, PySpark, ML Modelling and Optimization on AWS then will consider without Gov Cloud experience. Standard Job Description: Bachelor's degree in computer science, Engineering, Applied Mathematics or related field. 4-6 years of strong experience with AWS Gov Cloud environments / Export Control / FedRAMP environments. Overall, 8-10 years of solid experience in the a

Deloitte Technology |Product Engineering |Product Archi

Deloitte

New York, New York, USA

Full-time

Product Architect - CL5 Role Overview: As a Product Architect , you will actively engage in your software architecture craft, taking a hands-on approach to multiple high-visibility projects. Your expertise will be pivotal in delivering solutions that delight customers and users, while also driving tangible value for Deloitte's business investments. You will leverage your extensive engineering craftsmanship and advanced proficiency across multiple programming languages and modern frameworks, con

Deloitte Technology |Product Engineering |Product Archi

Deloitte

Jersey City, New Jersey, USA

Full-time

Product Architect - CL5 Role Overview: As a Product Architect , you will actively engage in your software architecture craft, taking a hands-on approach to multiple high-visibility projects. Your expertise will be pivotal in delivering solutions that delight customers and users, while also driving tangible value for Deloitte's business investments. You will leverage your extensive engineering craftsmanship and advanced proficiency across multiple programming languages and modern frameworks, con

Sr Data Analyst (Pharmacy Claims)

Molina Healthcare

Remote or Long Beach, California, USA

Full-time

Job Description JOB DESCRIPTION Job Summary This position will be providing analytical support for the Clinical Strategy team. In this role, you will be responsible for analyzing healthcare data, identifying trends, and making recommendations to the business. The role will be engaged in collaboration across departments and with internal/external customers to define requirements and understand business challenges. You will be handling both structured and unstructured healthcare data sets from

Principal Engineer - Data Automation

Genesis10

Remote

Full-time

Genesis10 is currently seeking a Principal Engineer Data Automation with our client in the financial Industry. This is a 12+ month contract position. Responsibilities: Develop and implement automation workflows around security-related data Provide data automation services supporting a broad range of cybersecurity functions Analyze and understand security-related data, its structure, and its implications across cybersecurity initiatives Design and deliver long-term, innovative automation solution