Python Pyspark Jobs

Refine Results
41 - 60 of 567 Jobs

Python Software Engineer

Innova Solutions, Inc

Charlotte, North Carolina, USA

Contract

itle: Software Engineer Job type: Fulltime/Contract on W2 Location: Charlotte NC Hybrid (3 days in-office/2 days remote) Duration: 12 Months As a Software Engineer, you will: Contribute to the resolution of complex situations requiring understanding of the function policies procedures and compliance requirements.Strategically collaborate and consult with End Customer. An ideal candidate should have: PysparkPython S3Dremio ETL skills.End-to-end developmentData Aggregation. Qualified candidates s

Databricks Engineer

SUNRAY INFORMATICS

Dallas, Texas, USA

Contract, Third Party

Hi Professionals, We have an immediate openins for the below role, If interested please apply. Job Title: Azure Databricks Engineer Type : ContractInterview: Telephonic & F2FJOB RESPONSIBILITIESNeed minimum 15+ years profiles of overall Experience.Candidates with in 15 miles of radius NeededROLE: SR.AZURE DATABRICKS ENGINEER- FINANCIAL EXPERIENCE MUSTMUST HAVE EXPERTISE IN THE SKILLS GIVEN BELOWAzure FunctionsSQL ServerPostgreSQLDatabricksStrong background in Data QualityOVERALL EXPERIENCE 15YRS

Data Engineer

Avenues International, Inc.

New York, New York, USA

Contract

W2 Role Job Title: Data Engineer Type (Contract, Contract to Hire, Perm) : 12 +months Location: New York City, New York or Phoenix Arizona (Either of 2 locations(Onsite) Note : 2 Positions are there 1. More core data engineering expertise- building data pipeline using PySpark, BigQuery, Python 2 .Needs experience working on real time pipelines, exposed to API's JD: We are looking for a highly skilled Engineer with a solid experience of building Bigdata, Google Cloud Platform Cloud based real t

Data Bricks Architect

NAAS Technologies

New Jersey, USA

Third Party

Role : Databricks Architect Location : Iselin NJ / New York, NY : Hybrid (2-3 Days) Relocation is fine Hire type : Contract (Preferred CTH) Exp level : 15+ years Must have : Expert in Databricks , Pyspark , python, SQL JD: Strong knowledge on data bricks architecture and tools Have experience of task and wf jobs creations in data bricks. Deep understanding of distributed computing and how to use spark for data processing. SQL and pyspark : strong command over querying databases and pro

Azure Databricks Lead

DataAffect

Remote

Contract

About DataAffect: We are a boutique data/service management firm specializing in the delivery of Data Governance, Enterprise Data Strategy, Solutions Architecture, Data Warehousing, Data Integrations, Data Security & Privacy Management, IT Service Management, Business analysis (and) Agile Project Management services to diverse clients across multiple industries. Role: Azure Databricks Lead Location: Remote Duration: 6+ months Job Summary We are looking for a results-driven Lead Data Engineer (Co

Azure Data Engineer - REMOTE

Kanshe Infotech

US

Contract, Third Party

Job Title: Azure Data Engineer Location: PST Time Zone (Remote) Job Description: Our West Coast client is seeking a skilled Azure Data Engineer to join their team. The ideal candidate will have extensive hands-on experience with Microsoft Fabric and a strong background in Azure data technologies. You will be responsible for designing, building, and maintaining data solutions on the Azure platform.Core Skills: MS Fabric: Must have hands-on experience. Azure: In-depth knowledge. SQL DAX: Fabric

Data Engineer with Python -- Charlotte, NC (Hybrid)

HuMetis Technologies Inc

Charlotte, North Carolina, USA

Contract

Data Engineer with Python -- Charlotte, NC (Hybrid) Skills: Requires Pyspark Python S3 Dremio ETL skills. Some financial exp would be beneficial. ProfitView modernization effort Resource will be responsible for end-to-end development covering portions of Financial Attribution SCD Booking and Referring Agreements Data Aggregrations and SOR Onboarding. In this contingent resource assignment you may: Consult on complex initiatives with broad impact and large-scale planning for Software Engineerin

MLOps Architect (Databricks Specialist)

Amiseq Inc.

Remote

Contract

Job Description: * 12+ years in IT experience with a minimum 10+ Years of experience in data engineering, data platform, and analytics. * Projects delivered with hands-on experience in development on Databricks. * Working knowledge of any one cloud platform (AWS, Azure, or Google Cloud Platform). * Deep experience with distributed computing with Spark, including knowledge of Spark runtime internals. * Familiarity with CI/CD for production deployments. * Working knowledge of MLOps. * Current know

Sr. AWS Glue ETL Developer

ServIT Consulting LLC

Remote

Third Party, Contract

Sr. AWS Glue ETL Developer Job Description: Sr. AWS Glue ETL Developer with strong systems, software, and AWS cloud experience to support a major mainframe systems modernization initiative for federal customer. Based in DevOps framework, participate in and/or direct major deliverables of projects through all aspects of the software development lifecycle including scope and work estimation, architecture and design, coding, unit testing, support deployments and testing in higher environments. Prim

Azure Data Engineer - Weehawken, NJ (ONSITE)

iPeople Infosystems LLC

Weehawken Township, New Jersey, USA

Contract

Azure Data Engineer :- hands-on skill on pyspark/python, Azure Databricks, Data Warehouse and some exposure to financing domain. Must Have: DatabricksPythonpysparkPL/SQLOracle or equivalent databaseUnix shell/perl scriptingJava - OO Concepts or any other equivalent language.Nice to have : Prior Financial / banking IT experience (Knowledge of the products) MS SSIS/SSAS

Full Time opportunity: Need Locals: QA Manager -- Austin, TX / F2F Interview

Intellisoft Technologies

Austin, Texas, USA

Full-time

Hi, Position; QA Manager Location: Austin, TX (Face to face interview) Big Focus for this role: ETL Testing Lead (Or similar experience) Python (Modem data pipelines, also need pandas libraries) SQL (Azure environment) ADF SSIS (Legacy) Databricks Snowflake (Nice to have, sounds like their sunsetting this) Testing on pipelines (so Spark, Pyspark, ADF) API - Postman

Senior Azure Data Engineer - Full time (12+ Years of Exp)

MethodHub

San Francisco, California, USA

Full-time

Bisoft is looking for Senior Azure Data Engineer - Full time (12+ Years of Exp) Senior Data Engineer We are seeking a highly experienced Senior Azure Data Engineer with over 12 years of expertise in data warehousing. The ideal candidate will have extensive experience with the Azure platform, developing Azure Data Factory (ADF) pipelines, and working with PySpark. Knowledge of Databricks or Synapse is essential. Good to have MS Fabric experience. Responsibilities Design and BuildData Pipelines:

Python developer

INNOVIT USA INC

Philadelphia, Pennsylvania, USA

Full-time, Part-time, Contract, Third Party

W2 Only for W2 Candidates Skills 1. Strong in Python skills - pandas, PySpark, NumPy 2. Strong in SQL skills 3. Good to have AWS services knowledge - ECS, Glue, , Lambda, Redshift, Athena, Cloudwatch 4. Good to have Dremio Knowledge 5. Good to have Semantic layers architecture 6. Experience in Agile with Jira boards 7. Strong in Github and project deployments pipeline.

Sr Big Data Engineer

Anblicks

Irving, Texas, USA

Full-time

Must be local to TX Core Skills: Python, Pyspark, Distributed data processing & CI/CD skills- Gen AI exposure is plus Roles and responsibilities: Proficiency in Python, SQL, and AI/ML frameworks (Transformers, LangChain, OpenAI, Hugging Face, PyTorch, TensorFlow).Strong understanding of AI cost optimization strategies, including serverless inference, model distillation, quantization, and GPU efficiency tuning.Experience deploying AI models in cloud environments (AWS, Azure, Google Cloud Platform

Pyspark Development Lead

Capgemini America, Inc.

Jersey City, New Jersey, USA

Full-time

Position Title : PySpark Development Lead Location : Jersey City, NJ (Hybrid) Experience : 8+ Years Employee Type : Full Time with Benefits Job Description: 8 + years hands-on experience as a PySpark developmentStrong programming skills in Hive/Python with minimum 5 Years of Experience.Familiarity with big data processing tools and techniquesExperience with the Hadoop ecosystemGood understanding of distributed systemsShould be familiar with Data warehouse concepts.Experience with streaming data

***Sr. AWS Glue ETL Developer***W2****Remote*****

SmartIMS Inc.

Remote

Contract

Title: Sr. AWS Glue ETL Developer Location: Remote Duration: Contract Required skills: Candidate must have bachelor s with 12 years of prior relevant experience or master s with 6-10 years of prior relevant experience Re-engineer mainframe batch jobs to equivalent ETL batch processes, preferably using Cloud-Native tools like AWS Glue. Leverage serverless cloud services to prepare (extract and transform) and load large numbers of datasets for data processing. Coordinate closely with mainframe res

AI engineer

Srinav Inc.

Raleigh, North Carolina, USA

Contract, Third Party

Job Title: AI engineer Location: Bloomfield, CT/Raleigh, NCDuration: Longterm An AI engineer with Python, pytorch, Tensor flow experienceExperience with AWS services like Lambda, API GatewayExperience with ML, GenAI and different AI modelsExperience with databricks/PySpark (I suggest to keep this as nice to have) Mohan Krishna Yarramsettimohan(at0srinav(dot)net

Azure Consultant

Hexaware Technologies, Inc

Mount Laurel Township, New Jersey, USA

Full-time

Role - Azure Consultant Location - Mount Laurel, NJ Job Description - Must Have 8- 12 Years of IT experience in Datawarehouse and ETL Hands-on data experience on Cloud Technologies on Azure, ADF, Synapse, Pyspark/PythonAbility to understand Design, Source to target mapping (STTM) and create specifications documentsFlexibility to operate from client office locationsAble to mentor and guide junior resources, as neededNice to Have Any relevant certificationsBanking experience on RISK & Regulatory O

SAS Teradata Developer

Innova Solutions, Inc

Charlotte, North Carolina, USA

Contract

Innova Solutions is immediately hiring for a SAS Teradata Developer Position: Teradata Developer Position Type: W2-Contract Locations: Charlotte, NC and Plano, TX Work Mode: Hybrid Job Description: Analyze, design, develop, enhance and support applications that integrate with existing business components utilizing established processes, frameworks, and technologies. Develop and support existing and new project requirements, including coordinating with business to understand requirements, and ana

Azure Architect - Data, AI/ML, Cloud Transformation & Security

Milestone Technologies, Inc.

Remote

Contract

Azure Architect with extensive Data, AI/ML, Cloud Transformation & Security experience. Initially: Two month W2 Contract (no C2C) 100% remote Estimated rate: $100 - 110/hr. Please review and let me know if you, or someone you know, may be interested in discussing. We are looking for aseasoned Azure Architectwith a robust foundation inData and AI/MLto lead the end-to-end design and implementation ofscalable, secure, and high-performance cloud-native solutions. This role requires a deep understa