ETL/PySpark Jobs in 10075

Refine Results
1 - 20 of 668 Jobs

Pyspark Developer

Atika Tech

Jersey City, New Jersey, USA

Full-time, Contract

Hi Team We are looking for candidates for below role Pyspark DeveloperC2C and Fulltime Jersey City, New Jersey Onsite $65/hr on C2C/ 130K/ Ann Job Description: - Python(pyspark), jupyter hub, airflow, Java Database knowledge - Oracle / SQL / Data Analytics Regulatory reporting knowledge preferred Good communication skills Open / Ability to learn new technologies Very good Analytical Skills Experience in ETL is preferable Thanks and regards, Martin RajRecruitment DirectorEmail: ; Voice: +1

Lead/Sr ETL Developer (PySpark, SparkSQL,AZURE)

Encora

Remote

Contract

Must have 5 or more years of experience in ETL Development, Data Engineering is a plus. ETL Concepts in Azure Build data pipeline using Python, PySpark, SparkSQL Airflow experience preferred but not required. Automate, optimize, migrate and enhance existing solutions. Perform data modeling, data analysis and providing insights using various tools

Senior Snowflake Data Engineer

Euclid Innovations

New York, New York, USA

Contract, Third Party

Required Skills: SnowflakePython - Pandas / PysparkAzureETL/ELTSQL12+ years of IT expStrong Snowflake Platform ExperienceStrong SQL programming ExperienceData warehousing ExperienceDatabase principles like Relational DatabasesPython coding (Pandas and Pyspark).Azure cloud experience to integrate on-premise to Azure cloud

Lead Python Data Engineer

Euclid Innovations

New York, New York, USA

Contract, Third Party

Lead Python Data Engineer with either Market Risk OR Credit Risk OR Portfolio Risk experience Job Summary: As part of the Risk Technology department, the senior developer will take part in local development and integration work, related to the local and global risk systems. Required Qualifications: 10 years of experience in IT with more than 4 years of experience in Market Risk/Credit Risk/Portfolio Risk Must have 2 years of Lead Experience.Expertise in Python.Strong experience in SQL and databa

Data Engineer

Euclid Innovations

New York, New York, USA

Contract

One of our direct client is in need of Data Engineer- Snowflake with following skills: Role : Data Engineer- Snowflake Location : NYC, NY- Hybrid 12+months Note : 10+ years of experience required Responsibilities: Design, implement, and maintain data solutions using the Snowflake platform. Develop and optimize complex SQL queries and stored procedures. Utilize data warehousing best practices to manage data integration and transformation. Work with Python for data manipulation and transformation

Lead Databricks Engineer

E-Solutions, Inc.

New York, New York, USA

Contract, Third Party

Major Responsibilities: Design, develop, and deploy Databricks jobs to process and analyze large volumes of data. Collaborate with data engineers and data scientists to understand data requirements and implement appropriate data processing pipelines. Optimize Databricks jobs for performance and scalability to handle big data workloads. Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks. Implement best practices for data management, security, and governance with

Sr. Cloud Data Engineer

Synechron

New York, New York, USA

Full-time, Third Party

We are hiring Sr. Cloud Data Engineer for New York City, NY Job Description: This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems.The position calls for someone that is comfortable working with business users along with business analyst expertise Major Responsibilities: Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and in

ETL Data warehouse Specialist _NYC

Synechron

New York, New York, USA

Full-time, Third Party

Our challenge We are looking to hire Sr. Data Warehouse developer with a financial background. Who will play a crucial role in a cloud-based data warehousing platform, to manage and analyze financial data. Additional Information New York Only* The base salary for this position will vary based on geography and other factors. In accordance with New York law, the base salary for this role if filled within New York is 140k - $160k/year & benefits (see below). The Role Responsibilities: Design and

Sr. Azure Databricks Engineer

SUNRAY INFORMATICS

Summit, New Jersey, USA

Third Party, Contract

Role : Sr. Azure Databricks Engineer Location: Summit, NJ Duration: 6+ Months MOI : Telephonic & Skype Primary Skills: Azure Databricks Need Candidates with a Minimum of 15 Years of Experience. This is an Onsite/Hybrid model and Needs local candidates only no Relocation Accepted. Must Have Financial Experience and SOLID AZURE DATABRICK EXPEREINCE. RESPONSIBILITIES: Build large-scale batch and real-time data pipelines with data processing frameworks in the Azure cloud platform.Designing and imple

Sr. Data Engineer _ NYC

Synechron

New York, New York, USA

Full-time, Third Party

We are looking for Sr. Data Engineer in New York City, NY. Roles & Responsibilities: Design and develop robust, scalable software solutions for acquiring, analyzing, and cleansing time series dataEnhance existing systems to improve performance, add functionalities, and integrate new technologies to enable easy access to time series data and metadata for both end users and systemsImplement algorithms for time series analysis, trend detection, and anomaly detection.Lead engineers responsible for

Palantir Architect

Axiom Global Technologies, Inc.

Remote

Contract, Third Party

Role: Palantir Architect Work location: Chicago, IL 60601 Duration: 10+ Months Job Description: Job Summary. Expertise in Palantir Data Foundry, Ontology and Python.Experience in Pyspark and Python Expert in writing shell scripts to execute various job scheduler Hands-on experience in Palantir & PySpark to build data pipes.Experience in deployment teams to execute securely in customer technical environments, design sustainable architectures, and act as a thought partner to customer.Good knowle

Azure Data Engineer

CitiusTech

Remote

Full-time

Job Title: Data Engineer POSITION DUTIES AND RESPONSIBILITIES Manage all technical phases of projectsMentor mid and junior level developersCollaborate with internal groups define requirements, define test plans, and implement solutions for data warehousingPerform data profiling and analysis to support data designsDesign, document and maintain data modelsApplies Kimball methodology and relevant data warehouse techniques to create new data designsPerforms problem resolutions and root cause analys

Data Product Owner

Acunor Infotech

Remote

Full-time

Role: Data product owner Location: Canada (toronto), USA (Florida)/ Remote Responsibilities: Strong understanding of data architecture, modeling, and the ability to work closely with data engineers to oversee the development of data solutions.Expertise in identifying business needs and translating them into technical requirements for data processing and analytics.Proficiency in managing complex projects, prioritizing tasks, and meeting deadlines. Experience with agile methodologies and tools lik

Product Owner - 100% Remote - USA/Canada

Prodware Solutions

Remote

Full-time

Job Description: Job Title:- Product OwnerLocation - Remote RoleDuration: Full time Contract Location: Florida (USA)/ Canada Responsibilities: Strong understanding of data architecture, modeling, and the ability to work closely with data engineers to oversee the development of data solutions.Expertise in identifying business needs and translating them into technical requirements for data processing and analytics.Proficiency in managing complex projects, prioritizing tasks, and meeting deadlines

R017525 Sr QA Analyst

HF Management Services LLC

Remote

Full-time

The Senior Quality Assurance (QA) Analyst position will conduct software testing and planning and analyzes results to insure they comply with specifications and Information Services (IS) standards. Prepares reports on the same and confers with programmers, business analysts, and upper management. The Senior QA Analyst ensures that standardized methods and procedures are used for efficient and prompt handling of all QA testing activities and adoption to the test the test tools. Healthfirst has ma

Fulltime Permanent - Azure Databricks Architect

Prodware Solutions

Remote or Columbus, Ohio, USA

Full-time

We have a Fulltime Permanent opportunity for a Azure Databricks Architect with our client in NYC, NY. We are 2 position available. 1) Columbus OH - Columbus Metro area, OH (twice a month) 3-4 days each trip 2) Jersey city Hybrid 3 days per week The below skills are must haves for the role: Azure DatabricksPysparkSQL QueriesCI/CD Pipelines for DatabricksETL ProcessesProject ManagementDelta Lake Storage

Data Operations and Engg - Remote

VIVA USA INC

Remote

Contract

Title: Data Operations and Engg - Remote Description: Responsibilities: Data Ops Engineer Qualifications: 5+ years of overall software engineering experience that includes hands-on software development, data engineering 3+ years for hands-on coding experience in SQL, Python, PySpark 3+ years of experience with advanced orchestration tools like Apache Airflow 2+ years of experience in at least one cloud (Azure, AWS, Google Cloud Platform) platforms, preferably Google Cloud Platform Experience in

Senior Cloud Data Engineer

Synechron

New York, New York, USA

Full-time

Job Description : This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise. Major Responsibilities: Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity.Design, develop, and deploy Spark program in data

Senior Data Engineer

Synechron

New York, New York, USA

Third Party, Contract

Our challenge This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise. The Role Responsibilities: Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity. Design, develop, and deploy Spark program in datab

Data Engineer

Apolis

Hoboken, New Jersey, USA

Full-time

Position: Data Engineer Duration: Direct Hire | Permanent FTE Location: 2 days/week in Hoboken, NJ Needs: PythonSPARKPySparkGoogle Cloud Platform preferredTableau