python pyspark Jobs

Refine Results
541 - 560 of 566 Jobs

Data Engineer - FTE role

Winston Staffing Service

Buffalo, New York, USA

Full-time

Location Buffalo/Niagra Falls Area - Hybrid Work week Full Time Employee plus benefits. Support the day-to-day operations of Invisible deployments. Our customers rely on our platform for some of their most critical operations. Build, optimize, and maintain ETL pipelines Modify existing application code or interfaces, or develop new components Analyze requirements, participate in design, and handle coding, testing, debugging, deployment, and maintenance Develop and implement databases, data coll

ETL Developer IV

Cyber Resource Provider LLC

US

Full-time, Part-time, Contract, Third Party

Job Description : An ETL developer needs to design, build, test and maintain systems that extract, load and transform data from multiple different systems. Primary Responsibilities: Leads, Designs, implements, deploys and optimizes backend ETL services. Support a massive scale enterprise data solution using AWS data and analytics services. Analyze and interpret complex data and related systems and provides the efficient technical solutions. Provide support to ETL schedule and maintain complianc

Sr Business Analyst, Data Analytics, MDM

SES

Remote

Full-time

Sr Business Analyst Type: W2 With Benefits - No C2C Location: Supporting Viginia Hours Top 5 Technical Skills: MUST be Senior Business Analyst Business Requirements Documents Functional Requirements Documents Test Planning/Execution Jira Agile/Waterfall - Hybrid Top 3 Soft Skills: Previous Experience as a Business Analysis Work on Data Engineering/Analytics Team Company / Project Description / Business Driver Project is in support of data and reporting platform for their data transformation Th

Pyspark, AWS Lead Data Engineer

Saama Technologies, LLC

Mississauga, Ontario, Canada

Contract

This is a remote Role to work from Home in CanadaGood understanding of big data conceptsExpertise with Amazon Web Services (AWS) - ECS, S3, Lambda, RDS, Athena, Glue, EMR, Redshift, AirflowGood knowledge on ETL and Data warehousing concepts with hands -on experience10+ years of total experience in data engineering development along with 2+ years in Pyspark, Python and PandasKnowledge of database concepts, modelling, SQL, MySQLAWS Certification is a plusBachelor degree in Computer Science, Engine

Incorta Solution Architect

Diverse Lynx Llc

Remote

Contract

Title: Incorta Solution Architect Location: 100% Remote PST Time zone Key Skills: Incorta, SQL, SparkSQL, PythonSQL Nice to have: BI Applications, ODI, Oracle ERP Fusion Position Overview: We are seeking a highly skilled Incorta Solution Architect to lead the design, implementation, and optimization of data analytics solutions using the Incorta platform. The ideal candidate will have a deep understanding of data architecture, ETL/ELT processes, and reporting strategies, with hands-on experience

Data Engineer

Dexian DISYS

Columbia, Maryland, USA

Contract

1 DAY ONSITE PER WEEK IN COLUMBIA, MD - CANDIDATE MUST BE LOCAL Job Title: Data Engineer Reports To: Senior Data Engineer Technical Lead Location: Columbia, MD (onsite 1 day/week) Essential Duties & Responsibilities Design, build and maintain large, complex data processing pipelines to meet business requirements Develop automated quality controls; perform unit, integration and user acceptance testing Create scalable, reusable frameworks for ingestion and transformation of large data sets Tro

Lead Azure Data Engineer

Codeforce 360

Cincinnati, Ohio, USA

Contract

Career Opportunity: Job Title: Lead Azure Data Engineer About CodeForce 360 Making a career choice is amongst the most critical choices one can make, and it's important for the choice to be calculated with factors such as a company's run of success since its inception and more. But, when you come across a company that has reputation proven with nothing but an illustrious run of success since the day it began, you don't need to think of anything else. That's precisely what some of our employe

Data Architect

Nityo Infotech Corporation

Miami, Florida, USA

Contract

Role: Data Architect (MS Fabric, Medallion, Azure) Location: Miami FL and Raleigh/Durham NC. Contract Job Job Description: Min 15+ years of total experienceShould be Hands-on delivery person to lead the design and architecture of the MS Fabric based platform and related applications on Medallion framework.Should have experience working in migration project to MS Fabric.Relevant technical and domain experience of 10+ years for Azure technologies like cloud storage solutions, ETL solutions like A

Senior Data Integration Director

Brains Workgroup, Inc.

New York, New York, USA

Full-time

Our client, a major bank in New York City, is looking for Senior Data Integration Manager (Director Level) Hybrid commute. 2/3 days on-site in NYC or Iselin NJ office. This is a permanent FT career opportunity, Director - Level position with base salary range 220 - 275K DOE, plus ~20-25% bonus and great benefits package. Senior Data Integration ManagerMajor Responsibilities: Manage team of integration engineers (both full time and project consultants)Architecture, design and documentation for da

MS Fabric- Data Architect

E-Solutions, Inc.

California, USA

Contract, Third Party

Min 15+ years of total experience Should be Hands-on delivery person to lead the design and architecture of the MS Fabric based platform and related applications on Medallion framework. Should have experience working in migration project to MS Fabric. Relevant technical and domain experience of 10+ years for Azure technologies like cloud storage solutions, ETL solutions like ADF, Dataflows, Synapse analytics, Notebooks (Pyspark) in Databricks, MS fabric. Strong knowledge of Life Science domain,

Incorta Solution Architect

KPI Partners, Inc.

Remote

Contract

KPI Partners, A global consulting firm focused on strategy, technology, and digital transformation. We help companies tackle their most ambitious projects and build new capabilities. We provide solutions in Cloud, Data, Application Development & BI spaces. We enable your growth At KPI, you can become who you want to be and learn skills that will take you further in your career Continuously upgrade yourself Develop as a future leader Drive cloud enablement around the world Engineering Excellence

Investment Analytics Solutions Specialist

Randstad Digital

Boston, Massachusetts, USA

Contract

job summary: Location: Boston, MA, Merrimack, NH or Jersey City. NJ Required Skills Strong client engagement skills with portfolio managers, financial advisors and/or brokerage platform product managers location: Boston, Massachusetts job type: Contract salary: $82 - 83 per hour work hours: 8am to 5pm education: Bachelors responsibilities: Strong business communications skills for crafting and delivering compelling presentationsFundamental understanding of financial markets to articulate

Big Data Engineer

CSI Companies

Alpharetta, Georgia, USA

Contract

Big Data Engineer 12-month contract Job Description: CSI Companies is looking to hire a Big Data Engineer that can design, build, and operationalize large-scale enterprise data solutions and applications using one or more AWS data and analytics services in combination with 3rd parties like Spark, EMR, RedShift, Lambda, Glue. This includes designing and building production data pipelines from ingestion to consumption within a big data architecture, using Java, and Python. Yearly Total Pay: $75

Data Engineer - Citizens, holders - 2 months contract

Keanesoft

New York, New York, USA

Third Party, Contract

Hello, I hope you are doing great today! We are looking for Data Engineer for NYC/NJ - Onsite facility for more details please find the below JD. If you are interested, please revert me back with your updated resume Job Title: Data Engineer Location: NYC/NJ - Onsite Client: State of NY Duration: 2 months contract Visa: and Key Responsibilities: Design, develop, and maintain data pipelines using Dell s Stardust Data Lakehouse platform.Ingest structured/unstructured data from various sources (incl

Google Cloud Data Engineer

Saama Technologies, LLC

Remote

Full-time

This is a Full time roleNo C2C Title: Google Cloud Data EngineerWe are looking for a Google Cloud Data Engineer, They will be responsible for building a solid Data Integration pipelines by integration various source data which will enable data delivery in near real-time using next-gen technologies.Roles and Responsibilities:Design, develop, and maintain scalable data pipelines on Google Cloud Platform (Google Cloud Platform).Implement data processing solutions using Google Cloud Platform service

Software Engineers

Randstad Digital Manual LLC

Woburn, Massachusetts, USA

Full-time

Software Engineers for Randstad Digital, LLC. Multiple openings. Headquarters: Woburn, MA. Develop, design, implement, test, integrate web applications, API, jobs, scalable data solutions, cloud functions, pipelines. Write scripts, troubleshoot performance, confer with Data and Analytics team to build Data Lake, use data pipelines from data sources, migration framework. Review customer transaction records and deliver to downstream users, support data workflows, validate data integrity after inge

Senior Software Developers

Randstad Digital Manual LLC

Woburn, Massachusetts, USA

Full-time

Senior Software Developers for Randstad Digital, LLC. Multiple openings. Headquarters: Woburn, MA. Develop, design, code, test, document, and support programs, data warehouse, scripts, applications. Confer with business, QA, Production Support to meet requirements and implementation. Review business functions, implement OID for automated selection of active servers, develop queries and algorithms from upstream users, optimize enterprise data flows, and review acquisition, storage and processing

Sr. Data Engineer (Databricks, PySpark Scala, Bigdata.)

Xoriant Corporation

Quincy, Massachusetts, USA

Contract

Data Engineer Key Skills: Databricks, PySpark Scala, Bigdata. Location : North Quincy MA - Hybrid Onsite Skill Sets Required Must have over 10 years of experience in Data engineering.Good decision-making and problem solving skillsSolid understanding of Databricks fundamentals/architecture and have hands on experience in setting up Databricks cluster, working in Databricks modules (Data Engineering and SQL warehouse).Solid Knowledge on medallion architecture, DLT and unity catalog within Databri

Data Engineer with Palantir Foundry experience | 100% Remote| (#UM) (#CH) (#ANB)

Pioneer Corporate Services Inc

Remote

Contract

Position: Data Engineer with Palantir Foundry experience Location: Remote Contract JD: Experience in Palantir Foundry.Proficient in programming languages such as Python and SQL for database querying and manipulation.Strong understanding of AWS services related to data engineering, such as Amazon S3, Amazon Redshift, Amazon Aurora Postgres, AWS Glue, AWS Lambda, AWS Step Function, AWS Lake Formation, Amazon Data Zone, Amazon Kinesis, MSK, and Amazon EMR.Knowledge of database design principles an

Senior Data Engineer

HMG America

Dallas, Texas, USA

Full-time, Contract

HMG America LLC is the best Business Solutions focused Information Technology Company with IT consulting and services, software and web development, staff augmentation and other professional services. One of our direct clients is looking for Senior Data Engineer in Dallas, TX. Below is the detailed job description. Role - Senior Data Engineer Location - Dallas, TX (Hybrid, 3 days/week) Mode - FTE and Contract Must Have - Databricks , Azure Data Factory , Spark Job Description Required Skills/Q