diyotta etl with hadoop Jobs

Refine Results
241 - 260 of 278 Jobs

Sr Data Engineer-Xumo

Comcast Corp

Irvine, California, USA

Full-time

Xumo, a joint venture between Comcast and Charter Communications, was formed to develop and offer a next-generation streaming platform for the entire entertainment industry. The company consists of three primary lines of business: Xumo devices, Xumo Play, and Xumo Enterprise. Powered by Comcast's global entertainment platform, Xumo devices feature a world-class user interface with universal voice search capabilities, making it easy for consumers to find and enjoy their favorite streaming content

Pyspark developer

LTIMindtree

Irving, Texas, USA

Full-time

About US: LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 750 clients, LTIMindtree brings extensive domain and technology expertise to help drive superior competitive differentiation, customer experiences, and business outcomes in a converging world. Powered by nearly 90

Software Engineer

SGS Consulting

Remote or Lexington, Massachusetts, USA

Contract

Note: Interim clearance is sucient to start on this positionThis position can be fully remote with a few trips per year to Lexington; person must be willing to do that infrequent travel to Client Location. Hours can be a little exible but preference for someone to be working EST hours/or close to.Interview process will likely be one round of interviews Description: Full lifecycle application development. Designing, coding and debugging applications in various software languages. Software analys

Data Scientist

Innova Solutions, Inc

Addison, Texas, USA

Contract

Innova Solutions has a client that is immediately hiring for Data Scientist Hybrid Role: 3 days Onsite 2 days Remote Position type: Contract Job Role: Data Scientist Job Location: Addison, TX and Charlotte, NC Job Duration: Long Term Required Skills: 2 - 4 years of professional experience in NLP programmingExperience with finetuning Large Language Models (LLMs) or writing language models from scratch.Demonstrated background in NLP and machine learning. Preference for degrees in computer science,

Perl

Apex 2000

Bellevue, Washington, USA

Contract

Perl Location: Bellevue, WA Duration:9-12 Month Implementing Client: Infosys JD: Must have skills: Perl Expertise is MustAdvanced PythonUnix / Shell scriptingResponsibilities / Tasks: Design, develop Python, Perl codeTroubleshooting ETL and network issues in a Linux environmentGood to have skills: Hadoop /KafkaNetwork/Telecom domain knowledgeWeb development

Sr. Big Data Engineer

Strategic Staffing Solutions

Irving, Texas, USA

Contract

Job Title: Senior Big Data Engineer Location: Irving, TXType: W2 Contract/No C2CPay Rate: Job Summary:We are hiring a Senior Big Data Engineer. You will build and optimize large-scale data systems. You will work with Spark, Hadoop, and cloud platforms. Key Responsibilities: Design and build big data pipelines using Spark and Hadoop Tune Spark queries for performance Write Spark SQL, streaming, and dataset APIs Work with HDFS and Unix shell scripts Build and support ETL/ELT processes Integr

Data Engineer PySpark

Photon

Jersey City, New Jersey, USA

Full-time

Job Title: Data Engineer PySpark Location: Jersey City, NJ Duration: Fulltime Permanent (No C2C) Requirements and Qualifications: 8+ years of relevant experience in the Data Engineering, ApacheSparkStrong proficiency in PySpark and Apache Spark.Solid experience with SQL, NoSQL databases (e.g., Hive, HBase, Cassandra).Hands-on experience with big data frameworks (Hadoop, Kafka, etc.).Expertise in cloud platforms (AWS, Azure, or Google Cloud Platform).Proficiency in Python programming and data man

INFORMATICA ENGINEER- HYBRID IN SEVERAL LOCATIONS

Pyramid Consulting Group, Inc

Pittsburgh, Pennsylvania, USA

Contract

Design and develop software systems, using scientific analysis and mathematical models to predict and measure outcome and consequences of design Pyramid Consulting Group Inc has a banking client with an immediate need for an experienced INFORMATICA ENGINEER with the following background and skills: Informatica ETL Agile Detail-oriented Oracle (creating and modifying tables) SQL (writing SQL queries) Work Environment: Agile Fast-paced Collaborative Flex Skills: OBIEE pull and create reports (

Senior Hybrid Cloud Data Engineer

Arrow Search Partners

Irving, Texas, USA

Contract

Job Title: Senior Hybrid Cloud Data Engineer Overview: We are looking for a highly skilled Hybrid Cloud Data Engineer to bridge the gap between legacy systems and modern cloud infrastructures. The ideal candidate will be responsible for leveraging the scalability and flexibility of the cloud while maintaining the control and reliability of on-prem systems, supporting critical decision-making and innovation. Key Responsibilities: Data Pipeline Development: Build and manage ETL (Extract, Transfo

AI/ML Engineer

Nityo Infotech Corporation

Irving, Texas, USA

Full-time

Job Responsibilities REQUIREMENTS: 7+ years of experience in financial services, with tangible AI and machine learning projects. Extensive experience in designing and implementing AI/ML platforms and architectures. Experience leading large data & AI transformation projects Proficiency in AWS services, including Amazon SageMaker, Amazon Bedrock. Strong architecture & development skills in Python, Java, or other relevant languages. Familiarity with cloud architecture and deployment strategies. Exp

Devops Developer

Kutir Inc

Sunnyvale, California, USA

Third Party

Title: Devops Developer Location: Austin, TX (Onsite), Sunnyvale CA ( Hybrid- 3days work from office) Experience: 7+ years Devops, Kafka, cKubernetes, Docker Job Description: Must have skills. DevOps Must have skills CI/CD Kafka Spark ETL AWS Kubernetes Skills: 6+ years of experience on DevOps with expertise in Building and managing CI/CD pipeline gatekeeping production deployments, develop and implement GIT branching strategies, branch protection rules, network policies, scale up/ scale down th

Big Data Architect/ w2 only

BizTech Solutions Inc

Jersey City, New Jersey, USA

Contract

Position: Big Data Architect Location: Jersey City, NJ (Onsite) Duration: Long Term Job description: 12+ years of relevant experience in Data Management, Big Data (Hadoop, Scala, Spark, Hive), ETL Talend, AWSTechnical Expertise in financial services industry and/or regulatory environmentsExcellent knowledge and experience on solutioning Cloud native solutionsExperience with migrating on-prem applications to Cloud Architectures or developing cloud native applications for any of the following: AW

Databricks Architect

Nityo Infotech Corporation

Jersey City, New Jersey, USA

Contract, Third Party

Role : Databricks Architect Location : Iselin NJ / New York, NY : Hybrid (2-3 Days) Local candidates only Inperson interview is must Exp level : 15 years+ Must have : Expert in Databricks , Pyspark , python, SQL Job Description: Strong knowledge on data bricks architecture and tools Have experience of task and wf jobs creations in data bricks. Deep understanding of distributed computing and how to use spark for data processing. SQL and pyspark : strong command over querying databases and prof

Urgent need for Databrick Architect - Iselin NJ / New York, NY : Hybrid- Local Candidates only - Must have 15+ years exp.

Nascent Global

New York, New York, USA

Full-time, Third Party

Role : Databricks Architect Location : Iselin NJ / New York, NY : Hybrid (2-3 Days) Local candidates only Hire type : Contract (Preferred CTH) Exp level : 15 years+ Must have : Expert in Databricks , Pyspark , python, SQL JD: Strong knowledge on data bricks architecture and tools Have experience of task and wf jobs creations in data bricks. Deep understanding of distributed computing and how to use spark for data processing. SQL and pyspark : strong command over querying databases and profic

Senior Data Engineer Azure, Databricks, PySpark

Adaequare Inc

Dallas, Texas, USA

Contract

Senior Data Engineer Azure, Databricks, PySpark Location: Hybrid (3 days a week onsite) Duration: 12-Month Contract (with potential extensions) Industry: Healthcare Overview: We are seeking a Senior Data Engineer with strong expertise in Azure, Databricks, and PySpark to join a high-impact healthcare data team. This is a great opportunity to work with a large enterprise organization on mission-critical data transformation and analytics initiatives. The ideal candidate will be experienced in clou

Platform Engineer

w3r Consulting

Cincinnati, Ohio, USA

Contract

JOB TITLE: Platform EngineerJOB DESCRIPTION Responsible for building outstanding software solutions to drive the success of a business. Build various aspects of the company's infrastructure to power innumerable conversations at scale.Primary Responsibilities: Maintain the company platform uptime, performance, stability, and scalabilityDesign, guide, mentor and challenge system architecture and design with othersDevelop and maintain a public APIDevelop best possible, most robust, and extensible s

Senior Analytics Developer - Specialist 3

K Systems Solutions

Remote or Brooklyn, New York, USA

Contract

Client Name: City of New York Start Date: July 10, 2025 End Date: July 9, 2026 Contract Length (in weeks): 52 Weeks SCOPE OF SERVICES TASKS:. ? Develop and maintain highly efficient and interactive reports, dashboards, and data models to meet business requirements. ? Collaborate with data scientists and business stakeholders to understand data analysis needs and translate them into technical requirements.? Design and implement data engineering pipelines to extract, transform, and load data f

Senior Software Developers

Randstad Digital Manual LLC

Woburn, Massachusetts, USA

Full-time

Senior Software Developers for Randstad Digital, LLC. Multiple openings. Headquarters: Woburn, MA. Develop, design, code, test, debug, document, modify, deploy, and migrate applications, programs, views, indexes. Confer with business partners regarding systems requirements. Review business environments, IT alternatives, present and future state. Perform scripting and querying, dependency analysis for object migration within data ecosystem, execute ad-job jobs, craft mappings, establish source an

AWS Data Architect ( Only W2)

Baanyan Software Services, Inc.

Richmond, Virginia, USA

Contract

Data Architect Contractor (15+ Years Experience) Long Term Contract Richmond, VA Role Overview We re looking for an experienced Senior Data Architect Contractor to help drive enterprise data modernization. In this high-impact role, you'll contribute to the design and implementation. The ideal candidate has a strong background in enterprise data architecture, deep hands-on AWS experience, and a proven track record of influencing engineering teams and business stakeholders. Key Responsibilities De

Senior Data Engineer (10+ Years) || Austin, TX (Onsite/Hybrid) || W2 Contract

V2 Innovations Inc

Austin, Texas, USA

Contract

Job Title: Senior Data Engineer Location: Austin, TX (Onsite/Hybrid) Job Type: W2 Contract Experience Required: 10+ Years Contact: Job Summary: V2 Innovations Inc. is seeking a highly skilled and experienced Senior Data Engineer for a long-term W2 contract role based in Austin, TX. The ideal candidate will bring a strong background in modern data engineering practices, ETL/ELT development, cloud technologies, and big data processing. This is a hybrid/onsite role, and local or nearby candidates a