diyotta etl with hadoop Jobs

Refine Results
1 - 20 of 309 Jobs

Senior Spark Architect

Infosys Technologies Ltd

Jersey City, New Jersey, USA

Full-time

Role: Sr. Spark Architect Location: Newport, NJ Required Qualifications Candidate must be located within commuting distance of Newport, NJ or be willing to relocate to the area. This position may require travel to project locationsBachelor s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of educationAt least 11 years of Information Technology experienceAll applicants authorized

Unix Engineer (Shell Scripting, Informatica & Teradata)

Stanley David and Associates

Plano, Texas, USA

Full-time

Job Description Unix Engineer (Shell Scripting, Informatica & Teradata) Hands on experience with Unix Hands on experience with Database (Oracle Teradata) Hands on experience in Hadoop Experience in Job scheduling tool - Autosys. Knowledge on ETL tool - Informatica.Interested candidate will explore unique set of opportunities that enriches domain, technical and process expertise. The suitable candidate shall support one of the Bank s critical Financial Crimes portfolio with expertise in Anti-Mon

ETL Technical Lead

VDart, Inc.

Worcester, Massachusetts, USA

Contract, Third Party

Role: ETL Technical Lead Location: Worcester, MA (Hybrid) Type: Contract Must have experience: years in ETL Power Center, Oracle, Hadoop, SQL Work with Business Analysts to understand the requirements and arrive at estimates Closely work with business to understand the issues and arrive at feasible solution. Track and monitor multiple daily, weekly and Monthly batches running on PowerCenter Work with offshore team for batch status reporting. Provide estimates to application enhancements Able to

Quality Assurance Consultant V

BCforward

Charlotte, North Carolina, USA

Contract

Quality Assurance Consultant V BCforward is currently seeking a highly motivated Quality Assurance Consultant V for an opportunity in Charlotte, NC Position Title: Quality Assurance Consultant V Location: Charlotte, NC Anticipated Start Date: ASAP Please note this is the target date and is subject to change. BCforward will send official notice ahead of a confirmed start date. Expected Duration: 12 Months. Job Type: CONTRACT, HYBRID Pay Range: $55/hr - $60/hr on W2 Please note that actua

Data Engineer

Shrive Technologies LLC

California, USA

Contract, Third Party

JD We are seeking a highly skilled and experienced Data Engineer with a strong background in AI/ML to design, build, and optimize robust data pipelines and infrastructure on the Google Cloud Platform (Google Cloud Platform). The ideal candidate will be passionate about leveraging data to power machine learning initiatives, ensuring data quality, accessibility, and scalability for advanced analytics and AI applications. MINIMUM 10 YEARS OF EXPERIENCE Responsibilities: Data Pipeline Development:

Big Data Developer

Capgemini America, Inc.

Jersey City, New Jersey, USA

Full-time

Position Title : Big Data Developer Location : Jersey City, NJ (Hybrid) Experience : 8+ Years Employee Type : Full Time with Benefits Job Description We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team. The ideal candidate will have a strong background in software development, data engineering, and large-scale distributed systems. This role requires a deep understanding of big data technologies and the ability to lead and implement enterprise-scale

Data Architect

FM Search, LLC

Dallas, Texas, USA

Full-time

Position Overview We are seeking an experienced and highly skilled Data Architect to join our IT team. As a Data Architect, you will be responsible for designing, implementing, and maintaining robust data systems and structures that meet the company's strategic needs. You will play a key role in creating efficient data workflows and managing large-scale datasets while ensuring data security, quality, and accessibility across the organization. Key Responsibilities: Data Architecture Design: Devel

Data Engineer

Centraprise Corp

Dallas, Texas, USA

Full-time

Data Engineer Fulltime (Permanent) Cleveland, OH/Pittsburgh, PA/Dallas, TX/Phoenix, AZ Complete Onsite Job Description 5+ Years experience working in Data Engineering and Data Analysis.Hands on Experience in Hadoop Stack of Technologies ( Hadoop ,PySpark, HBase, Hive , Pig , Sqoop, Scala ,Flume, HDFS , Map Reduce).Hands on experience with Python & Kafka .Good understanding of Database concepts , Data Design , Data Modeling and ETL.Hands on in analyzing, designing, and coding ETL programs which

Senior Ab-Initio developer

Vega Consulting Solutions

Washington, District of Columbia, USA

Third Party, Contract

ABINITIO DEVELOPMENT EXPERIENCE REQUIREDMust be located in the Metro DC area Vega Consulting Solutions, Inc. is searching for a Senior Ab-Initio developer for a 12 month+ Contract job opportunity with our direct client. This position is Hybrid based. Candidates must be located in PA, MD, VA, DC or WVa. Required Experience:Total of 7+ Years of IT Experience predominantly in Data Integration/ Data Warehouse area Must have at least 3 years of ETL Design and Development experience using Ab Initio

AWS Engineer

Technology Ventures

Reston, Virginia, USA

Third Party, Contract

Job title: AWS EngineerLocation: Reston, VA Job Description: Skilled in AWS services such as EC2, SSM, CloudFormation, CloudWatch, and Lambda Experience with Spark and Amazon EMR/Hadoop, PySpark and AWS Glue Skilled in programming languages like Python, Unix Shell scripting Experience with Terraform Module creation and usage Experience automating repetitive tasks related to provisioning of AWS Services, installation, configuration, or management of infrastructure using Terraform, Gitlab, Ansible

Data Warehouse Specialist (Snowflake)

Comtech Global

Columbus, Ohio, USA

Full-time, Part-time, Contract, Third Party

Direct client - Data Warehouse Specialist (Snowflake), Columbus, OH - Hybrid The Technical Specialist will be responsible for migrating the current data, framework and programs from the ODM EDW IOP Big data environment to the ODM EDW Snowflake environment. Technical Specialist will also involve in Medicaid Enterprise Data Warehouse design, development, implementation, migration, maintenance and operation activities. Works closely with Data Governance and Analytics team. Will be one of the key t

Role: Database Applications Developer.............Alpharetta, GA - Onsite - F2F interview

Tech Rakers

Alpharetta, Georgia, USA

Contract, Third Party

Role: Database Applications Developer Alpharetta, GA Onsite F2F Interview Required Skills and Experience: Data Modelling & Data Warehousing: Strong understanding of data warehousing concepts, building facts and dimensions, and translating business requirements into a data warehouse.SQL: Highly skilled in SQL, including stored procedures, views, and debugging.SSIS: Good knowledge of SSIS (SQL Server Integration Services), including storing, deploying, and scheduling packages.Snowflake: Ability t

Data Scientist/Architect-Principal

IKCON TECHNOLOGIES Inc.

Mason, Ohio, USA

Contract

IKCON TECHNOLOGIES INC delivers exceptional IT services and solutions that provide clients with definite edge over competitors and promoting highest standards of quality. We are currently looking for a Data Scientist/Architect-Principal with one of our clients in Mason, OH. If you are actively looking for opportunities, please send us your updated resume with your contact details. "U.S. Citizens and those authorized to work in the U.S. are encouraged to apply." JOB TITLE Data Scientist/Architec

QA Automation - TOSCA

Innova Solutions, Inc

Charlotte, North Carolina, USA

Contract

Innova Solutions has a client that is immediately hiring for a < QA Automation - TOSCA - ETL/Hadoop > Position type: Contract Duration: 12+ months Location: Hybrid 3 days onsite in Charlotte, NC As a QA Automation - TOSCA, you will: Job Description: Develops detailed, comprehensive and well-structured test cases based on functional requirements Contributes to test planning, and when part of a Scrum team, builds test cases for stories in the given sprint as per story acceptance criteria Automat

Data Engineer with ML Experience

Marlabs LLC

Atlanta, Georgia, USA

Contract

Data Engineer with ML Experience Location: Atlanta, GA ( Onsite from Day 1 ) Education and Experience: Bachelor s degree in Computer Science, Data Science, Engineering, or a related field. A Master s degree or relevant certifications (e.g., Google Professional Data Engineer) is a plus.5+ years of experience in data engineering, with at least 23 years of experience in machine learning engineering or deploying ML models in production.Proven experience in building and maintaining scalable data pipe

Software Engineer Intern (Big Data - Data Platform) - 2025 Summer/Fall (PhD)

TikTok

Seattle, Washington, USA

Full-time

Location : Seattle Employment Type : Intern Job Code : A52940 Apply to this job Share this listing: Responsibilities As a data engineer in the data platform team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll have the opportunity to gain hands-on experience on all kinds of systems in the data platform ecosystem. Your work will have a direct and huge impact on the company's core products as well as hundreds of millions of u

Software Engineer Intern (Big Data - Data Platform) - 2025 Summer/Fall (PhD)

TikTok

San Jose, California, USA

Full-time

Location : San Jose Employment Type : Intern Job Code : A18471A Apply to this job Share this listing: Responsibilities As a data engineer in the data platform team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll have the opportunity to gain hands-on experience on all kinds of systems in the data platform ecosystem. Your work will have a direct and huge impact on the company's core products as well as hundreds of millions of

Data Engineer, E-Commerce

TikTok

San Jose, California, USA

Full-time

Location : San Jose Employment Type : Regular Job Code : V0220 Apply to this job Share this listing: Responsibilities As a Data Engineer in the Data Platform E-Commerce team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll have the opportunity to gain hands-on experience on all kinds of systems in the data platform ecosystem. Your work will have a direct and huge impact on the company's core products as well as hundreds of m

Software Engineer Intern (Big Data - Data Platform) - 2025 Summer/Fall (MS)

TikTok

Seattle, Washington, USA

Full-time

Location : Seattle Employment Type : Intern Job Code : A186506 Apply to this job Share this listing: Responsibilities As a data engineer in the data platform team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll have the opportunity to gain hands-on experience on all kinds of systems in the data platform ecosystem. Your work will have a direct and huge impact on the company's core products as well as hundreds of millions of

Adobe Experience Platform Architect - Remote

Nava Software Solutions

Remote or Jersey City, New Jersey, USA

Contract, Third Party

NAVA Software solutions is looking for an Adobe Experience Platform Architect Details: Adobe AEP Architect Length: 12+ month contract Location: Remote Interview: Phone Screen, (2) Internal Video Technical Interviews & (1) Client Video Interview. JOB DESCRIPTION: Adobe AEP Architect : An Architect, AEP is a thought leader who will provide solutions in client contexts and guide the teams in executing digital transformation in areas of architecture and technology implementation. They can demons