hadoop big data spark engineer Jobs

Refine Results
81 - 100 of 1,196 Jobs

Hadoop Developer : Only Locals

Script2IT

Alpharetta, Georgia, USA

Contract

Position: Hadoop Developer with java background Location: Alpharetta, GA Duration: 12+ MonthsResponsibilities Programming Languages: Strong proficiency in Python, Java, and SQL. Big Data Frameworks: Deep understanding of Hadoop ecosystem (HDFS, MapReduce, Hive, Spark). Cloud Data Warehousing: Expertise in Snowflake architecture, data manipulation, and query optimization. Data Engineering Concepts: Knowledge of data ingestion, transformation, data quality checks, and data security practices.

Sr. Lead Data Engineer/Architect

iTech US, Inc.

Remote

Contract

Having 10+ years of experience as a Data Engineer , Experience in Financial IndustryStrong experience in one of language: Snowflake,Java, Scala, Python, C#Strong experience with: HDFS, YARN, Hive, Spark, Kafka, (AWS), Docker / Kubernetes, Snowflake.Good working Knowledge in Data mining/programming tools (e.g. SAS, SQL, R, Python)5+ years of experience in Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)Experience in Amazon Web Services : VPC, S3, CloudFront, EC2, Lambda

Sr. Data Engineer (Databricks, PySpark Scala, Bigdata.)

Xoriant Corporation

Quincy, Massachusetts, USA

Contract

Data Engineer Key Skills: Databricks, PySpark Scala, Bigdata. Location : North Quincy MA - Hybrid Onsite Skill Sets Required Must have over 10 years of experience in Data engineering.Good decision-making and problem solving skillsSolid understanding of Databricks fundamentals/architecture and have hands on experience in setting up Databricks cluster, working in Databricks modules (Data Engineering and SQL warehouse).Solid Knowledge on medallion architecture, DLT and unity catalog within Databri

Big Data Engineer

Cyber Space Technologies LLC

Berkeley Heights, New Jersey, USA

Third Party, Contract

Role: Data Engineer Location: Berkley heights, NJ (Hybrid) Experience with Big data technologies- Spark (java) for handling large scale data processeing proficiency in SQL and Database - querying, managing and manipulating data sets Knowledge of cloud platform- data storage, processing and deployment in a scalable environment (azure) CST provides its clients with complete, cost-effective, end-to-end personnel solutions across a range of industrial domains. CST's mission is to empower business

Sr. Data Engineer

ACL Digital

San Jose, California, USA

Full-time

Job Title: Sr. Data Engineer Location: San Jose, CA (Onsite) Job Description: Analytical skills : problem solving, handling multiple complex projects at one time etc SQL is a must( high proficiency). Preferably in Teradata but any SQL platform like Oracle, MySQL also ok Extensive experience in migrating data from Teradata --> Hadoop --> Cloud(Google Cloud Platform) and solid experience in Pre-prod and from Pre-prod to Production. Experience in migrating workload from on-premise to cloud and clou

Business Data Analyst

Newt Global

Irving, Texas, USA

Contract

Hi, Greeting from Newt Global, we are hiring potential Candidates for our Financial Clients, please go through below Job Description share me your updated resume if you are looking for a job change. Job Information: Position: Business Analyst Location: Irving , Texas (Hybrid) Duration: Contract Job Description: Participate in, and provide insights during, strategic discussions on data sourcing of various systems; presenting the findings to business/ relevant groupSupport requirements analysis

Snowflake Data Engineer

Acadia Technologies, Inc.

Boston, Massachusetts, USA

Full-time

Technical Skills:SQL:Fluent in SQL for querying, transforming, and managing data within Snowflake. Programming Languages:Proficiency in Python (and potentially Java or Scala) for data manipulation, scripting, and building data pipelines. Data Modeling:Knowledge of designing data models, including data warehousing concepts, schemas, and relationships. ETL Processes:Experience with ETL tools and techniques for extracting, transforming, and loading data into Snowflake. Cloud Computing:Familiari

Hadoop Developer

Avance Consulting

Austin, Texas, USA

Full-time

Role: Big Data Lead Developer Job Location:: Raleigh, NC Futime/Permanent Required Qualifications: At least 4 years of Information Technology experience3 +years of experience of building and supporting scalable Big Data applications. Working in a software product development organization building modern and scalable web applications.Experience in BigData Technologies and Hadoop.In-depth knowledge in Spark, Spark engine, Scala and PySpark programming.Experience on BigData querying using Pig, Hiv

Data Engineer(Expertise in Scala)

Photon

Tampa, Florida, USA

Full-time

Greetings from Photon, We hope you are staying safe. We are looking for a Data Engineer(Expertise in Scala)to join our team for large Fortune 500 Client. Who are we? Photon has emerged as one of the world s largest and fastest-growing Digital Agencies. We work with 40% of the Fortune 100 on their Digital initiatives and are known for our ability to integrate Strategy Consulting, Creative Design, and Technology at scale. Please visit to learn more about us, how we work, and our customer case stu

Senior Data Architect

Brains Workgroup, Inc.

New York, New York, USA

Full-time

Our client, a major bank in New York City, is looking for Senior Data Architect (Director Level). 2/3 days on-site in NYC office. This is a permanent FT career opportunity, Director - Level position with base salary range 220K-275K DOE, plus ~20-25% bonus and great benefits package. Senior Data ArchitectPOSITION SUMMARY: Seeking a highly experienced and innovative Senior Data Architect to join our Banking Technology team. This role is pivotal in designing, implementing, and managing data archite

Data Engineer (Need 10+ yrs on W2)

Symantrix Inc

California, USA

Contract

Position: Senior Data Engineer Location: Sunnyvale, CA Duration: 12+ Months Description: What you'll do: You will use cutting edge data engineering techniques to create critical datasets and dig into our mammoth scale of data to help unleash the power of data science by imagining, developing, and maintaining data pipelines that our Data Scientists and Analysts can rely on. You will be responsible for contributing to an orchestration layer of complex data transformations, refining raw data fro

Full Stack Engineer

Zachary Piper Solutions, LLC

Cary, North Carolina, USA

Full-time

Piper Companies is seeking a Full Stack Engineer to join a global financial powerhouse pioneering innovative banking solutions while shaping the future of sustainable finance for a full-time, hybrid position located in Cary, North Carolina (NC). The Full Stack Engineer will architect and develop complex enterprise systems using Big Data technologies and modern programming frameworks while collaborating with cross-functional teams to deliver end-to-end solutions through the entire software develo

Hadoop Developer

Innova Solutions, Inc

Jersey City, New Jersey, USA

Contract

A client of Innova Solutions is looking for Hadoop Developer Position type: Contract Duration: Long Term Location: Jersey City, NJ/Chicago, IL/Addison, TX (Hybrid 3 Days Onsite) As a Hadoop Developer, you will: Strong SQL Skills - one or more of MySQL, HIVE, Impala, SPARK SQL Data ingestion experience from message queue, file share, REST API, relational database, etc. and experience with data formats like json, csv, xml Experience working with SPARK Structured steaming Experience working with H

Senior AI/ML - Data Scientist

Apps Technologies, LLC

Hyderabad, Telangana, India

Full-time

Job Title: Senior AI/ML - Data ScientistExperience Required: 5+ YearsLocation: HyderabadNotice Period: Immediate Joiners Preferred About the RoleWe are looking for a Senior AI/ML Data Scientist with a strong foundation in big data technologies and a proven track record in building scalable AI/ML solutions. You will play a pivotal role in harnessing data to drive insights and power intelligent systems. This is a great opportunity for professionals who thrive in a data-driven environment and can s

Big Data Test Automation Engineer

Shimento, Inc.

San Francisco, California, USA

Contract

Big Data Test Automation Engineer Duration:- 12 Months Location:- San Francisco, CA 94105 / Hybrid Qualifications: Typically requires bachelor s degree in computer science, Information Systems, or another related field.The Test Automation Engineer typically requires four or more years of test automation, data science, or software engineering experience. The Sr. Test Automation Engineer typically requires seven or more years of test automation, data science, or software engineering experience.Cu

Data Scientist

I-Giants

Remote

Full-time

Job Title: Data Scientist Duration: Contract To Hire Location: Remote (CST or PST time zones is preferred) Key Skills: Machine Learning, AI, Data Science, Python, SQL, NLP, Spark/Hadoop 5-6 years of hands-on relevant experience in Data Science, Machine Learning and AI.Process data, develop algorithms and models to solve for a problem of needStrong programming skills in Python or R, with experience in ML libraries (scikit-learn, TensorFlow, PyTorch).Ability to ingest and process text, categorica

Senior Data Engineer

Garmin

Olathe, Kansas, USA

Full-time

Overview We are seeking a full-time Senior Data Engineer in our Olathe, KS location. In this role, you will be responsible for leading administration of technology by contributing expertise in researching new technologies and proposing cost effective solutions. Essential Functions Provides technical input to feature development plans and concept documentsUnderstands production and operations issues as they relate to engineeringDevelops scalable, extensible solution architectures leveraging cont

Hadoop Developer

Centraprise Corp

Newark, Delaware, USA

Full-time

5+ years of experience in data warehousing architectural approaches. Minimum of 4 years in big data,(Cloudera) Sound understanding and experience with Hadoop ecosystem (Cloudera). Able to understand and explore the constantly evolving tools within Hadoop ecosystem and apply them appropriately to the relevant problems at hand. Experience in working with a Big Data implementation in production environment. Must have experience with Big Data technologies like Hadoop, Hive, Spark, python, scala etc

Data Engineer

Unissant, Inc.

Ashburn, Virginia, USA

Full-time, Third Party

Unissant, Inc delivers innovative capabilities to the agencies that keep our nation healthy and safe. We apply our domain expertise, data acumen, and technology know-how to achieve breakthrough results for our clients. Working collaboratively, we advance missions and careers through a focus on honesty, integrity, and dependability. We continuously look for talent excited to join that effort. To learn more about our exciting organization, please visit us at . Unissant is seeking a Data Engineer

Security Clearance DevOps Engineer

Global Channel Management, Inc.

Columbia, Maryland, USA

Full-time

Security Clearance DevOps Engineer needs 9+ years' 9+ years of experience in DevOps Engineering or Software Development (Java preferred) Security Clearance DevOps Engineer duties: Proficient in configuration management tools such as Terraform, Ansible or Puppet Knowledge of AWS services (EC2, EBS, S3, Lambda) and their application to deployment and management of infrastructure. Experience with application and OS deployment, scaling, and management Ability to develop in multiple programming lang