hadoop big data spark engineer Jobs

Refine Results
1,241 - 1,260 of 1,314 Jobs

Data Scientist

Charter Solutions Inc.

•

Remote

Full-time

Data Scientist Information Technology Job Description: Data Scientist Data Scientist Roles and Responsibilities Building algorithms and designing experiments to merge, manage, analyze, and extract data for tailored reports to colleagues, clients or management. Creating, managing, and utilizing high performance relational and NoSQL databases, such as Microsoft SQL Server, Oracle, Microsoft Access, OLAP and other software. Selecting and implementing data mining methods most relevant to compan
Posted 60+ days ago | Updated 5 hours ago

AIOps/MLOps Architect | Remote (PST Time)

Momento USA LLC

•

California, USA

Contract, Third Party

Hi, Momento USA is a global technology consulting, talent acquisition, and creative development firm that addresses clients' most pressing needs and challenges. We are currently looking for an AIOps/MLOps Architect. Role: AIOps/MLOps Architect Location-Fremont, CA / Remote (Who can work in PST time) Job Type-Long Term Strong background in Python, API development, Large Language Models (LLM) concepts, ML Ops, Azure Cloud and AI operations with 10-15 years of experience working on advanced AI/ML
Easy Apply
Posted 8 days ago | Updated 3 hours ago

Director of Java Kafka Software Engineering

Request Technology, LLC

•

Chicago, Illinois, USA

Full-time

We are unable to sponsor for this permanent full-time role Position is bonus eligible Prestigious Financial Institution is currently seeking a Director of Software Engineering with strong Java and Kafka experience. Candidate will be responsible for leading a team of skilled software engineers designing and delivering scalable and resilient hybrid and Cloud-based applications and data solutions supporting critical financial market clearing and risk activities; helping to drive the strategy of tra
Easy Apply
Posted 9 days ago | Updated 9 days ago

Senior Data Engineer

Anblicks

•

Dallas, Texas, USA

Contract

Job Title: Senior Data Engineer Location: Dallas, TX Skills Required: 12+ years as a Data Engineer. 7+ years of experience with the end-to-end process for data pipelines, ETL/ELT tools and analytics 7+ years of experience building and scaling MDM systems and supporting infrastructure. 7+ year of expertise working with relational and columnar databases such as PostgreSQL, Snowflake, Snaplogic. Expertise in Data Analysis, Data Profiling, and SQL Tuning. Expertise in SQL programing skills - Adept a
Easy Apply
Posted 2 days ago

Lead PySpark Developer

Accuro Group

•

Maryland, USA

Part-time, Third Party, Contract

Hi, Hope you are doing well, I am reaching out to you on an exciting job opportunity with one of our clients. Role name: Lead PySpark Developer Location: Owings Mills, MD Contract Role Description: Lead the design, development, and deployment of PySpark-based big data solutions. Architect and optimize ETL pipelines for structured and unstructured data. Collaborate with Client, data engineers, data scientists, and business teams to understand requirements and provide scalable solutions. Opt
Easy Apply
Posted 3 hours ago

Senior Software Developers

Randstad Digital Manual LLC

•

Woburn, Massachusetts, USA

Full-time

Senior Software Developers for Randstad Digital, LLC. Multiple openings. Headquarters: Woburn, MA. Develop, design, code, test, and support data warehouse, data models, confer with developers and data analysts, review programming tasks and requirements. Ensure implementation, debug and fix issues, migrate data imports, implement data quality checks and deliver downstream, write scripts to ETL data into target databases, add new source system and capabilities to deliver systems data, support proc
Easy Apply
Posted 12 days ago

Data Architect: III (Senior)

Randstad Digital

•

Remote or Madison, New Jersey, USA

Contract

job summary: The Senior Data Engineer is responsible for designing and developing scalable, high-performance data solutions to support millions of users and clients. The role requires expertise in big data technologies such as Spark with Scala, Kafka, NoSQL databases, and AWS cloud services, with a focus on building robust data pipelines and platforms in a fast-paced, collaborative environment. Candidates should have extensive experience in real-time stream processing, data architecture, and a
Posted 1 day ago | Updated 1 hour ago

Senior Java Developer 12+ years on W2

Divit Technologies, Inc.

•

Hanover, New Jersey, USA

Full-time

12+ Years of exp. Work experience as a Fullstack Developer with Core Java, Spring framework (Spring Boot & Spring Batch), RESTful API Services and Angular Experience in writing test cases and Unix Shell scripts Good Knowledge in Relational databases and SQL Problem-solving abilities Eager to learn new technologies in Big Data Space (Hive, Impala, Spark Sql, Scala etc). Any cloud experience (AWS/Azure/Google/Oracle). Desirable skills/Preferred Qualifications: Understanding of Big Data Technologie
Easy Apply
Posted 11 hours ago

Data Engineer

Dahl Consulting

•

Remote or Brooklyn Park, Minnesota, USA

Contract

Seeking a new job opportunity? Don t miss this role! Dahl Consulting is currently partnering with a leader in the retail industry. We work one-on-one with great candidates to help connect them with local employment opportunities. This Company is hiring a Data Engineer for a contract position! Interested? Get more details below.Contract Duration: 6-monthsWorksite Location: Brooklyn Park, MN | Hybrid or remoteCompensation: $60.00 - $90.00 per hourWhat you ll do as the Data Engineer: Design, build,
Easy Apply
Posted 7 days ago

Sr Data Engineer (DBT, FiveTran, SQL) @ Fulltime with CriticalRiver

Critical River, Inc.

•

San Francisco, California, USA

Full-time

Hi , I hope you are doing well..!! Title: Sr Data Engineer (DBT, FiveTran, SQL) Location: Bay Area California (Hybrid) Duration: Fulltime with CR Years of Experience: 10-15 Years Job Description: A talented Senior Data Engineer to join our consulting practice. As a Senior Data Engineer, you will play a pivotal role in delivering data engineering solutions to our clients across various industries. You will work closely with clients to understand their business requirements, design and implement d
Easy Apply
Posted 60+ days ago | Updated 5 days ago

Azure Data Engineer

Kaynes Technology Inc

•

Woodbridge Township, New Jersey, USA

Contract

Role: Azure Data Engineer Location: Iselin NJ 3 Days Hybrid from Day 1 Note: Only W2 and EST Time Zone Must Have: SnowflakeSQLPythonADFAzure Data BricksPySparkData Warehouse Concepts Job Description : This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise. Major Responsibilities: Build and optimize
Easy Apply
Posted 2 days ago

Senior Data Analyst

Computer Enterprises, Inc.

•

Pittsburgh, Pennsylvania, USA

Contract

Senior Data Analyst W2 Contract Hybrid (3 days on site 2 days remote) Pittsburgh/Dallas/Cleveland Key Responsibilities: Conduct UAT (User Acceptance Testing), exploratory data analysis, and root cause investigations. Gather and translate complex business requirements into technical documentation and logic. Develop lightweight coding solutions in SQL, Python, and/or Spark to support business rules and data transformations. Partner with business and technology teams to prototype and implement data
Easy Apply
Posted 5 days ago | Updated 5 days ago

AWS Databricks Data Engineer (Hybrid onsite - W2 contract)

Xoriant Corporation

•

Quincy, Massachusetts, USA

Contract

Job Title : AWS Databricks Data Engineer Location: Quincy, MA (3- 4 days a week Hybrid onsite) Duration : Long term contract Contract: W2 / C2C IC (Own Individual corp only) Job Description: Client Note: In a nutshell we are looking for candidates who have hands on experience with migration of legacy applications from On-prem to AWS Public Cloud using AWS services such as EC2, ALB/ELB, S3, FSX, Opensearch, Kibana, CloudWatch, grafana, AWS Secret Manager with CyberArk, KMS and OIDC/ SAML integra
Easy Apply
Posted 13 days ago | Updated 2 days ago

Data Scientist

BEAT LLC

•

Remote

Full-time

Job Description:Security Clearance: Secret Required BEAT is seeking two highly skilled Data Scientists to join our team, preferably with Army and NATO sustainment process knowledge. These positions will require expertise in Army Vantage and MAVEN, as well as advanced skills in various data science tools and methodologies. The ideal candidates will work remotely, the role requires daily engagement with process owners in the G4 and other MSC G4s. Flexible hours is crucial for effective communicati
Easy Apply
Posted 36 days ago | Updated 15 days ago

Senior Ab Initio Developer

HPTech Inc.

•

Plano, Texas, USA

Contract

Technical Skillset Mandatory: Thorough understanding in ETL Architecture and being able to provide designs and solutions independently in ETLExperience working with various Ab Initio program components such as Reformat, Rollup,Scan, Join, Partition by key, - Partition by Round Robin, Gather, Merge, Sort, Lookup etc.Experience with various Ab Initio parallelism techniques, Ab Initio Graphs using Data, Pipeline Component parallelisms.Working knowledge in Bigdata / Hadoop Eco system and HDFS comman
Easy Apply
Posted 12 hours ago

Databricks Engineer

SUNRAY INFORMATICS

•

Dallas, Texas, USA

Contract, Third Party

Hi Professionals, We have an immediate openins for the below role, If interested please apply. Job Title: Azure Databricks Engineer Type : ContractInterview: Telephonic & F2FJOB RESPONSIBILITIESNeed minimum 15+ years profiles of overall Experience.Candidates with in 15 miles of radius NeededROLE: SR.AZURE DATABRICKS ENGINEER- FINANCIAL EXPERIENCE MUSTMUST HAVE EXPERTISE IN THE SKILLS GIVEN BELOWAzure FunctionsSQL ServerPostgreSQLDatabricksStrong background in Data QualityOVERALL EXPERIENCE 15YRS
Easy Apply
Posted 13 days ago

Solution Architect with strong Kafka exp

Techno-Comp, Inc.

•

Remote

Contract

Job Title: Solution Architect with strong Kafka exp Location: Remote Duration: Long Term Contract Required Skills: Manage Platform with Senior Kafka, Airflow, DatabricksExperience with Big Data technologies (Spark, Redshift/ BigQuery/ Synapse/ Databricks, Kubernetes, PowerBI)Familiar with programming languages Python/Kotlin/Go/C/JavaAPI Building from scratchAPI Gateway buildingNetwork Components Required OSS, BSS, Telecom IQ, Network IQ, Detection Analysis, Predictive Analysis, Real Time Streami
Easy Apply
Posted 33 days ago | Updated 12 hours ago

Data Architect: III (Senior)

Dexian DISYS

•

No location provided

Contract

Job Title: Sr. Data Engineer Assignment Duration: Long Term Assignment Type: Contract Location: 100% Remote At Anywhere, we work to build and improve a platform that helps real estate professionals work effectively and helps delight home buyers and sellers with an excellent experience. We do that by combining great technology with great people - and were looking for a Senior Data Engineer to join our team. What were looking for: Youre a talented, creative, and motivated engineer who loves de
Easy Apply
Posted 1 day ago | Updated 5 hours ago

Lead Data Scientist (PhD) - Intelligent Forecast Application

Sierra Software Solutions

•

Plano, Texas, USA

Contract

Lead Data Scientist (PhD) - Intelligent Forecast Application Location: Plano, TX - 6-12 Months Contract Job Description :: We are seeking an exceptional and highly motivated Lead Data Scientist with a PhD in Data Science, Computer Science, Applied Mathematics, Statistics, or a closely related quantitative field, to spearhead the design, development, and deployment of an automotive OEM s next-generation Intelligent Forecast Application. This pivotal role will leverage cutting-edge machine learni
Easy Apply
Posted 10 hours ago

Sr IDMC( (Informatica Data Management Cloud)) Architect-100% remote

Smart Caliber Technology

•

Remote

Contract, Third Party

Looking for a IDMC Architect 6 Months+ Remote Need a very Sr seasoned IDM resource 15 Yrs. sample resume attached We are seeking a highly skilled and experienced Informatica Architect to join our dynamic team. The ideal candidate will have a strong background in Informatica, Informatica Data Management Cloud (IDMC), and Collibra to design, develop, and implement robust data integration, governance, and management solutions. This role requires an individual who can take ownership of the data ar
Easy Apply
Posted 3 hours ago