apache spark Jobs

Refine Results
101 - 120 of 2,193 Jobs

Databricks Data Engineer (W2) No H1B

Sovereign Technologies

Plano, Texas, USA

Contract

Job Title: Support Data Engineer LOCATION: Plano, TX (hybrid 1-2 days a week) DURATION: 6+ months Top Skills Details EMR or Data Bricks Additional Skills & Qualifications Multiple years of experience with terraform is important. Multiple years of experience with AWS cloud is important. Multiple years of experience with configuring AWS cloud using terraform would be nice to have. Multiple years of Java backend development is important. Multiple years of Java Spring APIs experience is nice to have

Big Data Full Stack Developer

Info Dinamica Inc

Jersey City, New Jersey, USA

Third Party, Contract

Big Data Full Stack Developer Jersey City, NJ / New York City, NY Skills : bigdata, Hadoop ecosystem, sqoop, spark, scala, java, spring, springboot, rest services, oracle, angular Strong expertise in Big Data technologies, including hands-on experience with Hadoop ecosystem components like Sqoop and Spark for large-scale data processing and management. Proficient in Java programming, with experience in Spring, Spring Boot, and REST services to develop robust backend solutions and integrate with

Resilience, Testability & Scalability Lead

ISR Info Way, Inc.

Fort Mill, South Carolina, USA

Contract

Job Title: Resilience, Testability & Scalability Lead Location: Fort Mill, SC / New York / New Jersey / Remote (Hybrid) Project: Cloud-Native Enterprise Data Platforms Engineering Quality & Resilience Track Role Overview: Client is looking for a hands-on, technically strong Resilience, Testability & Scalability Lead to drive engineering excellence across our data platforms and cloud-based applications. This role is critical in ensuring system uptime, test automation maturity,performance under sc

Java Developer with Hadoop

I-Link Solutions

O'Fallon, Missouri, USA

Contract

Java developer with Hadoop Location: O'Fallon, MO Looking only on W2 candidates Technical skills SCALA/JAVA/SPRING API JAVAHADOOP (Kafka, Hdfs/Ozone, Hbase, Solr, Spark, Hive)DATA BRICKS/AWSSoft skills Problem-solvingCommunication/AdaptabilityDisclaimer: i-Link Solutions Inc. provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disabili

SAS Teradata Developer

Innova Solutions, Inc

Charlotte, North Carolina, USA

Contract

A client of Innova Solutions is immediately hiring for a SAS Teradata Developer Position: SAS Teradata Developer Position Type: W2-Contract Locations: Charlotte, NC and Plano, TX Hybrid: 3 days Onsite and 2 days remote The ideal candidate will have: SAS, Teradata, Python,SQL and Hadoop Required Qualifications 7+ years of software development experienceStrong experience in complex SQL query, PL/SQL programming,Strong software design, build, test and documentation skills * Proven track record in p

Senior Data Architect

Brains Workgroup, Inc.

New York, New York, USA

Full-time

Our client, a major bank in New York City, is looking for Senior Data Architect (Director Level). 2/3 days on-site in NYC office. This is a permanent FT career opportunity, Director - Level position with base salary range 220K-275K DOE, plus ~20-25% bonus and great benefits package. Senior Data ArchitectPOSITION SUMMARY: Seeking a highly experienced and innovative Senior Data Architect to join our Banking Technology team. This role is pivotal in designing, implementing, and managing data archite

Artificial Intelligence Engineer - Agentic Data Engineer

Accylerate

Richmond, Virginia, USA

Contract

Title: Artificial Intelligence Engineer - Agentic Data Engineer Duration: 6 Months(Extendable) Location: Richmond, VA (Resource will need to be in Richmond, VA quarterly) Client is seeking a highly skilled Artificial Intelligence Engineer 4- Agentic Data Engineer to design, develop, train and deploy data models that leverage agentic AI that solve real-world problems. Responsibilities: Gather business needs and translate them to analytics.Produce code that is clearly documented and maintain a ve

Hadoop Developer

Innova Solutions, Inc

Addison, Texas, USA

Contract

A client of Innova Solutions is looking for Hadoop Engineer. Position type: Contract Duration: Long Term Location: Addison, TX (Hybrid 3 Days Onsite) As a Hadoop Engineer, you will: 6+ Years of IT experience with 4+ Years of relevant experience in developing solutions using Hadoop technologies, Hive, Impala, Tez, UNIX, Python Good programming knowledge with Hadoop, HIVE, Unix, Python, Shell Scripting Strong knowledge in SQL/PSQL for building and performance tuning complex queries with multiple

Databricks Architect

Buaut

San Francisco, California, USA

Contract

Key ResponsibilitiesDesign and implement end-to-end data architecture on Databricks (Spark, Delta Lake, MLflow). Develop and optimize large-scale ETL/ELT pipelines using PySpark/SQL. Architect data lakes and lakehouses integrating cloud storage systems (e.g., ADLS, S3, GCS). Define and enforce best practices around security, data governance, and cost optimization. Lead technical workshops and collaborate with data engineers, data scientists, and DevOps. Implement data orchestration workflows (e.

Data Engineer

Xoriant Corporation

San Francisco, California, USA

Contract

Position Title: Data Engineer Location: San Francisco, CA (Hybrid) Duration: 12 Months contract with possibility of extension In Person Interview is Must have Key skill - Expert on Scala, Spark, Bigdata, DB Brief technical JD below Spark mandatory and programming in either Java or Scala. More importantly the person needs to be able to drive some program independently. JD: True Hands-On Developer in Programming Languages like Java or Scala .Expertise in Apache Spark .Database modelling and workin

Azure Data Engineer

Paul May & Associates

Schaumburg, Illinois, USA

Full-time

Job Title: Azure Data Engineer Primary Location: Hybrid - Schaumburg, IL - 2 Days In-Office, 3 Days WFH Position Type: Direct Hire Compensation Information The expected salary range for this position is $110,000 - $147,000 per year, depending on experience and qualifications. This role also qualifies for comprehensive benefits such as health insurance, 401(k), and paid time off. committed to pay transparency and equal opportunity. The salary range provided is in compliance with applicable s

BigData Developer

Innova Solutions, Inc

Addison, Texas, USA

Contract

A client of Innova Solutions is looking for Bigdata Engineer. Position type: Contract Duration: Long Term Location: Addison, TX/Charlotte, NC/Chicago, IL (Hybrid 3 Days Onsite) As a Bigdata Engineer, you will: Strong SQL Skills - one or more of MySQL, HIVE, Impala, SPARK SQL Data ingestion experience from message queue, file share, REST API, relational database, etc. and experience with data formats like json, csv, xml Experience working with SPARK Structured steaming Experience working with Ha

Lead AI-ML Developer

HAN IT Staffing Inc.

New York, New York, USA

Contract, Third Party

Job: Lead AIML Developer Location: NYC, NY onsite Day 1 Duration: Long Term Client: Direct $/hr on C2C Job Description : Responsibilities: Design and implement machine learning models and algorithms for classification, regression, clustering, and recommendation systems.Collaborate with data scientists, software engineers, and product teams to integrate AI solutions into production environments.Analyze large datasets to extract meaningful insights and improve model performance.Research and stay

Data Modeler / Data Engineer (Hybrid onsite - W2 Contract)

Xoriant Corporation

Stamford, Connecticut, USA

Contract

Job Title : Data Modeler / Data Engineer Client Location: Stamford. CT (Hybrid 3 - 4 days a week onsite) Contract: W2 Duration: Long term contract Job Description: Total 7-11 years of experience. 50% data modelling, 50% spark & python coding which includes advanced spark Must have 5+ Years of data analyst + Data modelling experience Data Modeling Experience is a must( Erwin tool), should be able to create physical model & logical model. Candidate should be able to write SQL queries. Knowledge

Big Data Hadoop Engineer

Harvey Nash Inc.

Remote

Contract

We are seeking a Big Data Hadoop Engineer for one of our direct client & its a 100% remote opportunity, needing to work in PST time zone. Looking for candidates who can work only on W2 Must Haves Strong experience in Big Data, Cloudera Distribution 7.x, RDBMS development4-5 years of programming experience in Python, Java, Scala, and SQL is must.Strong experience building data pipelines using Hadoop components Sqoop, Hive, SOLR, MR, Impala, Spark, Spark SQL, HBase.Strong experience with REST API

Java Developer with Hadoop experience - only W2

I-Link Solutions

O'Fallon, Missouri, USA

Contract

Hello, Greetings from i-link Solutions Inc! We have an immediate opening for the below position, if you are interested, please revert back to me with your updated resume and expected rate at the earliest. Title: Senior Software Engineer Location: O'Fallon, Missouri (Main Campus) Duration: 24 Months Glider: Software Engineering Advanced What are your top 3 required technical skills? SCALA/JAVA/SPRING API JAVA HADOOP (Kafka, Hdfs/Ozone, Hbase, Solr, Spark, hive) DATA BRICKS/AWSWhat soft skills wou

AIOps Google Cloud Platform Engineer/Architect

DynPro Inc.

Remote

Full-time

About the Role: As an AIOps Engineer, you will play a critical role in enhancing the reliability, efficiency, and performance of Google Cloud's vast and complex infrastructure. You will leverage your expertise in Artificial Intelligence and Machine Learning to design, implement, and optimize intelligent automation solutions for IT operations, ultimately improving the experience for our global customers. This position offers a unique opportunity to work on challenging problems at scale, contribut

Google Cloud Platform Data Engineer

Intellect Quest LLC

Remote

Third Party, Contract

Role : Google Cloud Platform Data EngineerLocation: Remote Description: We are seeking a highly motivated and talented Data Engineer to join our dynamic team. As a Data Engineer, you will play a critical role in designing, developing, and implementing data pipelines and data integration solutions using Spark, Scala, Python, and Google Cloud Platform (Google Cloud Platform). You will be responsible for building scalable and efficient data processing systems, optimizing data workflows, and ensur

Data Engineer

SG Analytics Inc.

New York, New York, USA

Full-time

Job Overview: We seek a highly skilled and motivated Data Engineer with strong expertise in Python, PySpark, AWS, Databricks, and Snowflake to join our dynamic team. The ideal candidate should have hands-on experience with Spark optimization, SQL data processing, and AWS tools and technologies. Exposure to Informatica and data streaming tools is a plus. Key Responsibilities:Design, develop, and optimize scalable data processing pipelines using Spark and PySpark.Implement Spark optimization tech

Google Cloud Platform Cloud Engineer

Vaco by Highspring

Montgomery, Ohio, USA

Full-time

Vaco is hiring a Google Cloud Platform Cloud Engineer for a direct hire opportunity in the greater Cincinnati area. This role requires candidates to be local to the Cincinnati area, as regular in office meetings are required. Only local candidates will be considered for this role. NO C2C SOLICITATIONS Our client is in the midst of leading a migration of data from SQL Server to Google Cloud Platform. As their Google Cloud Platform Cloud Engineer, you will architect and build robust ingestion fr