Apache Spark Jobs in 63141

Refine Results
1 - 20 of 214 Jobs

Hadoop/Spark Developer @ SFO, CA (Onsite)

Sage IT Inc

O'Fallon, Missouri, USA

Contract, Third Party

Position: Hadoop/Spark Developer Location: SFO, CA (Onsite) Long Term Contract Roles and Responsibilities: Talent should have minimum 5+ years of experience. Should have good knowledge on Hadoop and Spark, SPARK-SQL, PYSPARK / SCALA Should have good working experience/knowledge in SQL Should have good communication Skills ETL knowledge is advantage

Sr. Data Engineer (SQL, ETL, Python, Hadoop, Spark, AWS)

Fervorly

Remote

Third Party, Contract

Title: Data Engineer Responsibilities: - Architect, develop, and maintain scalable data pipelines and ETL processes, facilitating the seamless flow of data across our ecosystem. - Collaborate closely with cross-functional teams to gather requirements, identify data sources, and deliver solutions aligned with business objectives. - Harness the power of SQL Server, crafting finely-tuned queries and procedures to extract insights from our data repositories. - Leverage Python's versatility to design

Full time Position || Technical Lead - Spark / Scala & Kubernetes || Remote

SanKar Inc

Remote

Full-time

Title Technical Lead - Spark / Scala & KubernetesLocation Remote (EST Working hours)Type - Fulltime Job Description: Excellent Spark-Scala SkillsExcellent Cloud (Azure preferable) skillsKubernetes Skill and experience is mandatory.

Bigdata Developer With Spark & Scala EMR

E-Solutions, Inc.

Remote

Third Party

Job title: Bigdata Developer With Spark & Scala EMR Location: Remote Mandatory Skills: Spark, Scala EMR and AWS JD Bachelor's degree preferably Computer Science, Engineering, or other quantitative fields 6+ years of related experience in designing and implementing enterprise applications using big data 5+ years of experience in a senior level engineering role mentoring other engineers, which includes engineering best practices, unblocking, code reviews, unit testing, managing deployments, te

Big data Developer(12+ years) with Spark and Scala and EMR and AWS experience-Remote

People Force Consulting Inc

Remote

Contract

Role: Bigdata Developers Exp Required: 12+Years Location: Remote Duration: 7+ Months Interview Process: Test followed by two round of technical discussion. Mandatory Skills: Spark, Scala EMR and AWS Please submit candidate who have Hand-on experience only Job Description Bachelor s degree preferably Computer Science, Engineering, or other quantitative fields 6+ years of related experience in designing and implementing enterprise applications using big data 5+ years of experience in a senior l

Big Data Developer (Spark, Scala, AWS, EMR)

People Force Consulting Inc

Remote

Contract, Third Party

Role: Big Data Developer - Healthcare Remote Minimum: 12+Years Mandatory Skills: SparkScalaAWS EMRAWSJob Description Requirements: Bachelor s degree preferably Computer Science, Engineering, or other quantitative fields6+ years of related experience in designing and implementing enterprise applications using big data5+ years of experience in a senior level engineering role mentoring other engineers, which includes engineering best practices, unblocking, code reviews, unit testing, managing dep

Senior Spark Data Engineer

Randstad Digital

Remote or Akron, Ohio, USA

Full-time

job summary: Senior Level Data Engineer - Fully REMOTE - Direct Hire! Our client is seeking a Data Engineering Leader to join their team and serve as Subject Matter Expert and Mentor, as they build data pipelines and drive analytic solutions. This position requires a Bachelor's Degree in Computer Science, MIS, or related field, with at least 8-10 years of related experience. Bonus Eligible, Minimal Travel, and Opportunities for career growth! The following skillsets are strongly preferred: Expe

Data Quality Engineer - Spark/PySpark/Databricks - Looking Who Can Work On Our W2

IntelliSavvy

Remote

Contract

Job Description Technical Skills: Azure Databricks, Synapse Analytics, SQL Hyperscale. Python, and PySpark for test automation for test frameworks in Azure environments Familiarity with version control systems and CI/CD pipelines for automated testing and deployment. Familiarity with data modeling, ETL processes, and data warehousing concepts. 6-10 years of experience in QA automation, with 5+ using Spark/PySpark. Key Responsibilities Develop comprehensive test strategies with a clear understa

Lead/Senior Data Engineer - Scala/Spark/Kafka/Azure

BayOne Solutions

Remote

Full-time

Job Title: Senior Data Engineer Job Type: Full Time Remote Eligible: Yes Skills: Scala programming, Spark, Kafka, Azure Responsibilities: Streamline the intake of the raw data into our Azure Data lake.Perform production support and deployment activities.Proactively drive the execution of our core data engineering, business intelligence, and data warehouse frameworksBuild data pipelines from systems such as CRM, Ecommerce etc. with the emphasis on scalability and reliabilityLeverage central data

Spark Scala Developer

Infosys Technologies Ltd

Remote

Full-time

Job Description :In the role of Spark Scala Developer, you will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation, Application Architecture definition and Design. You will play an important role in creating the high-level design artifacts. You will also deliver high quality code deliverables for a module, lead validation for all types of testing and support activities related to i

Data Pipeline Engineer- Scala, Spark, AWS - Major Entertainment Company

TechLink Resources

Remote

Contract

Looking for a Software / Data Engineer strong with Scala, Spark, AWS, and object oriented programming. This team is under the Ads Platform team and you will be responsible of a large - scale data platform for real - time and batch processing. Must have skills: Spark, Scala, Spring/Springboot/Scala3-5 years general experience in addition to having experience in production- having worked at a company in prod environments- Operationalize and productionize of systems having worked on bothAd targetin

Azure Data Architect

Intraedge

Remote

Contract, Third Party

Job Title: : Azure Data Architect Location: REMOTE Duration: Long Term Contract Responsibilities: Engineer Azure-based solutions with a focus on cost-efficiency, performance, and operational effectiveness. Craft and enforce a framework to quantify data quality across various customer and prospect sources, ensuring data accuracy, completeness, consistency, and timeliness. Scrutinize first-party customer data sources to establish the most reliable ones and formulate ingestion strategies for both

Scala Developer (Remote)

eTek IT Services, Inc.

Remote

Contract

Scala Developer Remote role 12+ months contract 1. 8-10+ years of experience with hands on development with Scala and Spark. This role is 100% hands on development. Scala is the top programming requirement for this role. Need someone strong in Scala. Bulk of the work is with Apache Spark/Scala programming language. This person will be writing Scala code that will run on Apache Spark. Looking for true software development not data engineering. 2. This person must have strong knowledge of Databa

Java Developer +Scala +Spark +DAG

SAR TECH LLC

Remote

Contract

Hi Please find the below requirement and let me know your Interest Position: Java Developer +Scala +Spark Location : Remote Duration: Contract. Spark (not pyspark), Scala with Airflow DAG experience is mandatory.Google Cloud Platform experience is preferrable.Java experience is preferred or good to have Looking forward to hear and work with you soon Thanks & Regards Ashok Reddy US IT Recruiter SAR TECH LLC

Databricks Solutions Consultant

Arkhya Tech

Remote or US

Full-time

Role: Databricks Solutions Consultant Location: Remote Job Type: Full Time Requirement3 3+ Years Data Engineering Experience, 3+ years of consulting experience Completed Data Engineering Associate certification & required classes. Minimum 1 project delivered with hands-on experience in development on Databricks. Completed Apache Spark Programming with Databricks, Data Engineering with Databricks, Optimizing Apache Spark on Databricks. SQL delivery experience, and familiarity with BigQuery, Syna

Sr. Data Analyst - (Databricks)

IntelliSavvy

Remote

Full-time, Part-time, Contract, Third Party

Note: Work visa sponsorship is not supported for this position Key Responsibilities 6-10 years of experience with 2+ using Databricks Conduct data discovery, document data sources, and definitions to ensure data accuracy and consistency. Analyze data using SQL queries and other analytical tools and use visual tools like Tableau or Power BI. Collaborate with data engineers, product management and support business stakeholders as needed. Document user stories, requirements, and acceptance criteria

Senior Application Developer

Spectrum

Maryland Heights, Missouri, USA

Full-time

TITLE: Senior Application Developer LOCATION: Maryland Heights, MO JOB SUMMARY: Design, develop, and implement real-time data ingestion using technology including Kafka, Apache NiFi and Hadoop batch layer technology, HIVE, HBASE, ETL development, and integration systems. Design and develop batch and real-time Big Data systems using technology including SQL, Talend and Hadoop batch layer technology, Spark SQL, Python, HIVE, Impala, ETL development, and integration systems. Design platform archite

Data Engineer II Machine Learning

SOHO Square Solutions

Remote

Third Party

Job description: Manage data engineering projects through the full cycle. Create, maintain, improve, automate, test and deploy efficient data pipelines and systems that process large amounts of data used for ML models using industry best practices. Thorough testing, instrumentation and monitoring of data pipelines. Proactively testing existing systems and proposing improvements and bug fixes. Building dashboards. Regularly sharing progress with the team and occasionally presenting findings. Ab

Remote Opportunity || Data Analytics with Python || Full time

IT First Source

Remote

Full-time

Remote Opportunity || Data Analytics with Python || Full time Qualifications Expertise in using SQL with some experience in Python/R or Data AnalysisExperience in manipulating data and drawing insights from large data setsExperience in designing and implementing ETL process (defining, gathering, transforming) dataHands-on Development experience in Big Data technology stack Panda, NumPy, Hive, Impala, Spark, CDSWExperience in Git/ BitBucketExperience in Orchestration tools like Control M and AirF