big data engineer(scala & spark) Jobs

Refine Results
1 - 20 of 195 Jobs

Senior Big Data/ Spark Engineer - C13

Citi

•

Remote or Irving, Texas, USA

Full-time

The Senior Big Data engineering lead will play a pivotal role in designing, implementing, and optimizing large-scale data processing and analytics solutions. This role requires a visionary leader who can drive innovation, define architecture strategy, and ensure the scalability and efficiency of our big data infrastructure. Key ResponsibilitiesLead the design and development of a robust and scalable big data architecture handling exponential data growth while maintaining high availability and re
Posted 1 day ago | Updated moments ago

Lead Data Engineer

Exl Service

•

Fremont, California, USA

Full-time

Hi, We have urgent requirements for our direct client, please go through the below Job Description. If you are interested please send me your updated word format resume to and reach me @ . Role: Lead Data Engineer Location: Fremont, CA (3 days onsite, 2 days work from home) Duration: Full Time Experience range: 12-15 years Job Description: Candidate should Provide technical expertise in needs identification, data modelling, data movement, translating business needs into technical solutions wit
Easy Apply
Posted 8 days ago | Updated 7 hours ago

Google Cloud Platform Data Engineer

Intellect Quest LLC

•

Remote

Contract, Third Party

Role : Google Cloud Platform Data EngineerLocation: Remote Description: We are seeking a highly motivated and talented Data Engineer to join our dynamic team. As a Data Engineer, you will play a critical role in designing, developing, and implementing data pipelines and data integration solutions using Spark, Scala, Python, and Google Cloud Platform (Google Cloud Platform). You will be responsible for building scalable and efficient data processing systems, optimizing data workflows, and ensur
Easy Apply
Posted 21 days ago

Data Engineer - Scala

Exl Service

•

Remote

Full-time

We will only be able to move forward with candidates who have ship or hold active s for this role What you'll Do: Create and maintain optimal data pipeline architectureBuild data pipelines that transform raw, unstructured data into formats that data analyst can use to for analysisAssemble large, complex data sets that meet functional / non-functional business requirements Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-des
Easy Apply
Posted 26 days ago | Updated 26 days ago

Druid Engineer

Biztec Global LLC

•

Remote

Full-time

Data Engineer, Distributed Systems Druid Engineer Remote or Austin, Texas KEY RESPONSIBILITIES Design and Development:o Design and implement data ingestion pipelines to load data into Apache Druid.o Develop and optimize Druid schemas and data models for efficient querying and performance.o Design and implement data aggregations against event-level data in distributed database (preferably in Druid)o Migration from existing data stores to Druid Optimization:o Implement best practices for data in
Easy Apply
Posted 14 days ago

Jr. Data Engineer (Langchain, Spark) - Remote

ConsultNet, LLC

•

Remote or South Jordan, Utah, USA

Full-time

Title: Jr. Data Engineer, Healthcare Location : 100% Remote Target Start Date : ASAP Type: contract or contract to hire Pay Rate: DOE Are you driven by working to improve our healthcare system through advanced technology? We need your expertise and integrity! This role is 100% remote and we are looking for candidates who have healthcare domain expertise. Responsibilities Design, maintain, and execute intermediate-to-advanced Apache Spark jobs (using RDDs, DataFrames, Datasets, and Structur
Easy Apply
Posted 25 days ago | Updated 11 hours ago

Application Developer/Data Engineer - 5814923

Accenture LLP

•

Morristown, New Jersey, USA

Full-time

Accenture Flex offers you the flexibility of local fixed-duration project-based work powered by Accenture, a leading global professional services company. Accenture is consistently recognized on FORTUNE's 100 Best Companies to Work For and Diversity Inc's Top 50 Companies For Diversity lists. As an Accenture Flex employee, you will apply your skills and experience to help drive business transformation for leading organizations and communities. In addition to delivering innovative solutions for
Posted 10 days ago | Updated moments ago

Application Developer/Data Engineer - 5814924

Accenture LLP

•

Morristown, New Jersey, USA

Full-time

Accenture Flex offers you the flexibility of local fixed-duration project-based work powered by Accenture, a leading global professional services company. Accenture is consistently recognized on FORTUNE's 100 Best Companies to Work For and Diversity Inc's Top 50 Companies For Diversity lists. As an Accenture Flex employee, you will apply your skills and experience to help drive business transformation for leading organizations and communities. In addition to delivering innovative solutions for
Posted 10 days ago | Updated moments ago

Lead Engineer, Big Data

Molina Healthcare

•

Remote or Long Beach, California, USA

Full-time

Job Description JOB SUMMARY Responsible for all the aspects of architecture, design and implementation of Data Management solution using Big Data platform on Cloudera or Hortonworks and other areas of enterprise application platforms. KNOWLEDGE, SKILLS & ABILITIES (Generally, the occupational knowledge and specific technical and professional skills and abilities required to perform the essential duties of this job): Provide leadership on choosing ideal Architecture, evaluating tools and Fram
Posted 26 days ago | Updated moments ago

Google Cloud Platform Data Engineer

Acadia Technologies, Inc.

•

Philadelphia, Pennsylvania, USA

Full-time

Google Cloud Platform Cloud Platform Expertise:Core Services:A deep understanding of Google Cloud services like BigQuery, Cloud Storage, Cloud Dataflow, Cloud Pub/Sub, Cloud Composer (Airflow), and Cloud Dataproc is crucial. Data Warehousing:Proficiency in building and optimizing data warehouses using BigQuery for analytics and data storage. ETL Processes:Experience with Extract, Transform, Load (ETL) processes to move data between different sources, using tools like Cloud Dataflow, Apache Bea
Easy Apply
Posted 5 days ago

Machine Learning Engineer

Will-N-Able

•

Remote

Contract

Our client is seeking a Machine Learning Engineer. Due to the nature of the work, client is unable to hire H1-B candidates at this time. Work will be done remotely. Machine Learning Engineer As a ML Engineer for this key client engagement: We are seeking a talented and experienced Machine Learning Engineer to join our dynamic, multi-functional team. In this role, you will be instrumental in building and scaling AI-enabled intelligent products that deliver insights across diverse and highly regu
Easy Apply
Posted 19 days ago

Big Data Hadoop Engineer

Mumba Technologies

•

Remote

Contract

Big Data Hadoop Engineer - MT 1780 Remote Primary Skills: Scala, Java, Spark, Hive, Spark SQL, impala, Flask, Strong experience in Big Data, Cloudera Distribution 7.x,RDBMS development 4-5 years of programming experience in Python, and SQL is must. Strong experience building data pipelines using Hadoop components Sqoop, SOLR, MR, HBase. Strong experience with REST API development using Python frameworks (Django, Fast API etc.) and Java Springboot frameworks Project experience in AI/Machine Learn
Easy Apply
Posted 13 hours ago

Lead Bigdata Engineer

AGUH INC

•

Irving, Texas, USA

Contract

Job Title: Lead Big Data Engineer Location: Irving, TX (Hybrid) Duration: Long Term Client: Verizon Video Interview Need Only Local and Senior Candidates in this role EX Verizon Plus 8+ years of Software development and testing experience. 4+ years of Working experience on tools like Spark, HBase, Hive, Sqoop, Impala, Kafka, Flume, Oozie, MapReduce etc. 4+ years of programming experience in Scala, Java or Python Experience in technical leading and mentoring the teams Experience with developing a
Easy Apply
Posted 4 hours ago

Big Data Engineer

Software Guidance & Assistance

•

Rockville, Maryland, USA

Contract

Software Guidance & Assistance, Inc., (SGA), is searching for a Big Data Engineer for a Contract assignment with one of our premier Regulatory clients in Rockville, MD. This role is hybrid (2 days/week Onsite) Responsibilities : Design, develop, and maintain large-scale data processing pipelines using Big Data technologies (e.g., Hadoop, Spark, Python, Scala). Implement data ingestion, storage, transformation, and analysis of solutions that are scalable, efficient, and reliable. Stay cu
Posted 60+ days ago | Updated 10 hours ago

AIML - Sr Software Data Infrastructure Engineer - Data and ML Innovation

Apple, Inc.

•

No location provided

Full-time

Do you get excited by driving impact via measurement and evaluation, for products and services used by hundreds of millions of people globally? The vision of AIML Data and ML Innovation organization is to improve products by using data as the voice of our customers. We are seeking a passionate and experienced Data Infrastructure Engineer to play a pivotal role in revolutionizing how we process and use substantial datasets as the heart of Siri, Search and Machine Learning. You will be instrumenta
Posted 31 days ago | Updated moments ago

Big Data Engineer - W2

Pyramid Technology Solutions, Inc.

•

San Francisco, California, USA

Contract

Title: Senior Big Data Engineer Location: San Francisco, CA - Hybrid Duration: 12 Months Contract Type: Only W2 Mandatory Skills: Either Java or Scala, SQL and NoSQL, Apache Spark, Cloud Platforms Data Engineer Responsibilities: System development and maintenance activities of the team to meet service level agreements and create solutions with innovation, cost effectiveness, high quality and faster time to market.Support code versioning, and code deployments for Data Pipelines.Ensure test covera
Easy Apply
Posted 60+ days ago | Updated 8 days ago

Data Engineer

MARKS IT SOLUTIONS LLC

•

Sunnyvale, California, USA

Contract

Data EngineerLocation: Sunnyvale CAClient: WalmartW2 role Responsibilities: As a Senior Data Engineer, you will Design and develop big data applications using the latest open source technologies. Desired working in offshore model and Managed outcome Develop logical and physical data models for big data platforms. Automate workflows using Apache Airflow. Create data pipelines using Apache Hive, Apache Spark, Apache Kafka. Provide ongoing maintenance and enhancements to existing systems and parti
Easy Apply
Posted 19 days ago

Engineer 3, Data Engineering - 9190

Comcast Corp

•

Philadelphia, Pennsylvania, USA

Full-time

Make your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and solutions that our customers love. We create space to innovate, and we recognize, reward, and invest in your ideas, while ensuring you can prou
Posted 3 days ago | Updated moments ago

Global Platform Big Data Architect

Equifax

•

Alpharetta, Georgia, USA

Full-time

Equifax is where you can power your possible. If you want to achieve your true potential, chart new paths, develop new skills, collaborate with bright minds, and make a meaningful impact, we want to hear from you. We are seeking a highly experienced and visionary Global Platform Big Data Architect to spearhead the design, development, and evolution of our next-generation Data Fabric platform. This pivotal role will be responsible for defining the architectural roadmap, establishing best practic
Posted 18 days ago | Updated moments ago

Machine Learning Engineer

INNOVIT USA INC

•

Atlanta, New York, USA

Full-time, Part-time, Third Party, Contract

Hiring: W2 Candidates Only Location: USA Visa: Open to any visa type with valid work authorization in the USA Level: Mid to Lead positions What you will do: Develop and implement machine learning models and algorithms to optimize AI operations and enhance system performance. Collaborate with cross-functional teams to identify business needs and translate them into data-driven solutions. Analyze large datasets to extract actionable insights and support strategic decision-making. Design and condu
Easy Apply
Posted 7 hours ago | Updated moments ago