apache spark Jobs in austin, tx

Refine Results
241 - 260 of 299 Jobs

Sr. Application Developer (Data Mastering) - Remote

Lincoln Financial Group

•

Remote or Radnor, Pennsylvania, USA

Full-time

Alternate Locations: Charlotte, NC (North Carolina); Fort Wayne, IN (Indiana); Greensboro, NC (North Carolina); Radnor, PA (Pennsylvania) Work Arrangement: Hybrid Preferred : Preferred employee will work 3 days a week in a Lincoln office Relocation assistance: is not available for this opportunity. Requisition #: 73942 The Role at a Glance The person in this role will be responsible for designing, developing, and implementing Master Data Management solutions. It involves working closely wit
Posted 60+ days ago | Updated moments ago

Big Data Engineer - (Remote / Only for W2)

Primus Software Corp

•

US

Contract

Job Title: Big Data Platform Development Engineer Duration: 6 - 7+ months Contract Possibility of extension Locations: Remote - Texas *Only W2 Candidates* Discription: You will evolve the data cloud platform and building pipelines that are scalable, robust and resilient, to validate, ingest, normalize/enrich and support business rule processing of data. You will provide leadership in big data and cloud technologies. 5+ years of experience with Big Data pipelines with Spark in Java, Scala, Pyth
Easy Apply
Posted 60+ days ago | Updated 3 days ago

Data Engineer

Charter Solutions Inc.

•

Remote

Full-time

Data Engineer Information Technology Job Description: Data Engineer Data Engineer Roles and Responsibilities: Collect and process raw data at scale for a variety of projects and initiatives Design and develop data applications using selected tools and frameworks as required and requested for a variety of teams and projects Read, extract, transform, stage and load data to selected tools and frameworks as required and requested Perform tasks such as writing scripts, web scraping, calling API
Posted 60+ days ago | Updated 4 hours ago

Triage Engineer

Stanley David and Associates

•

Remote or West Chester, Pennsylvania, USA

Full-time

Role :: Triage Engineer Location :: West Chester, PA Type :: Fulltime Job Description Job Title: Triage Engineer Must Have Technical/Functional Skills At least 8+ years of experience architecting and implementing complex ETL pipelines preferably with Spark toolset.At least 4+ years of experience with Java particularly within the data spaceTechnical expertise regarding data models, database design development, data mining and segmentation techniquesGood experience writing complex SQL and ETL pr
Easy Apply
Posted 10 days ago

Machine Learning AI Engineer

Buxton Consulting

•

Remote

Contract

Position: Machine Learning AI Engineer Duration: 12+ Months Location: Remote Must Haves Strong project experience in Machine Learning, Big Data, NLP, Deep Learning, RDBMS is must. Strong project experience with Amazon Web Services and Cloudera Data Platform is must. 4-5 experience building data pipelines using Python, MLLib, PyTorch, TensorFlow, Numpy/Scipy/Pandas, Spark, Hive, 4-5 years of programming experience in AWS, Linux and Data Science notebooks is must. Strong experience with REST API
Easy Apply
Posted 4 days ago

Big Data Developer

URSI Technologies Inc.

•

Remote

Contract, Third Party

Role : Big Data Developer (10+ exp needed) Location : Austin, Texas Duration: 12 Months Qualifications : Required SkillsShould be able to communicate effectively with business and other stakeholders bull Demonstrate ownership.Hands-on experience designing and implementing data applications in production using Java/ Python/ R and etc on big data platformExperience with related/complementary open source software platforms and languages such as Java, Linux, Apache, Open Street Map, D3.js and etcStr
Easy Apply
Posted 14 days ago | Updated 3 days ago

Full stack Engineer

Prism IT Corp

•

Remote

Full-time

Job Description: About the Role The Relevance Team builds machine learning models to power product experiences and item rankings across various surfaces. The Difference You Will Make Explore, shape, and develop new product experiences alongside engineers and product managers, from ideation to implementation Develop prototypes to iteratively validate ideas that push technical capabilities Integrate AI capabilities into future products Your Expertise 3+ years of frontend software development ex
Easy Apply
Posted 32 days ago | Updated 19 days ago

Azure Data Engineer Consultant

Korn Ferry

•

Remote

Contract

Job Summary: We are seeking a highly skilled Azure Data Engineering Consultant to join our data team and drive the development and optimization of enterprise-grade data solutions. The ideal candidate will have extensive experience in enterprise ETL, strong SQL skills, and a solid background in Azure-based data engineering. Proficiency in either Python or Spark SQL is essential to succeed in this role. Key Responsibilities: Design, develop, and optimize scalable ETL pipelines and data workflows
Easy Apply
Posted 12 days ago | Updated 4 hours ago

Azure Data Architect with MS Fabric - w2 role

Xyant Services, Inc.

•

Remote or Jersey City, New Jersey, USA

Contract

Job Description: We are seeking a highly experienced Data Engineering Lead/Architect with a strong background in SQL, Azure Data Services, and data modeling. The ideal candidate will possess a deep understanding of data warehousing, ETL/ELT processes, and big data technologies, and be capable of driving both the technical execution and team coordination in a fast-paced, dynamic environment.Key Responsibilities:Design, develop, and optimize complex SQL queries, dimensional data models, and schema
Easy Apply
Posted 3 days ago

Data Engineer

Dahl Consulting

•

Remote or Brooklyn Park, Minnesota, USA

Contract

Seeking a new job opportunity? Don t miss this role! Dahl Consulting is currently partnering with a leader in the retail industry. We work one-on-one with great candidates to help connect them with local employment opportunities. This Company is hiring a Data Engineer for a contract position! Interested? Get more details below.Contract Duration: 6-monthsWorksite Location: Brooklyn Park, MN | Hybrid or remoteCompensation: $60.00 - $90.00 per hourWhat you ll do as the Data Engineer: Design, build,
Easy Apply
Posted 5 days ago

Confluent/Kafka Developer

Advanced Technology Group, Inc

•

Remote

Full-time

Job Description: What You ll NeedRequired:Bachelor's degree in Computer Science, Engineering, or a related fieldExperience as a developer/operator of the Kafka technology (NOT interested in candidates who set up clusters for others to use)Must have real-world experience setting up after Kafka real-time data streaming2+ years of experience with Confluent Platform and KafkaProficient in Java or other JVM languages (e.g., Scala, Kotlin)Experience with Kafka Connect, Kafka Streams, and ksqlDBStrong
Easy Apply
Posted 5 days ago

Palantir Engineer

CX Data Labs Pvt Ltd

•

INT, USA

Full-time, Contract

Palantir Engineer South America Fulltime/Contract Key Responsibilities: Design, develop, and maintain data pipelines and ETL workflows within Palantir Foundry and/or Gotham. Collaborate with data scientists, analysts, and stakeholders to understand data needs and deliver scalable solutions. Integrate and transform data from various sources into usable formats using best practices in data engineering. Optimize performance and reliability of data pipelines and workflows. Contribute to data modell
Posted moments ago | Updated moments ago

Senior Data Engineer with 15 years of experience-Santa Clara, CA, USA

Apton Inc

•

Remote or Santa Clara, California, USA

Full-time, Third Party

Role : Senior Data Engineer Duration: 12+monthsLocation: Santa Clara, CA-Hybrid RoleRemoteNeed minimum 15 years candidate with strong Data Migration ExperienceLinkedIn need to be before 2016 Job Description 8-12+ years of proven experience in Data Engineering, worked on designing and developing software with Big Data, Data Lake/ Lake House ecosystem, Data Analytics, backend microservices architecture, and heterogeneous data types at scale Proven in-depth experience in creating ELT/integrations p
Easy Apply
Posted 7 days ago | Updated 5 days ago

Google Cloud Platform Architect

Estuate Inc.

•

Remote

Contract, Third Party

Hi, We have a very urgent requirement for Google Cloud Platform Architect. Please let me know if you or someone you know is interested. Please see the job details below. Position: Google Cloud Platform Architect Location: Remote Deep experienced data engineer/architect. Review installation on Google Cloud Platform (Google Cloud Platform) Assess and give recommendations on best practices. Kubernetes, Spark, etc., are used by . 4-5 weeks assessment and analysis/recommendations are the expected
Easy Apply
Posted 59 days ago | Updated 4 hours ago

Palantir Foundry Developer / Data Engineer

GreyMatter Solutions

•

Remote

Contract

Hello All, Hope you are doing well Looking for Palantir Foundry Developer / Data Engineer Location: [Insert Location or Remote] Experience: 3+ years (min. 1 year in Palantir Foundry) Type: [Full-time / Contract / Remote] Summary: Looking for a professional with hands-on experience in Palantir Foundry, used for data integration and analysis. The role involves building scalable data pipelines, transforming data from multiple sources, and delivering actionable insights. Must-Have Skills: Strong exp
Easy Apply
Posted 21 days ago | Updated 9 hours ago

Machine Learning Engineer (Infrastructure)

Photon

•

Remote

Full-time

Who are we? Photon has emerged as one of the world s largest and fastest-growing Digital Agencies. We work with 40% of the Fortune 100 on their Digital initiatives and are known for our ability to integrate Strategy Consulting, Creative Design, and Technology at scale. For a brief 1 minute video about us, you can check Machine Learning Engineer (Infrastructure) Mountain View, CA Description: Experience in Machine Learning engineer or Infrastructure roles, with a focus on Machine Learning infras
Easy Apply
Posted 21 days ago | Updated 11 days ago

Backend Software Engineer, ML

Bayside Solutions

•

Remote

Contract

Backend Software Engineer, ML W2 Contract Salary Range: $135,200 - $156,000 per year Location: Remote Role - PST Job Summary: As a Backend Software Engineer, you will work with the engineering team, EPM, and customers to support customer migration to next-generation services that generate, manage, and consume datasets, features, and embeddings used for ML training. You will utilize tooling to migrate data and work with customers to change their Python clients to start using the new SDK. Thi
Easy Apply
Posted 26 days ago | Updated 4 hours ago

Solution Architect with strong Kafka exp

Techno-Comp, Inc.

•

Remote

Contract

Job Title: Solution Architect with strong Kafka exp Location: Remote Duration: Long Term Contract Required Skills: Manage Platform with Senior Kafka, Airflow, DatabricksExperience with Big Data technologies (Spark, Redshift/ BigQuery/ Synapse/ Databricks, Kubernetes, PowerBI)Familiar with programming languages Python/Kotlin/Go/C/JavaAPI Building from scratchAPI Gateway buildingNetwork Components Required OSS, BSS, Telecom IQ, Network IQ, Detection Analysis, Predictive Analysis, Real Time Streami
Easy Apply
Posted 31 days ago | Updated 10 hours ago

Data & BI Analytics Lead - P&C Insurance

Acunor Infotech

•

New Jersey, USA

Full-time

Ideal Profile: Education: Bachelor's or Master's degree in Data Science, Statistics, Mathematics, Economics, Computer Science, or a related field. An advanced degree is preferred. Experience: 10 - 15 years of experience in data analytics, with a strong focus on insurance analytics. Expertise in the Property & Casualty (P&C) domain is strongly preferred. Technical Skills: Strong in SQL, Python, Spark, and data pipeline architecture Deep understanding of cloud platforms (AWS, Azure, or Google Cl
Easy Apply
Posted 11 days ago | Updated 12 hours ago

Data Scientist

BEAT LLC

•

Remote

Full-time

Job Description:Security Clearance: Secret Required BEAT is seeking two highly skilled Data Scientists to join our team, preferably with Army and NATO sustainment process knowledge. These positions will require expertise in Army Vantage and MAVEN, as well as advanced skills in various data science tools and methodologies. The ideal candidates will work remotely, the role requires daily engagement with process owners in the G4 and other MSC G4s. Flexible hours is crucial for effective communicati
Easy Apply
Posted 34 days ago | Updated 13 days ago