Apache Spark Jobs in Austin, TX

Refine Results
261 - 280 of 331 Jobs

Data Architect

Fynbosys Inc

•

Austin, Texas, USA

Full-time

Any visa is fine Exp: 17+years Must have experience in financial background Aws certification must Key Responsibilities: Architect and design data-driven solutions for large-scale applications within the Wealth Management and Billing ecosystem.Lead the development of robust data pipelines using technologies such as AWS Glue, Athena, and Snowflake.Apply caching strategies and data modeling best practices to optimize system performance and throughput.Translate complex business requirements into ef
Easy Apply
Posted 9 days ago

Data Architect

MethodHub

•

Austin, Texas, USA

Contract, Third Party

Data Architect Location: Austin, TX [Hybrid] Duration: 12 months Key Responsibilities: Architect and design data-driven solutions for large-scale applications within the Wealth Management and Billing ecosystem. Lead the development of robust data pipelines using technologies such as AWS Glue, Athena, and Snowflake. Apply caching strategies and data modeling best practices to optimize system performance and throughput. Translate complex business requirements into effective, scalable enterprise d
Easy Apply
Posted 28 days ago | Updated 16 days ago

Software Engineer

NMK Global Inc.

•

Austin, Texas, USA

Contract

JD Level II- Key Responsibilities: Develop and maintain a robust and scalable big data insights platform to drive AI-assisted process automation and deliver actionable insights.Develop solutions that combine state-of-the-art Generative AI techniques with rich data to deliver best-in-class automation and user experience.Design and implement batch and near real-time data pipelines using Spark, Flink, and BigQuery.Design and implement efficient data models in relational and NoSQL databases like MyS
Easy Apply
Posted 10 days ago | Updated 4 days ago

AI Data & Python Tools Engineer for global consumer device company in Austin,TX

OSI Engineering, Inc.

•

Austin, Texas, USA

Contract

AI Data & Python Tools Engineer We're seeking an AI Data and Python Tools Engineer to develop and deploy intelligent tools that leverage big data infrastructure and modern AI architecture. This role combines strong software engineering fundamentals with the ability to build production-ready AI applications at speed, including integration with Model Context Protocol (MCP) systems. Responsibilities: Develop and deploy AI-powered full-stack applications using Python, React, and modern machine lea
Easy Apply
Posted 44 days ago | Updated 12 hours ago

Data Integration Engineer

Sripen

•

Remote

Contract

Job Description: 6+ years of Experience in Data Integrations, ETL, DWH.Hands-on 3 Yrs. experience on FiveTran/HVR.Hands-on 3 Yrs. experience on Talend.Knowledge on AWS and Data pipelines.Knowledge on AWS Redshift & S3.Knowledge on Python and Spark would help.Thanks
Easy Apply
Posted 3 days ago | Updated 1 day ago

Talend HVR Consultant (AWS is must) Remote W2

ICS Global Soft, Inc.

•

Remote

Contract

Tittle : Talend HVR Consultant (AWS is must) Location: Across USA any Location Experience : 6+ Years Backfill position Job Details 6+ years of Experience in Data Integrations, ETL, DWH.Hands on 3 Yrs experience on FiveTran/HVR.Hands on 3Yrs experience on Talend.Knowledge on AWS and Data pipelines .Knowledge on AWS Redshift & S3.Knowledge on python and spark would help.
Easy Apply
Posted 2 days ago

Data Bricks Engineer-W2 only

Gemini Consulting Services

•

Remote

Contract

Hello , Hope you are doing well. Please find the below job opportunities with our client. Role: Data Bricks Engineer-W2 only# of Openings: 5 Location: 100% remote Duration: 3-6 months; possible extensions Interview: 2 rounds: Offer Key Skills: Databricks, Python, Apache Spark, Scala, Airflow Experience with Medallion and Lakehouse architecture Databrick Certified is preferred. Job Description: - Need for Databricks engineers to handle data migration tasks. - Integration of Azure OpenAI Service
Easy Apply
Posted 16 days ago | Updated 15 hours ago

Big Data Hadoop Engineer

Mumba Technologies

•

Remote

Contract

Big Data Hadoop Engineer - MT 1780 Remote - Only W2 Primary Skills: Scala, Java, Spark, Hive, Spark SQL, impala, Flask, Strong experience in Big Data, Cloudera Distribution 7.x,RDBMS development 4-5 years of programming experience in Python, and SQL is must. Strong experience building data pipelines using Hadoop components Sqoop, SOLR, MR, HBase. Strong experience with REST API development using Python frameworks (Django, Fast API etc.) and Java Springboot frameworks Project experience in AI/Ma
Easy Apply
Posted 2 days ago | Updated 1 day ago

Pyspark

New Era Technology

•

Remote

Contract, Third Party

Hi, Looking for PySpark Consultant, If you are interested in applying kindly share me your updated resume to Location: Remote Duration: 6+months Note : Palantir Foundry platform is must At least 7 years of experience working with large scale software systems. Proficient in PySpark, Python, SQL with atleast 5 years of experience Working experience in Palantir Foundry platform is must Experience designing and implementing data analytics solutions on enterprise data platforms and distributed com
Easy Apply
Posted 31 days ago | Updated 31 days ago

Hiring for Data Scientist :: Remote

Feuji Inc

•

Remote

Contract

Hi, This is Rehan from Feuji. I have below requirement with one of our client and if you are comfortable with the Job Description kindly share your updated resume with contact details. Data Scientist II/GenAI Remote C2H Required technical skills: Core Duties: Build models, Measure Impact, Prioritization/Optimization Required technical skills: SQL/Spark/Python/Data Science/ML Tools or platform experience requirements: SQL/Spark, Scala, Langchain Should you be interested, please send me a cop
Easy Apply
Posted 52 days ago | Updated 2 days ago

Databricks Senior Manager

Oscar Technology

•

Remote

Full-time

Senior Manager, Databricks Location Remote Overview Databricks is seeking a seasoned Senior Manager to lead the strategy, implementation, and operation of our Databricks platform across Azure, AWS, and Google Cloud Platform. You'll manage and mentor a high-performing team, oversee cloud-native data platform initiatives, and ensure reliable, scalable analytics and AI capabilities. Key Responsibilities Lead and develop a team of data engineers, platform specialists, or solution architects, setti
Easy Apply
Posted 11 days ago | Updated 2 hours ago

Databricks Architect

Showman Staffing

•

Remote

Contract

Databricks Architect Location: Remote US Job Type: Contract 6+ Months Experience Level:10+ Years About the Role We are seeking an experienced Databricks Architect to lead the design and implementation of scalable data solutions across cloud platforms. This role demands strong technical leadership and hands-on expertise in Databricks, Apache Spark, and cloud data architecture (Azure or AWS). You will work closely with stakeholders to define data strategies, optimize performance, and ensure archit
Easy Apply
Posted 3 days ago

Data Engineer (Matillion ETL)

Sharpedge Solutions

•

Remote

Full-time

Job Details: Data Pipeline Development: Design, construct, test, and maintain highly scalable data management systems. Develop and implement architectures that support the extraction, transformation, and loading (ETL) of data from various sources. Data Integration: Integrate structured and unstructured data from multiple data sources into a unified data system, ensuring data quality and consistency. Data Warehousing: Build and maintain data warehouses and data lakes to store and retrieve vast am
Easy Apply
Posted 1 day ago

Data Architect with AWS, Databricks and Pyspark

E-Solutions, Inc.

•

California, USA

Full-time

Hi Professionals, Role Data Architect (Databricks) Duration: Fulltime Key Responsibilities: Solution Design & Implementation: Architecting and building scalable, secure, and high-performance data solutions on the Databricks platform using technologies like DLT Pipelines, Spark, Delta Lake, AI/BI Genie, etc. Data Pipeline Development: Designing and implementing end-to-end data pipelines, including ETL/ELT processes, for both batch and real-time data processing. Data Governance & Security: Defini
Easy Apply
Posted 15 days ago | Updated 13 hours ago

Lead Azure Data Engineer(15 + Years Exp. Required)

GSPANN Technologies

•

Remote or Fremont, California, USA

Contract

About GSPANN Headquartered in Milpitas, California (U.S.A.), GSPANN provides consulting and IT services to global clients, ranging from mid-size to Fortune 500 companies. With our experience in retail, high-technology, and manufacturing, we help our clients to transform and deliver business value by optimizing their IT capabilities, practices, and operations. Counting on our ten offices, including four global delivery centers, and approximately 1400 employees globally, we offer the intimacy of a
Easy Apply
Posted 25 days ago | Updated 24 days ago

Azure Data Solution Architect

RNR IT Solutions, Inc.

•

Remote or Little Elm, Texas, USA

Full-time

Job Title: Data Warehouse & Azure Data Architect / Principal Data Engineer Location: Remote 15+ years of experience in database architecture, data engineering, and analytics solutionsStrong expertise in Azure Data Platform: Azure Data Factory (ADF), Azure Databricks, Synapse Analytics, Azure Data Lake Storage, Event Hub, Azure Analysis Services, Power BI, Microsoft FabricProficient in Python, Spark SQL, T-SQL, and metadata-driven developmentExperience designing and implementing Data Vault 2.0,
Easy Apply
Posted 30 days ago | Updated 4 days ago

AWS Engineer

Axiom Global Technologies, Inc.

•

Remote

Contract

We're looking for a talented and experienced Senior AWS Engineer to join our team. In this role, you'll be instrumental in designing, developing, and implementing robust and scalable backend solutions, with a strong focus on data processing, API development, and AWS cloud infrastructure. If you're passionate about building high-performance systems and have a solid understanding of modern cloud architectures, we encourage you to apply! Key Responsibilities: Design and develop data-driven solutio
Easy Apply
Posted 9 days ago | Updated 8 days ago

Resident Solution Architect

Cycle 3 IT Staffing

•

Remote

Contract

Cycle3 IT Staffing is seeking several Resident Solutions Architects who are SENIOR LEVEL for a REMOTE role. Architecting and Leadership: o Deep understanding of modern data architecture, including Lakehouse, Medallion architecture, and Data Mesh. Data Engineering: o Strong programming experience in Python; Scala is a significant plus. o Proficiency in complex query tuning. o Experience building Slowly Changing Dimensions (SCD) TYPEs. o Familiarity with DBT. o Experience with structured streaming
Easy Apply
Posted 18 days ago | Updated 1 day ago

Databricks Engineer

Reveille Technologies

•

Remote

Contract, Third Party

Data Analysis and Mapping: Analyzing the source Salesforce instance and target environment to understand data structures, relationships, and migration requirements. Migration Strategy: Developing and documenting the overall data migration strategy, including data extraction, transformation, loading, and validation processes. Data Modeling: Designing and implementing data models in Databricks that align with the target environment and business requirements. Performance Optimization: Optimizing da
Easy Apply
Posted 1 day ago

Machine Learning Artificial Intelligence Engineer with Big Data and Cloudera

Buxton Consulting

•

Remote

Contract

Machine Learning Artificial Intelligence Engineer with Big Data and Cloudera Location Fully Remote Must Haves- Strong project experience in Big Data platform with Amazon Web Services and Cloudera Data Platform is must. Strong experience with REST API development using Python frameworks (Django, Flask etc.) is must. Micro Services/Web service development experience using Spring framework is must. 4-5 years of programming experience in AWS, Linux and Data Science notebooks is must. Good project e
Easy Apply
Posted 38 days ago | Updated 4 days ago