apache spark Jobs in texas

Refine Results
321 - 340 of 415 Jobs

Data Engineer with Palantir

InfoVision, Inc.

•

Richardson, Texas, USA

Contract

Skills: 10+ years of IT experience.Strong Experience with programming languages using Python and SQL is must.Strong Experience with Palantir foundry software is must.Strong experience in analyzing large data set and resolve issues.Strong experience in Data Mining and data integrationUsing Ingested Data from Real time streaming KafkaExperience delivering ETL, data warehouse and data analytics capabilities on bigdata architecture such as HadoopExperience with schema design and dimensionKnowledge o
Easy Apply
Posted 60+ days ago | Updated 3 days ago

Big Data Engineer - (Remote / Only for W2)

Primus Software Corp

•

US

Contract

Job Title: Big Data Platform Development Engineer Duration: 6 - 7+ months Contract Possibility of extension Locations: Remote - Texas *Only W2 Candidates* Discription: You will evolve the data cloud platform and building pipelines that are scalable, robust and resilient, to validate, ingest, normalize/enrich and support business rule processing of data. You will provide leadership in big data and cloud technologies. 5+ years of experience with Big Data pipelines with Spark in Java, Scala, Pyth
Easy Apply
Posted 60+ days ago | Updated 3 days ago

Data Engineer

Charter Solutions Inc.

•

Remote

Full-time

Data Engineer Information Technology Job Description: Data Engineer Data Engineer Roles and Responsibilities: Collect and process raw data at scale for a variety of projects and initiatives Design and develop data applications using selected tools and frameworks as required and requested for a variety of teams and projects Read, extract, transform, stage and load data to selected tools and frameworks as required and requested Perform tasks such as writing scripts, web scraping, calling API
Posted 60+ days ago | Updated 11 hours ago

Google Cloud Platform Developer

Avance Consulting

•

Richardson, Texas, USA

Full-time

Google Cloud Platform Developer Richardson, TX Required Qualifications: At least 4 years of experience in Information Technology.Experience working with technologies like Google Cloud Platform with data engineering data flow/airflow, pub-sub/ kafta, data proc/Hadoop, Big Query.ETL development experience with strong SQL background such as Python/R, Scala, Java, Hive, Spark, KafkaPreferred Qualifications: Proven experience working in healthcare / Pharmacy Benefits Management domainAt least 2 expe
Easy Apply
Posted 6 days ago | Updated 3 hours ago

Java Full Stack Developer with MongoDB

Visionary Innovative Technology Solutions

•

Dallas, Texas, USA

Full-time

Role: Java Full Stack Developer with MongoDB Location: Dallas, TX ( Onsite) Job Type: Full Time Skill: Java, MongoDB, Spark Mandatory: 10+ years of experience in Design and Development of applications using Java 8+/J2EE, Spring, Spring-Boot, RESTful Services and UI FrameworkDevelop, program, and maintain applications using the Apache Spark open-source framework.Spark Developer must have strong programming skills in Java, Scala, or Python2+ years of experience in design and development of Micros
Easy Apply
Posted 2 days ago

Triage Engineer

Stanley David and Associates

•

Remote or West Chester, Pennsylvania, USA

Full-time

Role :: Triage Engineer Location :: West Chester, PA Type :: Fulltime Job Description Job Title: Triage Engineer Must Have Technical/Functional Skills At least 8+ years of experience architecting and implementing complex ETL pipelines preferably with Spark toolset.At least 4+ years of experience with Java particularly within the data spaceTechnical expertise regarding data models, database design development, data mining and segmentation techniquesGood experience writing complex SQL and ETL pr
Easy Apply
Posted 10 days ago

AWS Data Engineer

TechniPros, LLC

•

Dallas, Texas, USA

Contract

Role : Azure engineer(w2 position, day 1 on-site) 3150-1 Location: Rockville MD/ Trevose Rate : 48/hr on W2 Job Description : Azure Data Lake Gen1/Gen2, Azure Data factory , Azure Data bricks, Azure DWH, Azure Synapse, Key vault, Azure Active directory. Data brick services (like processing streaming data using Spark clusters), usage of Blob containers, ESB, Event Grid, Azure SQL server, Cosmos DB, Azure functions, Analytics (like Power BI) is a mandatory requirement. Comments s: Scala, SQ
Easy Apply
Posted 6 days ago | Updated 1 day ago

Google Cloud Platform Data Engineer

Ztek Consulting

•

Richardson, Texas, USA

Contract, Third Party

Hi, I would like to share an excellent opening Contact Google Cloud Platform Data Engineer do go through the details and kindly send me the updated resume. Location : Richardson TX (Hybrid) Type of Hire : Contract Mode of interview : WebEx / Teams Job Description : Google Cloud Platform - Data Proc, Kubernetes Engine, Cloud Storage, BigQuery, PUB/SUB, Cloud Functions and Dataflow. Cloud Composer, ETL experience - working with large data sets, PySpark, Python, Spark SQL, DataFrames, PyTest Tha
Easy Apply
Posted 14 days ago | Updated 10 days ago

Machine Learning AI Engineer

Buxton Consulting

•

Remote

Contract

Position: Machine Learning AI Engineer Duration: 12+ Months Location: Remote Must Haves Strong project experience in Machine Learning, Big Data, NLP, Deep Learning, RDBMS is must. Strong project experience with Amazon Web Services and Cloudera Data Platform is must. 4-5 experience building data pipelines using Python, MLLib, PyTorch, TensorFlow, Numpy/Scipy/Pandas, Spark, Hive, 4-5 years of programming experience in AWS, Linux and Data Science notebooks is must. Strong experience with REST API
Easy Apply
Posted 4 days ago

Big Data Developer

URSI Technologies Inc.

•

Remote

Contract, Third Party

Role : Big Data Developer (10+ exp needed) Location : Austin, Texas Duration: 12 Months Qualifications : Required SkillsShould be able to communicate effectively with business and other stakeholders bull Demonstrate ownership.Hands-on experience designing and implementing data applications in production using Java/ Python/ R and etc on big data platformExperience with related/complementary open source software platforms and languages such as Java, Linux, Apache, Open Street Map, D3.js and etcStr
Easy Apply
Posted 14 days ago | Updated 3 days ago

Full stack Engineer

Prism IT Corp

•

Remote

Full-time

Job Description: About the Role The Relevance Team builds machine learning models to power product experiences and item rankings across various surfaces. The Difference You Will Make Explore, shape, and develop new product experiences alongside engineers and product managers, from ideation to implementation Develop prototypes to iteratively validate ideas that push technical capabilities Integrate AI capabilities into future products Your Expertise 3+ years of frontend software development ex
Easy Apply
Posted 32 days ago | Updated 19 days ago

Azure Data Engineer Consultant

Korn Ferry

•

Remote

Contract

Job Summary: We are seeking a highly skilled Azure Data Engineering Consultant to join our data team and drive the development and optimization of enterprise-grade data solutions. The ideal candidate will have extensive experience in enterprise ETL, strong SQL skills, and a solid background in Azure-based data engineering. Proficiency in either Python or Spark SQL is essential to succeed in this role. Key Responsibilities: Design, develop, and optimize scalable ETL pipelines and data workflows
Easy Apply
Posted 12 days ago | Updated 7 hours ago

DevOps Engineer

Cynet Systems

•

Frisco, Texas, USA

Contract

Job Description: Architect, deploy, and manage scalable AWS infrastructure using best practices (CloudFormation, Terraform preferred). Integrate cloud-native services (ECS, Lambda, RDS, S3, IAM, CloudWatch, etc.). Hands-on experience with AWS Glue (ETL jobs, crawlers, Glue Studio, Glue APIs). Deep understanding of Apache Spark architecture and development (Py Spark Scala preferred). Experience working with large-scale data ingestion and processing in distributed environments. Experience with AW
Easy Apply
Posted 3 days ago | Updated moments ago

Data Engineer

InterSec Inc.

•

Houston, Texas, USA

Contract

Data Engineer Houston, TX/Spring TX- Onsite Skills Required: Python, Databricks (SQL/Data Engineering), Apache Spark Responsibilities: Design, develop, and maintain scalable data pipelines using Python, Databricks, and Apache Spark.Collaborate with data scientists and analysts to understand data requirements and deliver efficient solutions.Implement and optimize ETL processes to ensure data quality and integrity.Develop and maintain SQL queries and scripts for data extraction, transformation, an
Easy Apply
Posted 3 days ago | Updated 2 hours ago

Confluent/Kafka Developer

Advanced Technology Group, Inc

•

Remote

Full-time

Job Description: What You ll NeedRequired:Bachelor's degree in Computer Science, Engineering, or a related fieldExperience as a developer/operator of the Kafka technology (NOT interested in candidates who set up clusters for others to use)Must have real-world experience setting up after Kafka real-time data streaming2+ years of experience with Confluent Platform and KafkaProficient in Java or other JVM languages (e.g., Scala, Kotlin)Experience with Kafka Connect, Kafka Streams, and ksqlDBStrong
Easy Apply
Posted 5 days ago

Azure Data Architect with MS Fabric - w2 role

Xyant Services, Inc.

•

Remote or Jersey City, New Jersey, USA

Contract

Job Description: We are seeking a highly experienced Data Engineering Lead/Architect with a strong background in SQL, Azure Data Services, and data modeling. The ideal candidate will possess a deep understanding of data warehousing, ETL/ELT processes, and big data technologies, and be capable of driving both the technical execution and team coordination in a fast-paced, dynamic environment.Key Responsibilities:Design, develop, and optimize complex SQL queries, dimensional data models, and schema
Easy Apply
Posted 3 days ago

Google Cloud Platform Data Engineer

Nityo Infotech Corporation

•

Richardson, Texas, USA

Full-time

Job Role: Google Cloud Platform Data Engineer Job Location: Richardson, TX Job Type: Full Time Job description: Client is seeking a Google Cloud Platform Data Engineer with experience working in a Big Data ecosystem. The position will primarily be responsible interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation and Design. You will play an important role in creating the high-level d
Easy Apply
Posted 6 days ago

Data Engineer

Dahl Consulting

•

Remote or Brooklyn Park, Minnesota, USA

Contract

Seeking a new job opportunity? Don t miss this role! Dahl Consulting is currently partnering with a leader in the retail industry. We work one-on-one with great candidates to help connect them with local employment opportunities. This Company is hiring a Data Engineer for a contract position! Interested? Get more details below.Contract Duration: 6-monthsWorksite Location: Brooklyn Park, MN | Hybrid or remoteCompensation: $60.00 - $90.00 per hourWhat you ll do as the Data Engineer: Design, build,
Easy Apply
Posted 5 days ago

Google Cloud Platform Architect

Estuate Inc.

•

Remote

Third Party, Contract

Hi, We have a very urgent requirement for Google Cloud Platform Architect. Please let me know if you or someone you know is interested. Please see the job details below. Position: Google Cloud Platform Architect Location: Remote Deep experienced data engineer/architect. Review installation on Google Cloud Platform (Google Cloud Platform) Assess and give recommendations on best practices. Kubernetes, Spark, etc., are used by . 4-5 weeks assessment and analysis/recommendations are the expected
Easy Apply
Posted 59 days ago | Updated 5 hours ago

Senior Data Engineer with 15 years of experience-Santa Clara, CA, USA

Apton Inc

•

Remote or Santa Clara, California, USA

Full-time, Third Party

Role : Senior Data Engineer Duration: 12+monthsLocation: Santa Clara, CA-Hybrid RoleRemoteNeed minimum 15 years candidate with strong Data Migration ExperienceLinkedIn need to be before 2016 Job Description 8-12+ years of proven experience in Data Engineering, worked on designing and developing software with Big Data, Data Lake/ Lake House ecosystem, Data Analytics, backend microservices architecture, and heterogeneous data types at scale Proven in-depth experience in creating ELT/integrations p
Easy Apply
Posted 7 days ago | Updated 4 days ago