kafka developer with pyspark Jobs in austin, tx

Refine Results
1 - 20 of 99 Jobs

Apache Kafka Developer with AWS MSK (Amazon Managed Streaming)

Uniqsoft

Remote

Contract

Job Title: Apache Kafka Developer with AWS MSK (Amazon Managed Streaming) Location: FULLY Remote Position type: Long term Contract Rate: DOE Job Description:- We need two senior (10+ Years) Apache Kafka developers with experience in AWS MSK (Amazon Managed Streaming for Apache Kafka) as well as Well-versed on MSK Connect and Kafka Connect for integration with RDBMS, using JDBC connectors and Hands-on experience in Terraform. They must also have experience with AWS services (EC2, ELB, RDS, Rout

Java Kafka Streaming Developer

Reveille Technologies

Remote

Third Party, Contract

We are looking at candidates as per below order of priority Strong Kafka/Apache Flink streaming experience with Captial markets domain experience (Risk/Options/Clearing)Strong Kafka/Apache Flink Streaming experience with BFSI domainStrong Kafka/Apache Flink Streaming Experience with any domain.Experience level: 12-17 Years experience. Buy Rate: $80/hr depending upon experience. Location: Remote. We will not consider any MST & PST candidates for these roles. No of positions: 10+ Key Skills & Res

Lead Go ETL Talend or Informatica Developer - SQL / CICD / Kafka 100% Remote

Zeektek

Remote

Contract

We have a 6-month contract to hire position open for a Lead Go / ETL (Talend or Informatica) Developer. 100% remote Must have a background in: 1. Lead experience 2. Go Development 3. ETL (Talend or Informatica) 4. SQL - near term is doing SQL but moving more to Go. Must know SQL Data Models. 5. Gitlab - or another CI/CD tool like Jenkins 6. Kafka - preferred but in not will need to learn this. day to day responsibilities As a Lead Application Development Engineer, this position is responsible

Kafka Messaging Architect/Developer

Mindlance

Remote

Contract

Role Summary: The Sr. Kafka Messaging Architect/Developer will drive the design, implementation, and adoptions of the client real-time stream data platform that will be a key enabler for our cloud-based business-application architecture. Client has enjoyed significant growth over the past several years, and with that, the Integrations platform is evolving from a departmental batch-oriented ETL solution to a global enterprise platform to adapt to the global expansion of the business. This role wi

2 - Java SpringBoot Developer - DevOps / Kubernetes / EDA / Kafka / CI/CD 100% Remote

Zeektek

Remote

Contract

We have a 6+ month contract to hire position open for a Sr Developer with a strong background in Java, Springboot, JavaScript, Kubernetes, Kafka, Event Driven Architecture. The position is 100% remote and the candidate can sit anywhere in the US. Mandatory skills: Java, Spring Boot, JavaScript (Vue), Event Driven Architecture, Event Streaming (Kafka preferred), NoSQL DB (Mongo Preferred), DevOps, CI/CD, Kubernetes Day to day responsibilities Code development (specific programming language exper

Confluent Kafka Senior Developer/Architect

Diverse Lynx Llc

Remote

Contract

Role: Confluent Kafka Senior Developer/Architect Location:- Remote Job Description:- Strong fundamentals in distributed systems design and operations, microservice architecture, integration patternsDeep understanding of different messaging paradigms (pub/sub, queuing), as well as delivery models, quality-of-service, and fault-tolerance architecturesEstablished track record with Kafka technology, with hands-on production experience and a deep understanding of the Kafka architecture and internals

Machine Learning Engineer

Diamond Pick

Remote

Contract

Software Engineer - ML Remote Contract to Hire Our group is responsible for developing core solutions in data mining, machine learning, anomaly detection and natural language processing, positively impacting multiple existing Extreme flagship products and new offerings from the company. We are spearheading a fundamental shift in how businesses think about managing their wired and wireless networks by building high-performance, real-time multi-agent systems that can perceive, learn, and act in

AWS Data Engineer - 14+ years consultants ONLY

Virtue Group

Remote

Contract

AWS Data Engineer *NOTE: Candidate must be strong on AWS coupled with 14 years of experience overall experience. *NOTE: Candidate must be strong on AWS coupled with 14 years of experience overall experience. Looking for data engineer who has below exp.>Minimum 14+ years candidate.AWS GluePyspark expertAwsStreaming exp is MUSTAmazon Kinesis Data Streams, Apache Kafka, and Amazon Managed Streaming for Apache Kafka (Amazon MSK).

IT Engineer (Data Engineer)

HawkB Inc

Remote

Full-time

Job Description: Job Title: IT Engineer (Data Engineer). Job Responsibilities Design and implement highly performant data ingestion & transformation pipelines from multiple sources using Azure Databricks and PySpark SPARK Performance\tuning\optimization Identify and optimize long running Databricks SPARK jobs. Monitor resource utilization and costs associated with Databricks usage, identifying opportunities for optimization and cost reduction. Analyze cluster performance metrics and implement tu

Java Developer with AWS Glue

Srinav Inc.

Austin, Texas, USA

Contract

Job Title: Senior Java/AWS Developer Location: Austin, TX Duration: Longterm NO EAD's Minimum 9+ years of Java experience. Understand Java coding standard methodologies, review code, TDD cases, merge the code. Strong experience on Java, Spring, Spring batch, Spring boot, Fuse, MongoDB, Cloud Deployment. Kafka, MQ experience must have. Strong experience in AWS development and AWS Services like Terraform, Lambda, SNS, S3, Glue, CloudWatch, Login Mechanism, DynamoDB, Document DB, Arora. Service O

senior javabackend developer

Decision Six Inc.

Austin, Texas, USA

Contract

We are urgently looking for candidates with following skills: 8+ Years of very Strong Java, Springboot development (Java Backend Development)Microservice based architecture and development.Deployment: K8S Cluster, Jenkins PipelineKnowledge about Observability Stack like Splunk, Prometheus, KafkaLocation: Austin, TX

Java Developer

Talent Group

Round Rock, Texas, USA

Contract

Title: Java FullStack Location: Round Rock, TX Job Type: Full-time Skills: Java, Microservices, Spring boot, Multithreading, Kafka, React Job Description: We are looking for a skilled Java Backend Developer to join our dynamic development team. As a Java Backend Developer, you will be responsible for designing, developing, and maintaining the server-side logic of our web applications. You will collaborate with cross-functional teams to deliver high-quality software solutions that meet our busine

Senior Java/Python Developer

General Motors

Austin, Texas, USA

Full-time

Description Hybrid: This role is categorized as hybrid. This means the successful candidate is expected to report onsite at the Austin IT Innovation Center North - Austin IT Innovation Center North or the GM Global Technical Center - Cole Engineering Center Tower three times per week minimum or other frequency dictated by the business. This job may be eligible for relocation benefits. Role: Hybrid: This role is categorized as hybrid. This means the successful candidate is expected to report onsi

Sr AWS Cloud Engineer

Rythmos

Remote or Dallas, Texas, USA

Third Party, Contract

Below is the JD for Sr Cloud Engineer role. Responsibilities: Collaborate as part of a development team to design and enhance large scale applications developed using Python, Spark. Evaluates and plans software designs, test results and technical manuals using AWS Confer with business units and development staff to understand both the business and technical requirements for producing technical solutions. Create and review technical and user-focused documentation for data solutions (data models,

Sr. Software Engineer, Tools and Framework - Ad Platforms

Apple, Inc.

Austin, Texas, USA

Full-time

Summary We are seeking a highly skilled and motivated Tools and Developer Framework Engineer to join our team. The ideal candidate will be responsible for designing, developing, implementing, and maintaining the tools and frameworks essential for our software development lifecycle. This role will play a critical part in enhancing the efficiency, productivity, and quality of our development processes. Key Qualifications Demonstrated proficiency in Java, Groovy, Python, or Swift.Atleast 3+ year

Sr. Software Engineer, Tools and Framework (Data) - Ad Platforms

Apple, Inc.

Austin, Texas, USA

Full-time

Summary At Apple, we believe in the power of technology to enrich people's lives. Everything we build is designed to empower people, including our advertising platform. We deliver ads in a way that benefits both customers and advertisers - helping people discover content, supporting creators, and protecting and respecting everyone's privacy.Our technology makes advertising possible on the App Store, Apple News, Stocks, and Apple TV. We help developers and marketers of all sizes drive app discov

AWS Cloud Engineer

Lorien

Remote

Contract

Position - AWS Cloud Engineer Temp to perm No VISA candidates Remote (plus if candidates work from NC/ NJ/ PA/DC/VA/DE) Interview via Teams with video 8-5 EST Top 3 skills and software: * Proven hands-on experience with AWS cloud services, including EC2, S3, Aurora PostgreSQL, Redshift, IAM, Lambda, Athena, DMS etc. * AWS Glue/ Python/ Database development experience * Moderate to senior database knowledge (PostgreSQL, Redshift) We are seeking a highly skilled and motivated AWS Cloud E

Azure Data Engineer

Golden Resources. Inc.

Remote

Contract

Position Summary Accountable for developing and delivering technological responses to targeted business outcomes. Analyze, design and develop enterprise data and information architecture deliverables, focusing on data as an asset for the enterprise. Understand and follow reusable standards, design patterns, guidelines, and configurations to deliver valuable data and information across the enterprise, including direct collaboration , where needed. Demonstrate the company's core values of respect,

Data Engineer

Raas Infotek LLC

Remote or Texas City, Texas, USA

Contract

Data Engineer Contract W2 only Responsibilities 9+ years of Data Engineering experience.Advanced experience working with both relational databases (e.g. Teradata, Vertica, etc.) and Big Data platforms (e.g. Hadoop, etc) requiredAdvanced hands-on experience with Python, Spark (PySpark, Scala) programming languagesStrong Hands-on Apache Spark Data frame and Datasets Map Reduce, Hive Query Language, HDFS, Hive.Experience with message queue technologies such as Kafka or RabbitMQDemonstrated experie

Palantir Developer

TriCom Technical Services

Remote or Dallas, Texas, USA

Contract

Palantir Developer Summary Our client is seeking a Palantir Developer to assist in the company s data-driven decision-making initiative. This individual must be comfortable with both front and back-end development. They will be tasked with developing and designing front-end Web user interfaces based on Palantir Foundry, along with many other technical tasks. Requirements Bachelor's degree in Computer Science, MIS, Engineering, or related field.Extensive development experience and background.E