kafka developer with pyspark Jobs in los angeles, ca

Refine Results
1 - 20 of 87 Jobs

Apache Kafka Developer with AWS MSK (Amazon Managed Streaming)

Uniqsoft

Remote

Contract

Job Title: Apache Kafka Developer with AWS MSK (Amazon Managed Streaming) Location: FULLY Remote Position type: Long term Contract Rate: DOE Job Description:- We need two senior (10+ Years) Apache Kafka developers with experience in AWS MSK (Amazon Managed Streaming for Apache Kafka) as well as Well-versed on MSK Connect and Kafka Connect for integration with RDBMS, using JDBC connectors and Hands-on experience in Terraform. They must also have experience with AWS services (EC2, ELB, RDS, Rout

Java Kafka Streaming Developer

Reveille Technologies

Remote

Contract, Third Party

We are looking at candidates as per below order of priority Strong Kafka/Apache Flink streaming experience with Captial markets domain experience (Risk/Options/Clearing)Strong Kafka/Apache Flink Streaming experience with BFSI domainStrong Kafka/Apache Flink Streaming Experience with any domain.Experience level: 12-17 Years experience. Buy Rate: $80/hr depending upon experience. Location: Remote. We will not consider any MST & PST candidates for these roles. No of positions: 10+ Key Skills & Res

Lead Go ETL Talend or Informatica Developer - SQL / CICD / Kafka 100% Remote

Zeektek

Remote

Contract

We have a 6-month contract to hire position open for a Lead Go / ETL (Talend or Informatica) Developer. 100% remote Must have a background in: 1. Lead experience 2. Go Development 3. ETL (Talend or Informatica) 4. SQL - near term is doing SQL but moving more to Go. Must know SQL Data Models. 5. Gitlab - or another CI/CD tool like Jenkins 6. Kafka - preferred but in not will need to learn this. day to day responsibilities As a Lead Application Development Engineer, this position is responsible

Kafka Messaging Architect/Developer

Mindlance

Remote

Contract

Role Summary: The Sr. Kafka Messaging Architect/Developer will drive the design, implementation, and adoptions of the client real-time stream data platform that will be a key enabler for our cloud-based business-application architecture. Client has enjoyed significant growth over the past several years, and with that, the Integrations platform is evolving from a departmental batch-oriented ETL solution to a global enterprise platform to adapt to the global expansion of the business. This role wi

2 - Java SpringBoot Developer - DevOps / Kubernetes / EDA / Kafka / CI/CD 100% Remote

Zeektek

Remote

Contract

We have a 6+ month contract to hire position open for a Sr Developer with a strong background in Java, Springboot, JavaScript, Kubernetes, Kafka, Event Driven Architecture. The position is 100% remote and the candidate can sit anywhere in the US. Mandatory skills: Java, Spring Boot, JavaScript (Vue), Event Driven Architecture, Event Streaming (Kafka preferred), NoSQL DB (Mongo Preferred), DevOps, CI/CD, Kubernetes Day to day responsibilities Code development (specific programming language exper

Confluent Kafka Senior Developer/Architect

Diverse Lynx Llc

Remote

Contract

Role: Confluent Kafka Senior Developer/Architect Location:- Remote Job Description:- Strong fundamentals in distributed systems design and operations, microservice architecture, integration patternsDeep understanding of different messaging paradigms (pub/sub, queuing), as well as delivery models, quality-of-service, and fault-tolerance architecturesEstablished track record with Kafka technology, with hands-on production experience and a deep understanding of the Kafka architecture and internals

Machine Learning Engineer

Diamond Pick

Remote

Contract

Software Engineer - ML Remote Contract to Hire Our group is responsible for developing core solutions in data mining, machine learning, anomaly detection and natural language processing, positively impacting multiple existing Extreme flagship products and new offerings from the company. We are spearheading a fundamental shift in how businesses think about managing their wired and wireless networks by building high-performance, real-time multi-agent systems that can perceive, learn, and act in

AWS Data Engineer - 14+ years consultants ONLY

Virtue Group

Remote

Contract

AWS Data Engineer *NOTE: Candidate must be strong on AWS coupled with 14 years of experience overall experience. *NOTE: Candidate must be strong on AWS coupled with 14 years of experience overall experience. Looking for data engineer who has below exp.>Minimum 14+ years candidate.AWS GluePyspark expertAwsStreaming exp is MUSTAmazon Kinesis Data Streams, Apache Kafka, and Amazon Managed Streaming for Apache Kafka (Amazon MSK).

IT Engineer (Data Engineer)

HawkB Inc

Remote

Full-time

Job Description: Job Title: IT Engineer (Data Engineer). Job Responsibilities Design and implement highly performant data ingestion & transformation pipelines from multiple sources using Azure Databricks and PySpark SPARK Performance\tuning\optimization Identify and optimize long running Databricks SPARK jobs. Monitor resource utilization and costs associated with Databricks usage, identifying opportunities for optimization and cost reduction. Analyze cluster performance metrics and implement tu

Sr AWS Cloud Engineer

Rythmos

Remote or Dallas, Texas, USA

Contract, Third Party

Below is the JD for Sr Cloud Engineer role. Responsibilities: Collaborate as part of a development team to design and enhance large scale applications developed using Python, Spark. Evaluates and plans software designs, test results and technical manuals using AWS Confer with business units and development staff to understand both the business and technical requirements for producing technical solutions. Create and review technical and user-focused documentation for data solutions (data models,

AWS Cloud Engineer

Lorien

Remote

Contract

Position - AWS Cloud Engineer Temp to perm No VISA candidates Remote (plus if candidates work from NC/ NJ/ PA/DC/VA/DE) Interview via Teams with video 8-5 EST Top 3 skills and software: * Proven hands-on experience with AWS cloud services, including EC2, S3, Aurora PostgreSQL, Redshift, IAM, Lambda, Athena, DMS etc. * AWS Glue/ Python/ Database development experience * Moderate to senior database knowledge (PostgreSQL, Redshift) We are seeking a highly skilled and motivated AWS Cloud E

Azure Data Engineer

Golden Resources. Inc.

Remote

Contract

Position Summary Accountable for developing and delivering technological responses to targeted business outcomes. Analyze, design and develop enterprise data and information architecture deliverables, focusing on data as an asset for the enterprise. Understand and follow reusable standards, design patterns, guidelines, and configurations to deliver valuable data and information across the enterprise, including direct collaboration , where needed. Demonstrate the company's core values of respect,

Data Engineer

Raas Infotek LLC

Remote or Texas City, Texas, USA

Contract

Data Engineer Contract W2 only Responsibilities 9+ years of Data Engineering experience.Advanced experience working with both relational databases (e.g. Teradata, Vertica, etc.) and Big Data platforms (e.g. Hadoop, etc) requiredAdvanced hands-on experience with Python, Spark (PySpark, Scala) programming languagesStrong Hands-on Apache Spark Data frame and Datasets Map Reduce, Hive Query Language, HDFS, Hive.Experience with message queue technologies such as Kafka or RabbitMQDemonstrated experie

Palantir Developer

TriCom Technical Services

Remote or Dallas, Texas, USA

Contract

Palantir Developer Summary Our client is seeking a Palantir Developer to assist in the company s data-driven decision-making initiative. This individual must be comfortable with both front and back-end development. They will be tasked with developing and designing front-end Web user interfaces based on Palantir Foundry, along with many other technical tasks. Requirements Bachelor's degree in Computer Science, MIS, Engineering, or related field.Extensive development experience and background.E

Senior Java Developer w/ Trading(Capital Market) Experience @ Remote

Reveille Technologies

Remote

Contract, Third Party

Role: Senior Java Developer(Capital Market) Location: 100% Remote Duration: Contract Should have Architectural level of experience, knowledge; but need to work independently as Hands On Senior Developer as this candidate would be directly interacting with the customer; Communication plays a big piece! They should be able to explain well on their Project Scope. Below are the client expectations for this position. Type-1:- Candidate having strong experience working with Capital Markets Domai

Azure Data Engineer

CC Pace Systems, Inc.

Remote

Contract

Open to Hybrid or Remote Responsibilities Design and implement highly performant data ingestion & transformation pipelines from multiple sources using Azure Databricks and PySpark SPARK Performance\tuning\optimization Identify and optimize long running Databricks SPARK jobs. Monitor resource utilization and costs associated with Databricks usage, identifying optimization and cost reduction opportunities. Analyze cluster performance metrics and implement tuning strategies to ensure optimal query

Google Cloud Platform Architect

Highbrow Technology Inc

Remote

Full-time

Please Note: This is a Fulltime position available to those authorized to work in the US. s and s are encouraged to apply Position: Google Cloud Platform Architect Location: Remote Role: Fulltime - (150K to 180K) Job Description: The ideal candidate will be a qualified architect who is able to construct clear diagrams using AutoCAD. This candidate should have an in-depth knowledge of all steps related to project completion and diligently communicate with necessary people to ensure timely execut

Data Engineer | Database Developer | Very Strong with SQL and Python "ONLY W2"

NearObjects

Remote or Ewing Township, New Jersey, USA

Contract

This is a W2 Role so, NO THIRD PARTY CANDIDATES PLEASE.Position: Data Engineer | Database Developer | Very Strong with SQL and PythonJD:Should have 8+ Years of IT Exp with Data Engineering and DWH, ETL Data Bases.5+ years' experience working with data bases like - Oracle/ SQL, and Very Strong with SQL Queries.Should have exp with Python. Should know some Data modelling practices.(Good to have) Understanding and Experience with PostgreSQL, PySpark, AWS, AWS Glue, EMR etc.

Python Developer with Spark Expertise

Optimuss Inc

Remote

Third Party, Contract

Position: Python Developer with Spark Expertise Position Overview: We are seeking a talented Python Developer with expertise in Apache Spark to join our growing team. The ideal candidate will have a strong background in Python development and hands-on experience with Spark for processing large-scale datasets. As a key member of our team, you will play a critical role in developing data pipelines, optimizing performance, and implementing robust solutions to meet our clients' evolving needs. Respo

Java Consultant -100% Remote Role

iSoftTek Solutions Inc

Remote

Contract

Work Location: 100% remote Job Type: W2 Strictly Need resources from Financial Services or Banking Domain only Job Description Are you a Java Developer working at a Large Financial Institution and being told by your leadership that you are too hands-on or detail-oriented or think and work like a start-up? We are looking forward to you joining our Platform Engineering Team. Our Platform Engineering Team is working to solve the Multiplicity Problem. We are trusted by some of the most reputable an