kafka/spark admin Jobs in new york, ny

Refine Results
1 - 20 of 124 Jobs

Kafka Admin

Dizer Corp

New York, New York, USA

Contract, Third Party

Title : Kafka Admin Location : NYC, NY Description Develop shell scripts to automate routine tasks and system administration activities.Expertise on Linux OS and the commandsMaintain and enhance existing shell scripts to improve efficiency and reliability.Deploy and configure Kafka clusters in production and non-production environments.Monitor Kafka clusters and perform routine maintenance tasks to ensure optimal performance and reliability.Troubleshoot and resolve Kafka & shell script related i

Kafka Admin

Orasi Software

New York, New York, USA

Full-time

Kafka administration

Kafka Admin

TechIntelli Solutions Inc

New York, New York, USA

Contract

Position: Kafka Admin Location: New York City, NY (Onsite/Hybrid) Duration: Long Term Contact Job Description: Setup new Confluent Kafka platform.Upgrade and maintain existing platform to approved version in the organization.Implement security best practices for Kafka cluster.Maintain & tune Kafka cluster for scalability and performance.Understanding of Kafka Brokers.Understanding of Kafka client (Producer and consumer) concepts.Collaborate among development teams, product Managers, operations

Kafka Admin

PETADATA

New York, New York, USA

Third Party

Position: Kafka Admin Location: Alpharetta, GA (OR) New York City, NY (Hybrid: 3 days a week) Experience: 10+ Years Work type: C2C PETADATA is currently looking to hire for the position of KAFKA ADMIN for one of their clients. Roles & Responsibilities: Handle all Kafka environment builds, including design, capacity planning, cluster setup, performance tuning, and ongoing monitoring. Perform high-level, day-to-day operational maintenance, support, and upgrades for the Kafka Cluster. Creation o

Sr. Kafka Admin/Platform Engineer

IDC Technologies

New York, New York, USA

Contract

Dear Applicant,Hope you are doing wellWe have an urgent requirement of Sr. Kafka Admin/Platform Engineer Position with one of our global consulting clients.Kindly click to apply if you are available and interested in the job role mentioned belowRole : Sr. Kafka Admin/Platform Engineer PositionLocation : New York City, NY (100% ONSITE-3 Days Hybrid )Duration : 8+ MonthsJob Description :Setup new Confluent Kafka platform.Upgrade and maintain existing platform to approved version in the organizat

Sr. Kafka Admin/Platform Engineer

TechIntelli Solutions Inc

New York, New York, USA

Contract

Role: Sr. Kafka Admin/Platform Engineer Type: Long Term Contract Contract Type: W2 OR 1099 Work Location: New York City, NY (100% ONSITE-3 Days Hybrid) NO REMOTE Job Responsibilities: Setup new Confluent Kafka platform.Upgrade and maintain existing platform to approved version in the organization.Implement security best practices for Kafka cluster.Maintain & tune Kafka cluster for scalability and performance.Understanding of Kafka Brokers.Understanding of Kafka client (Producer and consumer) con

Kafka Admin / Platform Engineer at New York City, NY

Parmesoft Inc.

New York, New York, USA

Contract, Third Party

Please send the resume to augustin (at) parmesoft (dot) com VERY URGENT REQUIREMENT Job title: Kafka Admin / Platform Engineer Location: New York City, NY ( Hybrid, 3 Days/week onsite in New York City, NY is a must Duration: 8 Months Rate: $72-$75/Hr all-inc Client wants the consultant to be 100% onsite in New York City, NY from day 1 3 Days/week onsite in New York City, NY is a must Description: Setup new Confluent Kafka platform.Upgrade and maintain existing platform to approved version i

Kafka Admin with Python

Talent Group

New York, New York, USA

Full-time

Job Description: Develop Python-based Kafka consumers and producers to enable efficient data processing with other systems.Create and manage Kafka topics, producers, consumers, and schemas as needed using Python/Shell scripting. Monitor and fine-tune Kafka cluster configurations to optimize performance and resource utilization. Implementation exp. on access controls and authorization (like SASL, JaaS config, Kerberos, OAuth, Trust KeyStore) mechanisms to protect Kafka Infrastructure

Kafka Admin

Tecktiva

Hanover, New Jersey, USA

Contract

Kafka Admin Location: Whippany NJ Hybrid 3 Days/ Week Duration: End of year Rate: $55-58/hr on W2, All Inc Client: Sogeti, Capgemini, NJ Experience with the Linux environments and Bash scripting. Experience with Kafka operations and administration. The individual will be asked to lead the triage sessions with multiple tenants. Must have ability to review client application configuration and architecture. Provide onboarding support to prospective tenants on 1-O-1 setting Participate and Lead Reg

Java Kafka Admin

HAN IT Staffing Inc.

Hanover, New Jersey, USA

Contract, Third Party

Java Kafka Admin Whippany NJ Long Term Contract Onsite only We need java background and Kafka Admin Not a etl kafka Java kafka No big data kafka This is java plus kafka admin Kafka: Rate yourself on KafkaWhat is the difference between Consumer and Consumer Group in Kafka?What are topic partitions and how does is benefit in Kafka?If a new message is sent to a Kafka topic, how many consumers in the consumer group will get the message?If there are 10 partitions and 5 consumers under a consumer gro

Lead/Senior Data Engineer - Scala/Spark/Kafka/Azure

BayOne Solutions

Remote

Full-time

Job Title: Senior Data Engineer Job Type: Full Time Remote Eligible: Yes Skills: Scala programming, Spark, Kafka, Azure Responsibilities: Streamline the intake of the raw data into our Azure Data lake.Perform production support and deployment activities.Proactively drive the execution of our core data engineering, business intelligence, and data warehouse frameworksBuild data pipelines from systems such as CRM, Ecommerce etc. with the emphasis on scalability and reliabilityLeverage central data

Big Data Developer

OJUS LLC

Jersey City, New Jersey, USA

Contract

Client TCS/Citi Bank Location = Jersey city/ It is onsite Role C2C Here is the JD Big Data Developer (Location: NJ) On-Site Strong Experience in Spark Scala Programing. Very extensive experience on Hive, Impala, Kafka & Hbase. Should have good knowledge on Spark Streaming. Clear understanding of Hadoop Ecosystem & Spark Architecture. Must have experience in Unix Shell Scripting, PL/SQL & Autosys Scheduler. Should have used udeploy, TeamCity, SharePoint. Should be expert in debugging & tracing er

Kafka Tech Admin

Vuesol Technologies Inc.

Remote

Contract

Role : Kafka Tech Admin Location : 100% Remote Contact : Longterm Contract Job Description: Primary responsibility of Confluent Platform Administrator will be to build, test and maintain Kafka Cluster and its eco-system which is deployed to run Data Streaming use cases for various business units Experience:Overall 5+ years of experience out of which 2+ years around Confluent Platform administration.Mandatory Job Requirements: Manage single and multi-node Kafka cluster deployed on VM, Docker an

Kafka Admin

Softpath System, LLC.

Remote

Third Party, Contract

Role Kafka Tech Admin Remote Job Responsibility Primary responsibility of Confluent Platform Administrator will be to build, test and maintain KafkaCluster and its eco-system which is deployed to run Data Streaming use cases for various business units Experience Overall 5+ years of experience out of which 2+ years around Confluent Platform administration Mandatory Job Requirements Manage single and multi-node Kafka cluster deployed on VM, Docker and Kubernetes Container platform. Experience with

Kafka Administrator

Synechron Inc.

New York, New York, USA

Full-time

We are At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development in

Java Developer with Hadoop Developer Whippany, NJ (Hybrid Onsite) - CG

Empower Professionals

Hanover, New Jersey, USA

Contract, Third Party

Role: Java Developer with Hadoop experience Locations: Whippany, NJ (Hybrid Onsite) Duration: 12+ Months Contract Note: Candidate needs to be in the office 3 Days every week. Local Or candidates from nearby states only. Key Qualifications: 7+ years advanced proficiency in Java application development.3+ years Hands-on experience with relevant tools such as Apache Hadoop, Spark, Kafka, and other industry-standard platforms.Profound command of Java emphasizing the development and maintenance of h

Senior Software Engineer - Metrics Intake Processing

Datadog

New York, New York, USA

Full-time

Metrics Platform stores and serves time-series data. Every day we ingest double-digit trillions of points and serve double-digit billions of queries. We power multiple Datadog products such as standard & custom metrics, infrastructure hosts, dashboards, metric-based monitors, SLOs to name a few. We work on new product functionality along with scalability and efficiency. We develop in modern programming languages (Rust, Go), frameworks (Glommio, Spark), storage engine (RocksDB). At Datadog, we pl

Data Engineer - Scala

Jobot

New York, New York, USA

Contract

100% Remote This Jobot Consulting Job is hosted by: Duran Workman Are you a fit? Easy Apply now by clicking the "Apply Now" button and sending us your resume. Salary: $75 - $95 per hour A bit about us: We are seeking a dynamic and experienced Consulting Data Engineer - Scala in the technology industry. This role will be a key player in our team, responsible for designing and implementing data processing systems and service solutions. The ideal candidate will have a strong background in SQL, E

Senior Software Engineer - Data Infrastructure

Bloomberg

New York, New York, USA

Full-time

Bloomberg runs on data, it's our business and our product. The DataHub Engineering team provides a distributed platform for hosting datasets, complete with managed data stores, search, discovery, lakehouse and real-time stream processing capabilities. The platform provides a single place in the company to discover, access, publish and subscribe to data. The DataHub team introduced the abstraction of "dataset", and invented a schema language to formally define all data at Bloomberg, complete with

Platform Engineer

Apple, Inc.

New York, New York, USA

Full-time

Summary At Apple, we believe in the power of technology to enrich people's lives. Everything we build is designed to empower people, including our advertising platform. We deliver ads in a way that benefits both customers and advertisers - helping people discover content, supporting creators, and protecting and respecting everyone's privacy.Our technology makes advertising possible on the App Store, Apple News, Stocks, and Apple TV. Our technology and services power advertising in Apple News an