Big Data Engineer (Spark) Jobs in New York, NY

Refine Results
41 - 60 of 107 Jobs

MySQL Enterprise Database Engineer - Whippany, NJ ( Locals Preferred )

Araxis Systems Inc

Hanover, New Jersey, USA

Contract, Third Party

MySQL Enterprise Database Engineer Location: Whippany, NJ (2-3 days from office) Job Description Minimum of 8 years development and experience in MySQL/Oracle comprehending the existing SQL queries and writing medium to complex SQL queries.Minimum of 3 years experience in Unix and shell scripting.Minimum of 1 year experience in investment banking or the financial sector.Performance Tuning of Oracle/MySQL/Hive SQL Queries/Spark SQL Statements.Experience in working with large databases - multi

Manager, Data Engineering

Capital One

New York, New York, USA

Full-time

11 West 19th Street (22008), United States of America, New York, New York Manager, Data Engineering Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying dat

Staff Data Engineer (Emerging Platforms)

NBC Universal

Englewood Cliffs, New Jersey, USA

Full-time

Company Description We create world-class content, which we distribute across our portfolio of film, television, and streaming, and bring to life through our theme parks and consumer experiences. We own and operate leading entertainment and news brands, including NBC, NBC News, MSNBC, CNBC, NBC Sports, Telemundo, NBC Local Stations, Bravo, USA Network, and Peacock, our premium ad-supported streaming service. We produce and distribute premier filmed entertainment and programming through Universa

Software Engineer In Test

Agile

Remote

Full-time

Title: SDET Compensation: $160k - $190k Benefits: Medical, Dental, Vision, 401k, Disability, and more Location: 100% Remote Our client does amazing work leading innovation in the medical industry, and they're looking for an SDET to lead that innovation. This is a salary role, and it's 100% remote. The ideal candidate will have: 4+ years of software engineering experience, using software testing tools, ML frameworks, containerization, CI/CD, and AWS.Experience automating component and integration

Data Scientist

Peritus Inc.

Bernards, New Jersey, USA

Contract

Candidate should be experience on MLOPS with Spark and Kubernetes and Kafka Data Scientist Basking Ridge NJ (2-3days office) 14+ Years exp is Mandatory As the Data Scientist / ML engineer, you are expected to engineer, develop and deliver ML models using real time network data to enable decision making and drive insights for a leading Telecom client. Key responsibilities will be - Experience in designing, developing, optimizing, and troubleshooting ML model applications in Kubernetes environment

Principal Data Engineer (Azure)

Tiger Analytics

Jersey City, New Jersey, USA

Full-time

Tiger Analytics is a global AI and analytics consulting firm. With data and technology at the core of our solutions, we are solving problems that eventually impact the lives of millions globally. Our culture is modeled around expertise and respect with a team-first mindset. Headquartered in Silicon Valley, you'll find our delivery centers across the globe and offices in multiple cities across India, the US, UK, Canada, and Singapore, including a substantial remote global workforce. We're Great

Lead Software Engineer

The Walt Disney Company

New York, New York, USA

Full-time

On any given day at Disney Entertainment & ESPN Technology, we're reimagining ways to create magical viewing experiences for the world's most beloved stories while also transforming Disney's media business for the future. Whether that's evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to maximize flexibility and efficiency, or delivering Disney's unmatched entertainment and sports content, every day is a moment to make a diffe

Lead Software Engineer - Java, Payments Technology

JPMorgan Chase & Co.

Jersey City, New Jersey, USA

Full-time

We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorgan Chase within the Corporate & Investment Bank, Payments Technology team, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solutions acro

Senior Manager, Machine Learning Engineering

Capital One

New York, New York, USA

Full-time

11 West 19th Street (22008), United States of America, New York, New York Senior Manager, Machine Learning Engineering As a Capital One Machine Learning Engineer (MLE), you'll be part of an Agile team dedicated to productionizing machine learning applications and systems at scale. You'll participate in the detailed technical design, development, and implementation of machine learning applications using existing and emerging technology platforms. You'll focus on machine learning architectural d

Sr Software Engineer

The Walt Disney Company

New York, New York, USA

Full-time

On any given day at Disney Entertainment & ESPN Technology, we're reimagining ways to create magical viewing experiences for the world's most beloved stories while also transforming Disney's media business for the future. Whether that's evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to maximize flexibility and efficiency, or delivering Disney's unmatched entertainment and sports content, every day is a moment to make a diffe

Data Engineer

Kforce Technology Staffing

Remote or Blue Ash, Ohio, USA

Contract, Third Party

RESPONSIBILITIES: Kforce has a client in Blue Ash, OH that is seeking a Data Engineer. Summary: We develop strategies and solutions to ingest, store, and distribute our big data. Our developers use Big Data technologies including (but not limited to) Hadoop, Pyspark, Hive, JSON, and SQL to develop products, tools and software features. REQUIREMENTS: * Bachelor's degree (Computer Science, Management Information Systems, Mathematics, Business Analytics, or STEM) * 4+ years of professional Data D

Data Engineer II

The Connors Group, Inc.

Remote

Full-time

The Data Engineer II plays a critical role in engineering of data solutions that support the reporting and analytic needs. As a key member of the Data engineering team, will work on diverse data technologies such as Steramsets, dbt, data ops and others to build insightful, scalable, and robust data pipelines that feed our various analytics platforms. ESSENTIAL FUNCTIONS: Design and Model data engineering pipelines that support company reporting and analytic needs. Engineer efficient, adaptable,

Database Administrator (100% Remote - W2 Only)

Performix Business Services, LLC

Remote

Contract

Database infrastructure administer, test, and implement databases, applying knowledge of database management systems. Database Engineer Responsibilities and Duties:Assist in design and development of distributed database systems.Optimize database systems for performance and reliability.Perform database maintenance and troubleshooting activities.Test database systems and perform bug fixes.Provide database solutions based on technical documents and business requirements.Provide technical assistanc

Data Engineer (Hybrid Day 1 Onsite)

Arthur Grand Technologies Inc

Jersey City, New Jersey, USA

Third Party, Contract

Arthur Grand Technologies ( We are a minority owned staff augmentation and technology consulting company To keep our valued employees, we need to keep them engaged in challenging, interesting work, offer market-relevant benefits, and provide continued opportunities for professional growth. Please send your resume tofor immediate consideration Title of Position: Data Engineer (Hybrid Day 1 Onsite) Location: Jersey City, NJ (Primary Location), Wilmington, DE, Plano, TX (Day 1 Onsite) Duration: Lo

Cloud Data Architect

Tiger Analytics

Jersey City, New Jersey, USA

Full-time

Tiger Analytics is an advanced analytics consulting firm. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our consultants bring deep expertise in Data Science, Machine Learning, and AI. Our business value and leadership have been recognized by various market research firms, including Forrester and Gartner. We are one of the highest-rated employers on Glassdoor. If you are passionate to work on unstructured business prob

Senior Data Engineer

iSpace, Inc

Remote

Contract

JOB DETAILS: Title: Senior Data Engineer Location: Remote Work (Team is based out in Century City, CA and NYC, NY) Type: 06 -12 plus months contract (extendable) Job Description: Looking for Senior Data Engineer with a passion for building robust, scalable, efficient, and high-quality Data Engineering solutions to join our Engineering team. If you enjoy designing and building innovative data engineering solutions using the latest tech stack in a fast-paced environment, this role is for you. P

Azure Data Engineer

P2PSoftTek Inc

Remote

Contract

Azure Data Engineer Location- Remote Job Type-Long Term Description Min 5 years of experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, AWS, Google Cloud Platform, Data Bricks etc. Azure experience is preferred over other cloud platforms. 10 + years of proven experience with SQL, schema design and dimensional data modelling. Hands on experience in SQL is a MUST. Solid knowledge of data warehouse best practices, development standards and me

Data Engineer

TeknoBit Solutions Inc.

Remote

Contract

Title - Data Engineer Job Duration - 6 Month(s) Location: Remote Work (EST or CST only) Interview process: 2 rounds- Behavioural> Technical screening Pre-screen: Standard, 5 questions and a game TOP SKILLS: Azure/Databricks Python/PySpark SQL Job Description: We develop strategies and solutions to ingest, store, and distribute our big data. Our developers use Big Data technologies including (but not limited to) Hadoop, Pyspark, Hive, JSON, and SQL to develop products, tools and software features

Data Engineer (L4) - Privacy

Netflix, Inc.

Remote

Full-time

Netflix is enjoyed by more than 230 million members globally, entertaining new audiences every day. We are in the midst of major transformative developments for the Netflix product with the launch of an Advertising-supported plan, Games, and Live content. These new products, alongside our streaming service, have resulted in significant increases in the complexity and breadth of our internal data ecosystem. We manage one of the largest paid subscription businesses and are committed to handling ou

Data Engineer

Sparibis, LLC

Remote

Full-time

Location: 100% Remote Years Experience: 3+; 10+ years (Jr and Sr Level available) Education: Bachelor s in IT related field Work Authorization: Must show that applicant is legally permitted to work in the United States. Clearance: Applicants must be able to meet the requirements to obtain an Public Trust security clearance. NOTE: United States Citizenship is required to be eligible to obtain this security clearance. Key Skills: 10+ years of IT experience focusing on enterprise data architecture