Apache Spark jobs in Bedminster, NJ

Hybrid in Montgomery, New Jersey

•

10d ago

Title: Senior Spark/PySpark Developer Location: Hybrid work in Skillman, NJ 08558 (Three days onsite is a must) Duration-12 months contract Overall, Skills needed: Working knowledge of industry standard Data Infrastructure (e.g. Warehouse, BI, Analytics, Big-Data, etc.) toolsProficient at developing, architecting, standardizing and supporting technology platforms using Industry leading ETL solutions.Building scalable and high throughput systemsExperience with agile BI & ETL practices to assis

Easy Apply

Contract, Third Party

$80 - $90

Senior/Lead Data Engineer-Python,Spark & SQL (Only W2)

Remote or New Jersey

•

Today

Description: We are in search of a Senior Data Engineer who is adept in SQL, Python, and Spark, and ideally with an experience in AI-related tasks and API integrations for chatbot development/integration. SQL Expertise: Essential for complex query handling and database manipulation. Python Proficiency: Required for automation, data processing, AWS Bedrock API integration, and chatbot development workflows using Boto3 SDK Spark Familiarity: Needed for large-scale data processing. Responsibilit

Easy Apply

Contract

Data Engineer w/ Spark/Scala Exp

Remote

•

3d ago

Key Responsibilities: Design, develop, and maintain scalable big data solutions using Apache, Spark and Scala. Implement complex SQL queries for data transformation and analytics. Develop and optimize Power BI dashboards for business reporting and visualization. Collaborate with cross-functional teams to integrate data pipelines and reporting solutions. Ensure data quality, security, and compliance across all systems. Required Skills & Experience Strong proficiency in Apache, Spark with hands-on

Easy Apply

Contract

$60+

Senior Java Spark Engineer - Tech Lead - Vice President

Remote or Jersey City, New Jersey

•

Today

We are seeking a highly skilled and experienced Senior Java Spark Engineer to join our dynamic team. In this role, you will be responsible for designing, developing, and implementing robust and scalable data processing solutions using Core Java, Sprint Integration Framework, and Apache Spark. You will play a crucial part in integrating these solutions into our existing data infrastructure, addressing complex data challenges, and providing technical leadership. The ideal candidate will possess a

Full-time

USD 142,320.00 - 213,480.00 per year

Data Engineer (MDM, Python, Kafka, Financial) - NJ Hybrid - 12+ Yrs

Hybrid in Woodbridge Township, New Jersey

•

2d ago

Role: Data Engineer (MDM) Exp: 12+ Yrs Location: Iselin, NJ (Hybrid) Note: In-Person Interview in Iselin MUST Required Qualifications:12+ years of experience in data engineering, with a proven track record of MDM implementations, preferably in the financial services industry.Extensive hands-on experience designing and deploying MDM solutions and comparing MDM platform options.Experience with financial systems (capital markets, credit risk, and regulatory compliance applications).Strong functiona

Easy Apply

Contract

Depends on Experience

Sr. Databricks Architect - Princeton, NJ (Onsite)

Princeton, New Jersey

•

Yesterday

Role Name: Sr. Databricks Architect Location: Princeton, NJ (Onsite) Duration: 12 Months JOB DESCRIPTION: Contribute to the design and implementation of scalable data architectures, such as a Lakehouse, using Delta Lake and Unity Catalog. Manage and maintain the underlying data infrastructure, which typically exists on a major cloud platform like AWS, Azure, or Google Cloud Platform. Implement data governance practices, including data lineage, metadata management, and access controls integrat

Easy Apply

Contract, Third Party

Depends on Experience

Data Architect/ Databricks Architect- Princeton, NJ (Onsite)

Princeton, New Jersey

•

Yesterday

Role Name: Databricks Architect Location: Princeton, NJ (Onsite) Duration: 12 Months Job ID : CGEMJP00324803 JOB DESCRIPTION: Contribute to the design and implementation of scalable data architectures, such as a Lakehouse, using Delta Lake and Unity Catalog. Manage and maintain the underlying data infrastructure, which typically exists on a major cloud platform like AWS, Azure, or Google Cloud Platform. Implement data governance practices, including data lineage, metadata management,

Easy Apply

Contract

Depends on Experience

Java/Kafka Developer

East Hanover, New Jersey

•

14d ago

10+ years skilled and experienced in design, development, and maintaining real-time data streaming applications using Java and Apache Kafka. Data pipeline development: Design, build, and maintain real-time data streaming pipelines using Apache Kafka and Java.Kafka application development: Develop and implement Kafka producer and consumer applications, including microservices.Integration: Integrate Kafka with various existing systems, databases, and data sources.Performance optimization: Monitor

Easy Apply

Full-time

$40 - $50

Senior Software Engineer - DataHub Core Services

Montgomery, New Jersey

•

Today

Description & Requirements The DataHub Engineering team is building a distributed platform to host, catalog, discover, and deliver financial datasets across Bloomberg. This platform powers batch analytics, real-time stream processing, and low-latency, high-availability data distribution - ensuring that high-quality data, the lifeblood of financial markets, is always accessible. You will join the team that introduced the abstraction of "dataset", invented a schema language to formally define all

Full-time

USD 160,000.00 - 240,000.00 per year

Staff Data Scientist, Personalization & Shopping

Remote or New York, New York

•

Today

About Pinterest: Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we're on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product. Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other's unique experiences and embrace the flexibility

Full-time

USD 164,695.00 - 339,078.00 per year

Databricks Lead

Remote

•

13d ago

Key Responsibilities Lead implementation of modern data solutions on DatabrickImplement data governance, access control, and lineage using Unity Catalog.Optimize ETL/ELT processes and Spark workloads for high performance.Collaborate with data engineers, analysts, and scientists to ensure business and technical alignment.Provide guidance on cloud data architecture and CI/CD best practices.Required Skills & Experience 8 10 years in Big Data Engineering with Apache Spark; 3 4 years hands-on with Da

Easy Apply

Contract

Depends on Experience

Azure Data Engineer

Remote

•

30+d ago

Year of exp In Synapse, Year of exp in IAAS, SQL Server Year of exp in ADLS Gen 2 Year of exp in Azure Automation account runbooks using PowerShell, spark, scala programming Data Engineer PST time zone only Remote Key skills Synapse, IAAS, SQL Server, ADLS Gen 2, Azure Automation account runbooks using PowerShell, spark, scala programming 1. Experience with Azure technologies like Synapse, IAAS VM, SQLserver and ADSL Gen 2 2. Experience with developing, maintaining, and debugging Azure automa

Easy Apply

Contract

$30 - $55

Application Reliability Engineer

Remote or Raritan, New Jersey

•

Today

At Johnson & Johnson, we believe health is everything. Our strength in healthcare innovation empowers us to build a world where complex diseases are prevented, treated, and cured, where treatments are smarter and less invasive, and solutions are personal. Through our expertise in Innovative Medicine and MedTech, we are uniquely positioned to innovate across the full spectrum of healthcare solutions today to deliver the breakthroughs of tomorrow, and profoundly impact health for humanity. Learn m

Full-time

USD 77,000.00 - 124,200.00 per year

Data Engineers for Data Management (Capital Markets)

Hybrid in Newark, New Jersey

•

20d ago

We're seeking a Data Engineer to support data management initiatives. This role involves building robust data pipelines, integrating market and trade data, and ensuring high-quality data delivery for trading, risk, and compliance functions. Key Responsibilities Design and implement scalable data pipelines for market, reference, and transactional data.Develop ETL processes to ingest data from trading platforms, market data providers, and internal Collaborate with trading desks, risk teams, and co

Easy Apply

Contract, Third Party

$1 - $1

Senior Data Management Professional - Data Engineer - Private Deals

Montgomery, New Jersey

•

Today

Description & Requirements Bloomberg runs on data. Our products are fueled by powerful information. We combine data and context to paint a complete picture for our clients-around the clock and around the world. In Data, we are responsible for delivering this data, news, and analytics through innovative technology-quickly and accurately. We apply product thinking, domain expertise, and technical insight to continuously improve our data offerings, ensuring they remain reliable, scalable, and fit-

Full-time

USD 110,000.00 - 190,000.00 per year

Senior AI Engineer - Core AI

Remote or New York, New York

•

Today

At eBay, we're more than a global ecommerce leader - we're changing the way the world shops and sells. Our platform empowers millions of buyers and sellers in more than 190 markets around the world. We're committed to pushing boundaries and leaving our mark as we reinvent the future of ecommerce for enthusiasts. Our customers are our compass, authenticity thrives, bold ideas are welcome, and everyone can bring their unique selves to work - every day. We're in this together, sustaining the futur

Full-time

USD 210,400.00 - 280,900.00 per year

Lead Big Data Engineer

Remote

•

Today

Lead Engineer- Big Data (Fulltime Role) The Lead Engineer Analytics (Advanced Software Engineer) will report to a Senior Manager - Analytics. Using Big Data technology, you will be responsible for designing, developing, implementing and supporting data analytics solutions utilizing cloud architecture. Primary Responsibilities: Lead, build and deliver projects with high impact and cross-portfolio scope, complexity and collaboration with cross-functional teams, both business and technology Iden

Easy Apply

Full-time

Depends on Experience

Data Warehouse Administrator

Remote or Salt Lake City, Utah

•

Today

Data Warehouse Administrator Remote 6 months MADlib, PXF, GPCC, gpfdist, gpload, gpbackup/gprestore, gpdr backup/restore SQL development skills in data warehousing environments Bash scripting and Python UNIX/Linux (RHEL) environments Terraform or other infrastructure-as-code tools ETL technologies (e.g., IBM DataStage) cloud platforms (AWS, Google Cloud Platform, Azure) Databricks and Spark-based data processing containerization (Docker, Kubernetes) and CI/CD pipelines

Easy Apply

Contract, Third Party

SAP Databricks Engineer

Remote

•

Today

SAP Databricks EngineerRemote12 months contractAI/ML (SAP Business Data Cloud) Resource NeededThe SAP Databricks Engineer develops and runs AI and machine learning workloads within SAP Business Data Cloud (BDC) using SAP-managed Databricks. The role focuses on model development, feature processing, training, and inference on SAP-governed data exposed via BDC and Datasphere, enabling predictive and intelligent scenarios consumed through SAP Analytics Cloud (SAC) and other SAP services. Build and

Easy Apply

Contract, Third Party

Depends on Experience

DevSecOps Engineer

Woodbridge Township, New Jersey

•

Today

DevSecOps Platform Engineer Location: Iselin, NJ (3 days onsite) Employment: Long-term contract through March 2027 Level: Senior / Experienced Overview Seeking an experienced DevSecOps Platform Engineer to design, secure, and operate large-scale infrastructure supporting big data, analytics, AI/ML, and critical enterprise platforms. This role blends deep platform engineering, strong security practices, and automation skills to maintain a resilient, compliant, and high-performance environmen

Easy Apply

Contract

$70 - $90

Filter Results

Job post features

Posted date

Work settings

Employment type

Distance

Employer type

Work authorization

Apache Spark jobs in Bedminster, NJ, USA