Spark jobs

Remote

•

9d ago

Zions Bancorporation s Enterprise Technology and Operations (ETO) team is transforming what it means to work for a financial institution. With a commitment to technology and innovation, we have been providing our community, clients, and colleagues the best experience possible for over 150 years. Help us transform our workforce of the future, today. We are seeking an experienced Senior Databricks Solution Architect to join our data architecture team, focusing on architecting cloud solutions in Da

Sponsored

Full-time

$127,000 - $185,000

Senior Lead Data Engineer (Snowflake, Databricks, Apache Iceberg, Spark + SQL workload optimizations)

McLean, Virginia

•

Today

Senior Lead Data Engineer (Snowflake, Databricks, Apache Iceberg, Spark + SQL workload optimizations) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying da

Full-time

USD 229,900.00 - 262,400.00 per year

Data Engineer Senior - Data Products Organization (Hadoop, Spark 3, Python, Kafka)

Pittsburgh, Pennsylvania

•

Today

Job Profile Position Overview At PNC, our people are our greatest differentiator and competitive advantage in the markets we serve. We are all united in delivering the best experience for our customers. We work together each day to foster an inclusive workplace culture where all of our employees feel respected, valued and have an opportunity to contribute to the company's success. As a Data Engineer Senior within PNC's Data Products Organization, you will be based in Pittsburgh-PA, Cleveland-O

Full-time

USD 65,000.00 - 149,500.00 per year

Lead Data Engineer (Java, Scala, Spark)

McLean, Virginia

•

Today

Lead Data Engineer (Java, Scala, Spark) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engi

Full-time

USD 197,300.00 - 225,100.00 per year

Senior Manager, Application Development (Python & Spark)

Tampa, Florida

•

Today

Senior Manager, Application Development (Python & Spark) - Vice President Citi Funds Transfer Pricing Application has been built and rolled out to execute Funds Transfer Pricing ("FTP") Policy globally across Citigroup and for all businesses. Fund Transfer Pricing is a key regulatory function and is very important in how Citi determines the internal transfer price when allocating funds between businesses and treasury. This FTP allocation adjusts the revenues/expenses of businesses for the cost

Full-time

USD 125,760.00 - 188,640.00 per year

Senior Manager, Application Development (Python & Spark)

Irving, Texas

•

Today

Full-time

USD 125,760.00 - 188,640.00 per year

Senior Data Engineer (PySpark/Spark, AWS, Databricks, EMR, ETL/SQL)

Cambridge, Massachusetts

•

Today

Senior Data Engineer (PySpark/Spark, AWS, Databricks, EMR, ETL/SQL) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a

Full-time

USD 161,800.00 - 184,600.00 per year

Databricks Engineer (Scala Spark)

Hybrid in Boston, Massachusetts

•

2d ago

Job Title: Databricks Engineer (Scala Spark) Location: Boston, MA (Hybrid Onsite) Type: W2 (Locals Preferred) Roles & Responsibilities Recognize the current application infrastructure and suggest new concepts to improve performanceDocument the best practices and strategies associated with application deployment and infrastructure supportProduce reusable, efficient, and scalable programs, and also cost-effective migration strategiesDevelop Data Engineering and ML pipelines in Databricks and dif

Easy Apply

Third Party, Contract

$60 - $70

Backend Developer - Java, Glue, Spark - W2 contract - Hybrid mode

McLean, Virginia

•

3d ago

Hi, Please check below job description Job Title: Backend Developer - Java, Spark, Glue Location: McLean, VA - Hybrid (3 days onsite 2 days remote) Duration: Long term contract Contract Type: W2 (NO C2C or C2H) Visa: USCEAD/EAD/L2EAD/ H1 transfer MUST HAVE: JAVA, AWS GLUE, SPARK, ETL, DynamoDB if you dont have Java, GLUE and Apache Spark will not consider Experience: Minimum 8-10 years of experience required Required Skills & Qualifications: 8 10 years of experience in back-end engineering or

Easy Apply

Contract

Kafka Admin

St. Louis, Missouri

•

3d ago

Designing, developing, and managing Kafka-based data pipelines. Working with other big data technologies such as Hadoop, Spark, and Storm. Monitoring and optimizing Kafka clusters. Troubleshooting Kafka related issues. Performing 3rd level administrator support for Kafka infrastructure. Maintaining the availability, performance and security of Kafka infrastructure. Creating and managing Kafka topics, producers, consumers, and Java-based Kafka consumers and producers to enable efficient data proc

Easy Apply

Contract, Third Party

Depends on Experience

Hadoop and PySpark Lead Developer

Plano, Texas

•

2d ago

Hadoop and PySpark Lead Developer Charlotte, NC, Plano, TX Fulltime Required Qualifications: At least 4 years of Information Technology experience At least 3 years of experience in Hadoop, Python, and Spark Good experience in end-to-end implementation of data warehouse and data marts Strong knowledge and hands-on experience in SQL, Unix shell scripting Preferred Qualifications: Good understanding of data integration, data quality and data architecture Experience in Relational Modeling, Dimens

Easy Apply

Full-time

Data Engineer, Hadoop, SPARK, Python, Shell, CI/CD, Hive, Snowflake, SQL 12+ Mts Con, Alpharetta, GA

Alpharetta, Georgia

•

3d ago

JPC - 3512 Level 4 : ( 7+ Yrs of exp) 2 rounds of interview ( final round inperson) Loc - Alpharetta, GA (Hybrid - 3 days in office, 2 days home) Duration : 12+ Months Contract Description: Big Data Engineer MUST HAVE - Haddoop, SPARK, UNIX, Python, Shell, Github, Devops, CI/CD, Hive, SQL, Trouble Shoot SnowFlake 50% Work on Haddoop - Production Support of the existing Application 50% Work on Frame work of Migration of Data from Hadoop to Snowflake. Description: Big Data Engineer Job Description

Easy Apply

Contract, Third Party

Data Engineer (Hybrid Onsite - W2 Contract)

Hybrid in Quincy, Massachusetts

•

2d ago

Job Title : Data Engineer Location: Quincy, MA (3 days a week Hybrid onsite) Duration : Long term contract Contract: W2 Job Description: Key Skills: Python/Pyspark, Spark, Scala, Databricks, AWS. Education and experience Qualification Bachelors degree in Computer Science, Information Systems, or equivalent education or work experience Around 5+ years of experience as a developer on cloud technologies Any AWS and/or Databricks certification will be a plus Roles & Responsibilities: Recognize the

Easy Apply

Contract

$70 - $80

AWS Data Engineer - Python, Pyspark, EMR, Spark, Kafka/ Kinesis, SQL/NoSQL

Chicago, Illinois

•

Today

As a Data Engineer with deep expertise in Python, Pyspark, AWS, big data ecosystems, and SQL/NoSQL technologies, driving scalable, real-time data solutions with CI/CD and stream-processing frameworks. Experience: - 8+ Years Contract In-person Interview Required Location: - Chicago, IL (Local Only) Educational Qualifications: - Engineering Degree BE/ME/BTech/MTech/BSc/MSc. Technical certification in multiple technologies is desirable. Mandatory skills: - Python, PySpark, AWS Good to have sk

Easy Apply

Third Party, Contract

Scala Developer in Mount laurel,NJ/New York City or Charlotte NC

Mount Laurel Township, New Jersey

•

6d ago

Experience level 6 to 9 years Experience with Apache Spark / Scala, Spark SQL, and related Spark ecosystem tools and libraries. Hands-on development building spark applications using Scala Knowledge of Big data technologies such as Hadoop, HDFS, distributed computing frameworks for large-scale data processing. Experience in Java coding, debugging experience. Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment. Knowledge o

Easy Apply

Third Party, Contract

Scala Developer in Mount laurel,NJ/New York City or Charlotte NC

Mount Laurel Township, New Jersey

•

4d ago

Easy Apply

Contract, Third Party

Senior Data Engineer with Scala, Java & Spark - W2 Role

San Francisco, California

•

Today

Role: Senior Data Engineer Location: San Francisco, CA (Hybrid - 3 days a week onsite) Job Type: W2 Contract Length: 1 year, can be extended Must Have: Scala, Java + Spark (can strong Java with some Scala + Spark) Minimum Qualifications: 2-5+ years of Scala, Java development experience. 2+ years of SQL and NoSQL experience (handling structured and unstructured data). 1+ years of extensive experience with Spark Processing engine. 1+ years of experience with Big data tools / technologies/ Stream

Easy Apply

Contract

W2-Data Engineer (Python / Spark / AWS) - F2F, TX

Texas

•

Today

Job Title: Data Engineer (Python / Spark / AWS) Location: Texas - Onsite | Face-to-Face (In-Person) Interview Positions: Multiple Duration: Long-Term Contract Rate: $55 57/hr Start Date: Immediate Role Summary: We are seeking talented and experienced Data Engineers with strong expertise in Python, Spark (PySpark), and AWS to work on enterprise-scale data modernization initiatives. The selected candidates will be responsible for building, optimizing, and maintaining robust data pipelines t

Easy Apply

Contract

W2-Data Engineer (Python / Spark / AWS) - F2F, VA

Virginia

•

Today

Job Title: Data Engineer (Python / Spark / AWS) Location: McLean, VA or Richmond, VA - Onsite | Face-to-Face (In-Person) Interview Positions: Multiple Duration: Long-Term Contract Rate: $55 57/hr Start Date: Immediate Role Summary: We are seeking talented and experienced Data Engineers with strong expertise in Python, Spark (PySpark), and AWS to work on enterprise-scale data modernization initiatives. The selected candidates will be responsible for building, optimizing, and maintaining rob

Easy Apply

Contract

Senior Data Engineer with Aerospike.

Scottsdale, Arizona

•

2d ago

Hi All Role: Senior Data Engineer Locations: Scottsdale, AZ (100% onsite) Experience: 14+ years we have multiple Senior Data Engineer roles open. need someone with 12+ year experience and strong in hadoop, spark, scala, Kafka, Aerospike. These are fast moving and expected start date is 1st week of January.. Please send genuine strong profiles If you're interested, please email me your latest resume at

Easy Apply

Contract

Depends on Experience

Data Engineer w/ Spark/Scala Exp

Remote

•

6d ago

Key Responsibilities: Design, develop, and maintain scalable big data solutions using Apache, Spark and Scala. Implement complex SQL queries for data transformation and analytics. Develop and optimize Power BI dashboards for business reporting and visualization. Collaborate with cross-functional teams to integrate data pipelines and reporting solutions. Ensure data quality, security, and compliance across all systems. Required Skills & Experience Strong proficiency in Apache, Spark with hands-on

Easy Apply

Contract

$60+

Filter Results

Job post features

Posted date

Work settings

Employment type

Distance

Employer type

Work authorization