Apache Spark jobs in New York, NY, USA

Spark/Scala Developer DE/Jersey City NJ/Tampa FL/Irving TX 12+ Months Contract

Need Scala Spark Developer Need Scala Spark Developer

Senior Data Engineer Spark (Java) & Databricks with ADLS Expertise Job Description: We are looking for a highly skilled Senior Data Engineer with 8 to 12 years of experience in building and optimizing large-scale data processing pipelines. The ideal candidate will have strong hands-on expertise in Apache Spark using Java, proficiency in Databricks, and solid knowledge of Azure Data Lake Storage (ADLS) concepts and implementations. Experience with Python is also valuable, but Spark with Java is p

Hi, this is Srikanth from Reliable Software. We have an opportunity with one of our direct clients, and I'd like to share the details with you. Please review the information below and let me know if you're interested. Kindly share your updated resume if you'd like to be considered. Job Title: Big Data / Spark Principal Architect Location: Remote Mandatory Skills - Spark, SCALA, Kafka, Streaming, technical architecture, Data Bricks, Data Engineering, data quality, Data Governance. Presales, Clie

Position Title : Scala Developer Location : New York, NY (Hybrid) Experience : 8+ Years Preferred Employee Type : Full Time with Benefits Job Description: We are seeking a highly skilled and hands-on Scala Developer to join our dynamic team focused on building and enhancing a Big Data platform for financial applications. This role involves delivering high-quality code, implementing automated testing, supporting DevOps release processes, and documenting technology solutions for transaction moni

Project descriptionWe are seeking a highly skilled Spark Developer with strong experience in Python, AWS, and SQL to join our team. The ideal candidate will be responsible for designing, developing, and optimizing large-scale data processing solutions, ensuring data quality, scalability, and performance. This role requires a solid background in distributed computing, cloud environments, and data engineering best practices. ResponsibilitiesDesign, develop, and maintain scalable data pipelines usi

Job Title: Senior Spark Developer Java Location: 750 Seventh Ave. New York NY 10019 (HYBRID 3 days on site) Local only Duration: 12 Months Contract (with possible extension) SPARK JAVA and SQL Spark: Good concepts of spark core. How a spark process executes and able to solve and write spark code to questions. Java : They should be able to provide solution and write code as well. Hands on Job Description: The ideal candidate will have extensive experience in Java development, a strong understa

Job Description We have an exciting and rewarding opportunity for you to take your software engineering career to the next level. As a Software Engineer at JPMorgan Chase within the Corporate Technology, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and scalable way. You are responsible for carrying out critical technology solutions across multiple technical areas within various business functions in suppor

Job Description We have an exciting and rewarding opportunity for you to take your software engineering career to the next level. As a Software Engineer at JPMorgan Chase within the Corporate Technology, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and scalable way. You are responsible for carrying out critical technology solutions across multiple technical areas within various business functions in suppor

Seeking a Spark Java Developer with expertise in big data processing , Python and Apache spark particularly within finance domain. Candidate should have a strong experience working with financial instruments, market risk and large scale distributed computing systems. This role involves developing and optimizing data pipelines for risk calculations, trade analytics and regulatory reporting . Key responsibilities Develop and optimize scalable Spark Java-based data pipelines for processing and an

Immediate need for a talented BigData Hadoop Engineer. This is a 12+months contract opportunity with long-term potential and is located in Jersey City, NJ (Hybrid). Please review the job description below and contact me ASAP if you are interested. Job ID: 25-83256 Pay Range: $60 - $63/hour. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location). Key Responsibilities: Hadoop Developer to work in

Job Title: Data Scientist AI/ML Location: New York, NY Domain: Banking & Finance Long Term Contract Looking for W2 Candidates. No C2C Job Summary: We are seeking a highly skilled and analytical Data Scientist to join our team. You will be responsible for leveraging data to drive business insights, develop predictive models, and support data-driven decision-making across departments. The ideal candidate is proficient in data mining, statistical modeling, machine learning, and data visualiza

Position: Scala Developer Location: NYC, NY (Looking for only locals or near by who can do in person) Duration: 12 Months Key Qualifications: Proficiency in Scala Must have some experience working with JavaExperience with SQL and NoSQL databases (Teradata, PostgreSQL, MongoDB)Expertise in ETL pipeline development and data warehousing (Snowflake, Redshift)Familiarity with cloud infrastructure AzureExperience with Apache Spark, Kafka, Databricks, and AirflowThese roles provide an excellent opportu

Overview:We are seeking an experienced Azure Databricks Engineer to design, implement, and optimize modern Lakehouse architectures in a regulated financial services environment. This role is a blend of hands-on engineering and leadership, requiring strong technical depth alongside the ability to enforce governance and security at scale. Responsibilities: Architect, build, and maintain Azure-based Lakehouse solutions using Databricks, Delta Lake, and Azure-native services. Implement medallion (br

Job Title: Lead Data Engineer - AWS Location: Jersey City, NJ - hybrid Position Type: Fulltime Key Skills Snowflake, SQL, Python, Spark, AWS Glue, Big Data ConceptMust Have 10+ years of relevant experience in Data Engineering and delivery.10+ years of relevant work experience in Big Data Concepts. Worked on cloud implementations AWS in particular.Strong experience being a hands-on lead for a team of 4+ members at least.Strong experience with SQL, Python, and PySpark.Good understanding of data i

Job Title: Lead Data Engineer Location: Jersey City, NJ (Hybird) Duration: Long Term Contract Key Skills:Snowflake, SQL, Python, Spark, AWS- Glue,Big Data Concepts Responsibilities: Lead the design, development, and implementation of data solutions using AWS and Snowflake. Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions. Develop and maintain data pipelines, ensuring data quality, integrity, and security. Optimize data storag

We Are Accenture is a global professional services company with leading capabilities in digital, cloud and security. Combining unmatched experience and specialized skills across more than 40 industries, we offer Strategy and, Interactive, Technology, and Operations services, all powered by the world's largest network of Advanced Technology and Intelligent Operations centers. Our 738,000 people deliver on the promise of technology and human ingenuity every day, serving clients in more than 120 c

Role: AB initio Developer Location: Jersey City, NJ (onsite) Mode of Hire: Contract for long term Rate: $65 Job Description: Mandatory Skills: Python, Java, Ansi SQL, Abinitio, Spark Experience in building data integration solutions using the AB initio ETL .Creating efficient and scalable data processing pipelines and applications using Apache sparkProficient in understanding distributed computing principles.Creating ,optimizing, and maintaining directed acyclic graphs(DAGs) in Python to define

Title: Scala Developer Location: New York, NY (Onsite / Face to Face Interview required) Position: Contract Note: Face to Face Interview required Description: We would like to hire hands on Scala developer that will be responsible for delivering a high quality code in a big data platform, Unit testing in automated test framework, automated DevOps release and documentation of technology solutions for transaction monitoring, customer activity review, Optimization of scenarios and other associated

Job Role: Scala Developer Location: NYC Experience: 8-10 years Skills: Strong proficiency in Scala programming.Solid hands-on experience with Apache Spark (Batch and/or Streaming).Familiarity with Hadoop ecosystem, Hive, Kafka, or HBase.Experience with SQL and data transformation logic.Understanding of software engineering best practices (version control, CI/CD, testing).Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform is a plus.Experience with Delta Lake, Databricks