apache spark Jobs in connecticut

Refine Results
1 - 20 of 312 Jobs

Jr. Data Engineer (Healthcare, Spark, Scala) - Remote

ConsultNet, LLC

Remote

Full-time

Title: Jr. Data Engineer, Healthcare Location : 100% Remote Target Start Date : ASAP Type: contract or contract to hire Pay Rate: DOE Are you driven by working to improve our healthcare system through advanced technology? We need your expertise and integrity! This role is 100% remote and we are looking for candidates who have healthcare domain expertise. Responsibilities Design, maintain, and execute intermediate-to-advanced Apache Spark jobs (using RDDs, DataFrames, Datasets, and Structur

Java Spark Developer - AVP

Citi

Remote or Jersey City, New Jersey, USA

Full-time

Seeking a Spark Java Developer with expertise in big data processing , Python and Apache spark particularly within finance domain. Candidate should have a strong experience working with financial instruments, market risk and large scale distributed computing systems. This role involves developing and optimizing data pipelines for risk calculations, trade analytics and regulatory reporting . Key responsibilities Develop and optimize scalable Spark Java-based data pipelines for processing and an

Senior java developer with Spark - VP - TAMPA

Citi

Remote or Tampa, Florida, USA

Full-time

The Java Applications Developer with Spark is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities. Responsibilities: Lead integration of functions to meet goals, deploy new products, and enhance processesAnalyze complex business processes, system processes, and industry standards to defi

Data Engineer - Scala

Exl Service

Remote

Full-time

We will only be able to move forward with candidates who have ship or hold active s for this role What you'll Do: Create and maintain optimal data pipeline architectureBuild data pipelines that transform raw, unstructured data into formats that data analyst can use to for analysisAssemble large, complex data sets that meet functional / non-functional business requirements Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-des

Databricks Architect

Amiseq Inc.

Remote

Contract

Job Title: Databricks Architect Duration: 12 months Location: Remote Skills Required: Architecting and Leadership:Deep understanding of modern data architecture, including Lakehouse, Medallion architecture, and Data Mesh.Data Engineering:Strong programming experience in Python; Scala is a significant plus.Proficiency in complex query tuning.Experience building Slowly Changing Dimensions (SCD) TYPEs.Familiarity with DBT.Experience with structured streaming.Knowledge of data formats like Iceberg

Databricks Engineer

Showman Staffing

Remote

Contract

Job Title: Databricks Engineer Location: Remote - US Job Type: Contract 6 + Months Experience Level: 7+ yrs About the Role We are seeking a highly skilled Databricks Engineer to join our growing data team. You will play a key role in building and optimizing our big data pipelines, implementing scalable data solutions, and collaborating with cross-functional teams to unlock insights from large datasets using Databricks, Apache Spark, and Azure/AWS cloud technologies. Key Responsibilities Des

Senior Software Engineer

Skywaves MP LLC

Remote

Contract

This role contributes to the Engineering of large-scale solutions that enable client's business while supporting the strategic architectural vision leveraging AWS and AI to achieve quality, scalability, performance and function. Senior Software Engineer is an active member of a dynamic team looking to build Best in Class software. The ideal candidate for this role not only is able to produce high quality work quickly but also collaborates with others around them whenever possible, holding the te

Data Architect V

Aditi Consulting

Remote or San Jose, California, USA

Contract

Payrate: $63.74- $63.74/hr. Summary: As a Data Engineer, you will be responsible for designing and implementing data pipelines and architectures that support the collection, transformation, and analysis of data. You will work closely with our Technology and Products Teams to ensure data understanding, security methods assigned and accessibility. Key Responsibilities: Data Pipeline Development: Build and maintain scalable data pipelines using Python, SQL, and SPARK/SPARK SQL to ensure efficient d

Azure Databricks Engineer

Aptino

Remote

Third Party, Contract

Job Description: We are seeking a skilled Platform Engineer with strong expertise in Azure, Databricks, and Snowflake. The ideal candidate will be responsible for configuring and maintaining platform components, ensuring governance alignment, optimizing performance, and evaluating new platform features to support data engineering and analytics initiatives. Key Responsibilities: Align platform configurations with data governance and compliance standards. Evaluate and implement enhancements and ne

Microsoft Fabric

Dyota Tech Solutions

Remote

Contract

Job title MS Fabric Location: 100% remote Duration : Contract Required Skills and Experience: Minimum 8 + years technology experience, preferably in the Microsoft spaceProven experience in designing enterprise-scale data architectures using Microsoft Fabric5 + years experience of Azure SynapseDeep understanding of Microsoft Fabric ecosystem.5 + years experience of ETL/ELT tools, Spark, KQL, and SQL-based data warehousing.5 + years experience with Power BI, particularly DirectLake capabilities

Staff Data Scientist -- Direct Hire -- REMOTE Position (& Citizens ONLY)

Amtex Enterprises

Remote

Full-time

Staff Data Scientist Location: Remote- CST time working hours Salary: DOE QUALIFICATIONS: Master's or PhD degree in a machine learning/AI related field such as engineering, statistics, computer science, or physics 5+ years of industry experience in data science, data analytics, and machine learning in advertising domain Extensive experience in Real-Time Bidding (RTB) systems. Skilled in applying advanced data science methodologies to improve the efficiency, profitability, and competitiveness o

Data Modeler / Data Engineer (Hybrid onsite - W2 Contract)

Xoriant Corporation

Stamford, Connecticut, USA

Contract

Job Title : Data Modeler / Data Engineer Client Location: Stamford. CT (Hybrid 3 - 4 days a week onsite) Contract: W2 Duration: Long term contract Job Description: Total 7-11 years of experience. 50% data modelling, 50% spark & python coding which includes advanced spark Must have 5+ Years of data analyst + Data modelling experience Data Modeling Experience is a must( Erwin tool), should be able to create physical model & logical model. Candidate should be able to write SQL queries. Knowledge

Big Data Hadoop Engineer

Harvey Nash Inc.

Remote

Contract

We are seeking a Big Data Hadoop Engineer for one of our direct client & its a 100% remote opportunity, needing to work in PST time zone. Looking for candidates who can work only on W2 Must Haves Strong experience in Big Data, Cloudera Distribution 7.x, RDBMS development4-5 years of programming experience in Python, Java, Scala, and SQL is must.Strong experience building data pipelines using Hadoop components Sqoop, Hive, SOLR, MR, Impala, Spark, Spark SQL, HBase.Strong experience with REST API

AIOps Google Cloud Platform Engineer/Architect

DynPro Inc.

Remote

Full-time

About the Role: As an AIOps Engineer, you will play a critical role in enhancing the reliability, efficiency, and performance of Google Cloud's vast and complex infrastructure. You will leverage your expertise in Artificial Intelligence and Machine Learning to design, implement, and optimize intelligent automation solutions for IT operations, ultimately improving the experience for our global customers. This position offers a unique opportunity to work on challenging problems at scale, contribut

Google Cloud Platform Data Engineer

Intellect Quest LLC

Remote

Third Party, Contract

Role : Google Cloud Platform Data EngineerLocation: Remote Description: We are seeking a highly motivated and talented Data Engineer to join our dynamic team. As a Data Engineer, you will play a critical role in designing, developing, and implementing data pipelines and data integration solutions using Spark, Scala, Python, and Google Cloud Platform (Google Cloud Platform). You will be responsible for building scalable and efficient data processing systems, optimizing data workflows, and ensur

Data Engineer

Vaco by Highspring

Remote

Contract

Vaco is on the search for a key client as they build out their data engineering team. In this role,as a Data Engineer, your primary responsibility will be to lead the design, development, and implementation of data solutions while driving strategic initiatives across the enterprise. We are looking for a strong background with Azure Data Factory, Kafka, Snowflake, SQL and ETL processes. You will assist with data warehousing architecture design and strategies for data replication, governance, obse

Druid Engineer

Biztec Global LLC

Remote

Full-time

Data Engineer, Distributed Systems Druid Engineer Remote or Austin, Texas KEY RESPONSIBILITIES Design and Development:o Design and implement data ingestion pipelines to load data into Apache Druid.o Develop and optimize Druid schemas and data models for efficient querying and performance.o Design and implement data aggregations against event-level data in distributed database (preferably in Druid)o Migration from existing data stores to Druid Optimization:o Implement best practices for data in

Databricks Engineer

Showman Staffing

Remote

Contract

Job Title: Databricks Engineer Location: Remote - US Job Type: Contract 6 + Months Experience Level: 7+ yrs About the Role We are seeking a highly skilled Databricks Engineer to join our growing data team. You will play a key role in building and optimizing our big data pipelines, implementing scalable data solutions, and collaborating with cross-functional teams to unlock insights from large datasets using Databricks, Apache Spark, and Azure/AWS cloud technologies. Key Responsibilities Des

Databricks Solution Architect

Innova Solutions, Inc

Remote

Full-time

A client of Innova Solutions is looking for a Databricks Solution Architect Position Type: Full-Time Location: Remote Industry: Healthcare As a Databricks Solution Architect, you will: Minimum Qualifications: We are looking for an experienced Databricks Solution Architect to join our team and lead the design, development, and optimization of scalable data and analytics solutions on the Databricks platform. You will play a key role in architecting cloud-native data pipelines, enabling advanced an

Machine Learning Engineer, Core Engineering

Pinterest, Inc.

Remote or San Francisco, California, USA

Full-time

About Pinterest: Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we're on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product. Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other's unique experiences and embrace the flexibility