big data engineer (spark) Jobs in boston, ma

Refine Results
21 - 40 of 73 Jobs

Azure Data Engineer

Princeton IT Services

Boston, Massachusetts, USA

Contract

Job Title: Azure Data Engineer Location: Boston, MA Role Type: Contract Role Overview: We are seeking a highly skilled Azure Data Engineer with expertise in data migration from Big Data platforms to Azure Data Factory (ADF) to join our team. The ideal candidate will have a strong background in designing and executing complex data migration projects, with a focus on leveraging Azure cloud technologies. As an Azure Data Engineer, you will play a key role in migrating data from various Big Data

Data Engineer

CGT Staffing

Remote

Full-time

No C2c Candidates Essential Duties & Responsibilities Analyze and organize raw data sets to meet both functional and non-functional requirements Develop and maintain data sets Improve data quality and efficiency Create scalable, production-ready pipelines for data movement and transformation Work with various stakeholders, including data, design, product, and executive teams, to assist with data-related technical issues Implement and enhance support tools for monitoring and acting on data pipeli

Database Administrator (100% Remote - W2 Only)

Performix Business Services, LLC

Remote

Contract

Database infrastructure administer, test, and implement databases, applying knowledge of database management systems. Database Engineer Responsibilities and Duties:Assist in design and development of distributed database systems.Optimize database systems for performance and reliability.Perform database maintenance and troubleshooting activities.Test database systems and perform bug fixes.Provide database solutions based on technical documents and business requirements.Provide technical assistanc

Azure Data Engineer

P2PSoftTek Inc

Remote

Contract

Azure Data Engineer Location- Remote Job Type-Long Term Description Min 5 years of experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, AWS, Google Cloud Platform, Data Bricks etc. Azure experience is preferred over other cloud platforms. 10 + years of proven experience with SQL, schema design and dimensional data modelling. Hands on experience in SQL is a MUST. Solid knowledge of data warehouse best practices, development standards and me

Senior Data Engineer

iSpace, Inc

Remote

Contract

JOB DETAILS: Title: Senior Data Engineer Location: Remote Work (Team is based out in Century City, CA and NYC, NY) Type: 06 -12 plus months contract (extendable) Job Description: Looking for Senior Data Engineer with a passion for building robust, scalable, efficient, and high-quality Data Engineering solutions to join our Engineering team. If you enjoy designing and building innovative data engineering solutions using the latest tech stack in a fast-paced environment, this role is for you. P

Data Engineer

CGT Staffing

Remote

Full-time

Essential Duties & Responsibilities Analyze and organize raw data sets to meet both functional and non-functional requirements Develop and maintain data sets Improve data quality and efficiency Create scalable, production-ready pipelines for data movement and transformation Work with various stakeholders, including data, design, product, and executive teams, to assist with data-related technical issues Implement and enhance support tools for monitoring and acting on data pipeline issues Interpre

Sr. Data Engineer(Data Bricks Certified)

Amiseq Inc.

Remote

Contract

1. 4+ Years Data Engineering Experience, 5+ years of consulting experience 2. Completed Data Engineering Professional certification & required classes 3. Minimum 2-3 projects delivered with hands-on experience in Databricks 4. Completed Apache Spark Programming with Databricks, Data Engineering with Databricks, Optimizing Apache SparkTM on Databricks 5. Experience in Spark and/or Hadoop, Flink, Presto, other popular big data engines 6. Familiarity with Databricks multi-hop pipeline architecture

Data Engineer (L4) - Privacy

Netflix, Inc.

Remote

Full-time

Netflix is enjoyed by more than 230 million members globally, entertaining new audiences every day. We are in the midst of major transformative developments for the Netflix product with the launch of an Advertising-supported plan, Games, and Live content. These new products, alongside our streaming service, have resulted in significant increases in the complexity and breadth of our internal data ecosystem. We manage one of the largest paid subscription businesses and are committed to handling ou

Data Engineer

Sparibis, LLC

Remote

Full-time

Location: 100% Remote Years Experience: 3+; 10+ years (Jr and Sr Level available) Education: Bachelor s in IT related field Work Authorization: Must show that applicant is legally permitted to work in the United States. Clearance: Applicants must be able to meet the requirements to obtain an Public Trust security clearance. NOTE: United States Citizenship is required to be eligible to obtain this security clearance. Key Skills: 10+ years of IT experience focusing on enterprise data architecture

Senior Scala Software Engineer

JBC powered by Workgenius

Remote

Contract

Senior Software Engineer (Java / Scala) with Top Mass Media & Entertainment Company Senior Software Engineer (Java / Scala) Location: Remote Rate: up to $88.00/HR W2 Duration: 18 months Summary: The Ad Intelligence team is under Ad Platforms and its mission is to transform advertising and the Ad platform with data and AI across TV and streaming video. We build solutions to measure and optimize every aspect of the advertising life cycle. Our tenant is a strong cross-domain team to deliver E2E sol

Senior Data Engineer

iPivot, LLC

Remote

Contract

Job Details: Senior Data Engineer (AWS/ AZURE, Python, Spark, Glue, Athena)A total of 10+ Years of experience is required.Healthcare(Claims) domain knowledge is preferred.Architect, Design, Develop and Deploy scalable, high-availability systems on AWS or Azure , leveraging serverless technologies and a variety of AWS or Azure services like Lambda, API Gateway, S3, DynamoDB, CloudFormation, Event Bridge, Step Functions, and AWS Glue, Athena, Redshift.Big Data Technologies: Utilize big data techno

Data Engineer (L5) - Privacy

Netflix, Inc.

Remote

Full-time

Netflix is enjoyed by more than 230 million members globally, entertaining new audiences every day. We are in the midst of major transformative developments for the Netflix product with the launch of an Advertising-supported plan, Games, and Live content. These new products, alongside our streaming service, have resulted in significant increases in the complexity and breadth of our internal data ecosystem. We manage one of the largest paid subscription businesses and are committed to handling ou

Senior Data Engineer

CodeMax Consulting, LLC

Remote or Arkansas, USA

Full-time, Third Party, Contract

Responsibilities: Design, construct, install, test, and maintain highly scalable data management systems on Azure and AWS, utilizing services such as Azure Data Lake, Azure Data Factory, AWS S3, and AWS Glue. Integrate new data management technologies and software engineering tools into existing structures, focusing on Azure and AWS ecosystems. Utilize Azure Databricks and AWS EMR for big data processing tasks to create data set processes for data modeling, mining, and production. Develop analy

Sr. Data Engineer- REMOTE

Comcast Corporation

Remote or Erie, Pennsylvania, USA

Full-time

FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we're making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can insert advertisements around the world. Job Summary Comcast brings together the best in media and technology. We drive innovation to create th

Sr. Data Engineer- REMOTE

Comcast Corporation

Remote or Pittsburgh, Pennsylvania, USA

Full-time

FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we're making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can insert advertisements around the world. Job Summary Comcast brings together the best in media and technology. We drive innovation to create th

Sr. Data Engineer- REMOTE

Comcast Corporation

Remote or York, Pennsylvania, USA

Full-time

FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we're making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can insert advertisements around the world. Job Summary Comcast brings together the best in media and technology. We drive innovation to create th

Sr. Data Engineer- REMOTE

Comcast Corporation

Remote or Norristown, Pennsylvania, USA

Full-time

FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we're making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can insert advertisements around the world. Job Summary Comcast brings together the best in media and technology. We drive innovation to create th

Sr. Data Engineer- REMOTE

Comcast Corporation

Remote or Philadelphia, Pennsylvania, USA

Full-time

FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we're making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can insert advertisements around the world. Job Summary Comcast brings together the best in media and technology. We drive innovation to create th

DevOps Engineer with RedHat OpenShift

EITAcies, Inc.

Remote or Bedminster, New Jersey, USA

Full-time, Part-time, Third Party, Contract

About US : Since 2008, EITACIES has been a beacon of innovation, crafting tailored tech solutions. From humble beginnings, we've grown globally, nurturing client relationships and adapting to digital shifts. Today, we're a tech powerhouse, delivering customized excellence from startups to Fortune 500, State & Federal clients. Any of the following Certifications are a big plus Certified Kubernetes Administrator (CKA) Red Hat Certified OpenShift Administrator Job Summary: 10+ Year of overall IT

Data Engineer (L5)

Netflix, Inc.

Remote

Full-time

At Netflix, our mission is to entertain the world. With 200+ million paid members in over 190 countries on millions of devices; enjoying TV series, documentaries, and feature films across a wide variety of genres and languages - Netflix is reinventing entertainment from end to end. We are revolutionizing how shows and movies are produced, pushing technological boundaries to efficiently deliver streaming video at a massive scale over the internet, and continuously improving the end-to-end user ex