Apache Spark Jobs in Annapolis, MD

Refine Results
1 - 20 of 250 Jobs

Spark Platform Engineer

Fynbosys Inc

Remote

Contract

Spark Platform Engineer Location: Remote (100%) Exp: 12 years Apache Spark: Strong understanding and hands-on experience with Apache Spark, including Spark SQL, Spark Streaming. Databricks: Proficiency in using Azure Databricks, including setting up and managing clusters, notebooks, and jobs. Python and SQL: Strong programming skills in either Python and SQL as these are the primary languages used for writing Spark applications. Data Processing and Analysis: Experience in designing and implem

100% REMOTE : PLATFORM DATA ENGINEER - Python, Pyspark, Google Cloud Platform, SQL Tunning, Data Proc, Spark Configure- Minimum 14+ Years - C2C is fine-CH

Empower Professionals

Remote

Third Party, Contract

Hi, I hope everything is fine , Please check the following JD and let me know if you re interested Role: Platform Data Engineer Location: Remote (CST Time) Duration: 12+ Months 14+ Years experience Must have: Data ProcAirflowPySparkSpark configurationPythonSQL tuningGoogle Cloud PlatformData Pipelining Requirements: For this role the engineers with responsibilities to help the platform users.The users are data analysts and data scientists. So we are a data engineering and a platform support t

Data Architect (Azure, DataBricks,Apache Spark, Scala, and Python)

cloudingest inc

Remote

Contract

Data Architect (c2c) 12 years of experience REMOTE Skills-Azure, DataBricks,Apache Spark, Scala, and Python.(Must) Seeking a skilled Data Architect to design and implement data architecture solutions for data-centric projects. The role involves leading the development of enterprise data strategies, creating real-time analytics models, managing data pipelines, and optimizing data processing using various technologies. Key Responsibilities: Design and implement data architecture solutions for dat

Java Back End Developer (Must Have Spark & Data Pipelines Experience)

Apolis

Remote

Contract

Role: Java Back End Developer (Must Have Spark & Data Pipelines Experience) Location: Remote Canada or US Duration: 6-12+ Months Note: Only W2, No C2C (We are looking for candidates with BIG TECH experience) Must Have: 5+ years experience with Java / PythonFamiliarity with technologies such as Spark, Airflow, and Presto (spark is a must have)Familiarity with technologies such as Docker, Airflow, Kubernetes, Terraform, and moreFamiliarity with AWSExperience with a variety of data technologies

Python/Spark/ETL Application Developer - AWS

My IT LLC

Remote

Full-time, Contract

Role: Python/Spark/ETL Application Developer - AWS Location: Richmond, VA (Remote) Contract: 6+ Months possible to extend Job Responsibilities: Able to do analysis of complex business requirements for developers Able to provide expertise and leadership for analysis, design, and modeling tasks Delivery-focused and hands-on Quality-focused Able to design, develop, implement, test, deploy, and support server-less infrastructure in AWS Cloud Able to ensure security and compliance requirements are

Senior Data Engineer - Scala, Spark, Kafka, Azure

BayOne Solutions

Remote

Full-time

Job Title: Senior Data Engineer Job Type: Full Time Remote Eligible: Yes Skills: Scala programming, Spark, Kafka, Azure Responsibilities: Streamline the intake of the raw data into our Azure Data lake.Perform production support and deployment activities.Proactively drive the execution of our core data engineering, business intelligence, and data warehouse frameworksBuild data pipelines from systems such as CRM, Ecommerce etc. with the emphasis on scalability and reliabilityLeverage central data

Senior Data Analyst

Unisoft Technology Inc

On-site in Maryland City, Maryland, USA

Contract, Third Party

Looking for Senior Data Analyst with strong experience in SQL and Python. Candidate should be local to Maryland, Virginia and DC area. Senior Data Analyst At least six (6) years of strong experience in SQLMust have 4 years of practical experience in using relational or NoSQL database and generating complex SQL scripts.Experience validating data at the database level and review data flow across multiple systems.Knowledge of ETL processes, data migration, data conversion, and/or data integrationS

Data Governance Analyst

Unisoft Technology Inc

On-site in Maryland City, Maryland, USA

Third Party, Contract

Looking for Data Governance Analyst with strong experience in ETL and SQL, Python. Title: Data Governance Analyst Type: Onsite and Long term contract Description: At least six (6) years of experience in SQL, Python, Spark, Shell Script.Knowledge of ETL processes, data migration, data conversion, and/or data integration routines and protocols.Comfortable working with database files from multiple sources and format.Strong written and verbal communication skills with experience writing functional

Big Data Architect

Rishabh Software Pvt. Ltd

On-site in Washington, District of Columbia, USA

Third Party, Contract

Title: Big Data Architect Location: Washington, DC Duration: 12 Months + Possible Extension Candidate needs to have at least 16 years of IT experience The ideal candidate has 16+ years of experience planning, coordinating, and monitoring project activities in an enterprise environment, 5+ years of knowledge of Big Data, Data Architecture, and Implementation best practices, and 10+ years of knowledge of Data-centric systems for the analysis and visualization of data, such as Tableau, MicroStrateg

AWS Data Architect

Unisoft Technology Inc

On-site in Maryland City, Maryland, USA

Contract, Third Party

Looking for AWS Data Architect Must to be local to Maryland, Virginia & District of Columbia (DC). Job Description: Work closely with development teams and customers to design, architect, implement, and support big data solutions. Provide design and development of cloud based solutions and is responsible for technical design and implementation of the architecture. Experience: At least Fifteen (15) years of experience in architecting on-prem/cloud based multi user environments with expertise in p

Data Engineer (TS/SCI)

Motion Recruitment Partners, LLC

On-site in Fort Meade, Maryland, USA

Full-time

A provider of analytics and software services for the intelligence and defense communities is seeking a Data Engineer. You would be at the forefront of designing, developing, and validating AI/ML solutions. In summary, this position offer a unique opportunity to shape data-driven transformation. Required Skills & Experience Bachelors in Sciences, Mathematics or Engineering At least 5 years of professional experience in a Data Engineer position Experience with Java, Parquet, Nifi, and Kafka Exper

16+ years Big Data Architect IT Consultant - Washigton, D.C. (onsite)

CapitalTechSolutions Inc

On-site in Washington, District of Columbia, USA

Contract, Third Party

Role : Big Data Architect IT Consultant Master Client : State of DC Location : Washington,D.C. Job description This role will provide expertise to support the development of a Big Data / Data Lake system architecture that supports enterprise data operations for the District of Columbia government, including the Internet of Things (IoT) / Smart City projects, enterprise data warehouse, the open data portal, and data science applications. This is an exciting opportunity to work as a part of a col

Data Engineer (TS/SCI)

Motion Recruitment Partners, LLC

On-site in Suitland-Silver Hill, Maryland, USA

Full-time

A provider of analytics and software services for the intelligence and defense communities is seeking a Data Engineer. You would be at the forefront of designing, developing, and validating AI/ML solutions. In summary, this position offer a unique opportunity to shape data-driven transformation. Required Skills & Experience Bachelors in Sciences, Mathematics or Engineering At least 5 years of professional experience in a Data Engineer position Experience with Java, Parquet, Nifi, and Kafka Exper

AWS Data Engineer

iPivot, LLC

Remote

Contract

A total of 10+ Years of experience is required. Healthcare(Claims) domain knowledge is preferred. Architect, Desgin, Develop and Deploy scalable, high-availability systems on AWS, leveraging serverless technologies and a variety of AWS services like Lambda, API Gateway, S3, DynamoDB, CloudFormation, EventBridge, Step Functions, and AWS Glue, Athena, Redshift. Big Data Technologies: Utilize big data technologies like Python, Spark, DBT, and Iceberg to handle large-scale data processing and analys

Healthcare Data Engineer (HL7 FHIR, Google Cloud Platform)

System Soft Technologies

Remote

Third Party, Contract

System Soft Technologies is widely recognized for its professionalism, strong corporate morals, customer satisfaction, and effective business practices. We provide a full spectrum of business and IT services and solutions, including custom application development, enterprise solutions, systems integration, mobility solutions, and business information management. System Soft Technologies combines business domain knowledge with industry-specific practices and methodologies to offer unique solution

Data Architect

Heliogic LLC

Remote

Full-time

Data Architect Role : FTE only Remote Required Experience: 10 - 20 Years Skills : kafka, spark, python, sql, java Own the end-to-end architecture of the data platform, ensuring its efficiency, cost-effectiveness, security, and governance. Collaborate closely with other engineers to design and build an optimal and cost-efficient platform solution. Work in partnership with other engineers and managers to design and develop foundational elements of the platform. Create tools and frameworks that en

Data Scientist - TS/SCI

Jobot

On-site in Washington, District of Columbia, USA

Full-time

This Jobot Job is hosted by: Eric Williams Are you a fit? Easy Apply now by clicking the "Apply Now" button and sending us your resume. Salary: $110,000 - $150,000 per year A bit about us: This is a government consulting company has been around for the past 10+ years and helps the Federal Government. They help discover cracks in software products which allows them to better understand application security and reinforce operating systems. Why join us? Competitive Base Salary! Extremely Compet

Big Data Engineer

Jobot

On-site in Baltimore, Maryland, USA

Full-time

Leading Edge Technology. Remote! Recognized as one of the best places to work! Great Benefits! This Jobot Job is hosted by: Brooke Meyer Are you a fit? Easy Apply now by clicking the "Apply Now" button and sending us your resume. Salary: $120,000 - $170,500 per year A bit about us: Serving the marketing and advertising industry. We bring together real time survey data and insights on millions of consumers. We provide this insightful data about online behavior all in one platform. Why join us

AlloyDB Developer with Google Cloud Platform

HAN IT Staffing Inc.

Remote

Contract, Third Party

Design, implement, and maintain AlloyDB solutions on the Google Cloud Platform.Collaborate with development teams to optimize data models, queries, and database performance.Perform AlloyDB installations, upgrades, and patch management following best practices.Monitor and ensure the availability, integrity, and security of AlloyDB databases.Implement and maintain backup and recovery strategies to safeguard data and ensure business continuity.Collaborate with DevOps teams to automate routine Alloy

Data engineer

Intellisoft Technologies

Remote

Full-time

THIS POSITION IS W2 CONTRACT Cloud Data Engineer Remote RESPONSIBILITIES Supporting and modernizing existing data integrations.Crafting and maintaining efficient data pipeline architecture.Assembling large, complex data sets that meet business requirements.Design and maintain schemas.Monitor, manage, and troubleshoot Boomi processes. Create and maintain optimal data pipeline/flow architecture.Identifying, crafting, and implementing internal process improvements: automating manual processes, opt