Apache Spark Jobs in Washington, DC

Refine Results
1 - 20 of 312 Jobs

Spark/Big Data Developer

The Depository Trust & Clearing Corporation

•

McLean, Virginia, USA

Full-time

Short Description for Internal Candidates The data engineer role is a technical person who is involved with architecting, building, testing, and maintaining the data platform. Data engineers will implement infrastructure for data processing, analysis, reporting, integrations, and machine learning model deployment Description for Internal Candidates Are you ready to make an impact at DTCC? Do you want to work on innovative projects, collaborate with a dynamic and supportive team, and receive inv
Posted 60+ days ago | Updated 11 hours ago

Data Engineer (Spark)

The Depository Trust & Clearing Corporation

•

McLean, Virginia, USA

Full-time

Job Tittle: Data Engineer Duration: Full-time Location: Mclean, VA/TX/FL/NJ (Hybrid 3 days onsite, Rest days remote) Must Have: Spark Your Primary Responsibilities: Work with large, complex data sets and high throughput data pipelines that meet business requirements. Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources. Build data and analytics tools that utilize the data pipeline to provide actionable insights to ope
Easy Apply
Posted 55 days ago | Updated 2 hours ago

Software Engineer-Spark

Veear

•

Remote

Contract

Title: Software Engineer (Spark) Duration: 03+ months contract (possible extension) Location: Cupertino, CA(Remote) Job Summary: Strong understanding of distributed systems and cloud computing principles.Demonstrated experience with Apache Spark.Extensive hands-on experience and strong understanding of Kubernetes environments, preferably on AWS Cloud.Extensive experience with major cloud providers, especially with AWS services related to computing (EKS, EC2), storage (S3), and networking (VPC, N
Easy Apply
Posted 8 days ago | Updated moments ago

Big Data Developer (Spark, Scala, AWS, EMR)

People Force Consulting Inc

•

Remote

Contract, Third Party

Role: Big Data Developer - Healthcare Remote Minimum: 12+Years Mandatory Skills: SparkScalaAWS EMRAWSJob Description Requirements: Bachelor s degree preferably Computer Science, Engineering, or other quantitative fields6+ years of related experience in designing and implementing enterprise applications using big data5+ years of experience in a senior level engineering role mentoring other engineers, which includes engineering best practices, unblocking, code reviews, unit testing, managing dep
Easy Apply
Posted 4 hours ago

Databricks Developer ( Spark , PySpark ) | Remote

Bramkas Inc.

•

Remote

Contract

Title: Databricks Developer Experience: 7 + yrs exp Position Type : Contract Location : Remote Must Have Skill : Spark , Pyspark ,Python ,Data BricksWe are seeking a skilled Databricks Developer to join our team . As a Databricks Developer, you will be responsible for designing, building, and maintaining data pipelines and analytics solutions using the Databricks platform. You will collaborate with cross-functional teams to analyze data requirements, develop data models, and implement solutions
Easy Apply
Posted 10 days ago | Updated 9 days ago

Data Architect ( Spark, PySpark, and Python) | Full Time Position | Remote

Bramkas Inc.

•

Remote

Full-time

Data Architect Location: RemoteEmployment Type: Full-time PositionExperience: 9+ yrs expMust have : Data Architect , Spark , Pyspark , PythonWe are currently seeking a skilled and experienced Data Architect to join our team. The ideal candidate will have a strong background in data architecture, along with expertise in Spark, PySpark, and Python. As a Data Architect, you will play a critical role in designing and implementing data solutions to support our organization's objectives. Responsibili
Easy Apply
Posted 17 days ago | Updated 9 days ago

Senior Spark Data Engineer

Randstad Digital

•

Remote or Akron, Ohio, USA

Full-time

job summary: Senior Level Data Engineer - Fully REMOTE - Direct Hire! Our client is seeking a Data Engineering Leader to join their team and serve as Subject Matter Expert and Mentor, as they build data pipelines and drive analytic solutions. This position requires a Bachelor's Degree in Computer Science, MIS, or related field, with at least 8-10 years of related experience. Bonus Eligible, Minimal Travel, and Opportunities for career growth! The following skillsets are strongly preferred: Expe
Posted 1 day ago | Updated 2 hours ago

Data Quality Engineer - Spark/PySpark/Databricks - Looking Who Can Work On Our W2

IntelliSavvy

•

Remote

Contract

Job Description Technical Skills: Azure Databricks, Synapse Analytics, SQL Hyperscale. Python, and PySpark for test automation for test frameworks in Azure environments Familiarity with version control systems and CI/CD pipelines for automated testing and deployment. Familiarity with data modeling, ETL processes, and data warehousing concepts. 6-10 years of experience in QA automation, with 5+ using Spark/PySpark. Key Responsibilities Develop comprehensive test strategies with a clear understa
Easy Apply
Posted 7 days ago | Updated moments ago

Software Engineer (Spark)

Bayside Solutions

•

Remote or

Contract

Software Engineer (Spark) W2 Contract Salary Range: $145,600 - $166,400 per year Location: Seattle, WA - Remote Role Requirements and Qualifications: Strong understanding of distributed systems and cloud computing principles Demonstrated experience with Apache Spark Extensive hands-on experience and strong understanding of Kubernetes environments, preferably on AWS Cloud Experience with major cloud providers, especially with AWS services related to computing (EKS, EC2), storage (S3), and net
Easy Apply
Posted 8 days ago | Updated 3 hours ago

Senior Data Engineer - Scala, Spark, Kafka, Azure

BayOne Solutions

•

Remote

Full-time

Job Title: Senior Data Engineer Job Type: Full Time Remote Eligible: Yes Skills: Scala programming, Spark, Kafka, Azure Responsibilities: Streamline the intake of the raw data into our Azure Data lake.Perform production support and deployment activities.Proactively drive the execution of our core data engineering, business intelligence, and data warehouse frameworksBuild data pipelines from systems such as CRM, Ecommerce etc. with the emphasis on scalability and reliabilityLeverage central data
Easy Apply
Posted 60+ days ago | Updated 3 days ago

Spark Scala Developer

Infosys Technologies Ltd

•

Remote

Full-time

Job Description :In the role of Spark Scala Developer, you will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation, Application Architecture definition and Design. You will play an important role in creating the high-level design artifacts. You will also deliver high quality code deliverables for a module, lead validation for all types of testing and support activities related to i
Easy Apply
Posted 10 days ago

AWS Data Engineer

Applet Systems

•

McLean, Virginia, USA

Full-time, Third Party

Title: AWS Data Engineer Locations: Mc Lean, VA, Plano, TX , Chicago, IL (Hybrid) Duration: Long term. W2 only -Mid-Senior level Data Engineer- 5+ Years Data Engineering experience -Python, Spark, AWS and experience working with data pipelines -Strong experience maintaining and building the new data pipelines -EMRs please search for the candidates ( with AWS Certification) and Seniors Must Have cloud Deployment
Easy Apply
Posted 10 days ago | Updated 9 days ago

Sr. Back end Java Developer (Healthcare)

Xoriant Corporation

•

Washington, District of Columbia, USA

Contract

Job Description: We are looking for an experienced Java Lead resource who also has good experience in Java Frontend and Backend development along with Kafka, DevOps, and OpenShift.Proficiency in Java 8 and above, with a deep understanding of Streams, Lambda expressions, and Concurrent programming.Very strong with min 5 years of hands on experience in Kafka, DevOps, and OpenShift is mandatory.Candidate should have strong development experience in Java and should have end-to-end project experience
Easy Apply
Posted 7 days ago | Updated 2 days ago

Data Engineer (Snowflake)

Motion Recruitment Partners, LLC

•

Arlington, Virginia, USA

Full-time

Our client is seeking a Data Engineer to join their team. They work with consumer and voter data to enable their clients to make data-driven strategies and insights. They have been utilizing predictive modeling to advance their advocacy on a local, state, and national, and level. Requirements 5+ years of technical experience PostgreSQL Java / Python ElasticSearch Spark Snowflake Offer / Benefits Medical, dental, and vision PTO and holidays Competitive pay Applicants must be currently authorize
Easy Apply
Posted 30 days ago | Updated 11 hours ago

Sr. Java Developer

Xoriant Corporation

•

Washington, District of Columbia, USA

Contract

Sr. Java Developer Location: Washington DC-Need Only Locals to DC Duration: 12 Months + (Onsite- Hybrid model) Note: The successful candidate should have at least 9 years of experience as a Sr Java Developer, and expertise in managing PHI data. Job Description: We are looking for an experienced Java Lead resource who also has good experience in Java Frontend and Backend development along with Kafka, DevOps, and OpenShift.Proficiency in Java 8 and above, with a deep understanding of Streams, L
Easy Apply
Posted 9 days ago | Updated 7 days ago

Big Data Architect

Rishabh Software Pvt. Ltd

•

Washington, District of Columbia, USA

Third Party, Contract

Title: Big Data Architect Location: Washington, DC Duration: 12 Months + Possible Extension Candidate needs to have at least 16 years of IT experience The ideal candidate has 16+ years of experience planning, coordinating, and monitoring project activities in an enterprise environment, 5+ years of knowledge of Big Data, Data Architecture, and Implementation best practices, and 10+ years of knowledge of Data-centric systems for the analysis and visualization of data, such as Tableau, MicroStrateg
Easy Apply
Posted 59 days ago | Updated 8 hours ago

SDET - Crypto

Tential

•

Rockville, Maryland, USA

Contract

Java or Python Test plan and test case development Owning and maintaining test framework Data pipeline or ETL experience (Airflow, dbt, dagster) Big Data (Spark / EMR) AWS CI/CD and continuous testing Nice to have: Experience testing pipelines with ML models embedded Crypto (development or testing of apps for blockchain, or tokens) #LI-WB #Dice
Easy Apply
Posted 23 days ago | Updated 11 hours ago

AWS Data Architect

Unisoft Technology Inc

•

Maryland City, Maryland, USA

Third Party, Contract

Looking for AWS Data Architect Must to be local to Maryland, Virginia & District of Columbia (DC). Job Description: Work closely with development teams and customers to design, architect, implement, and support big data solutions. Provide design and development of cloud based solutions and is responsible for technical design and implementation of the architecture. Experience: At least Fifteen (15) years of experience in architecting on-prem/cloud based multi user environments with expertise in
Easy Apply
Posted 1 day ago | Updated 3 hours ago

Data Engineer

QinetiQ US

•

McLean, Virginia, USA

Full-time

Company Overview We are a world-class team of professionals who deliver next generation technology and products in robotic and autonomous platforms, ground, soldier, and maritime systems in 50+ locations world-wide. Much of our work contributes to innovative research in the fields of sensor science, signal processing, data fusion, artificial intelligence (AI), machine learning (ML), and augmented reality (AR). QinetiQ US's dedicated experts in defense, aerospace, security, and related fields a
Posted 13 days ago | Updated 2 hours ago

Data Engineer

QinetiQ

•

McLean, Virginia, USA

Full-time

Company Overview We are a world-class team of professionals who deliver next generation technology and products in robotic and autonomous platforms, ground, soldier, and maritime systems in 50+ locations world-wide. Much of our work contributes to innovative research in the fields of sensor science, signal processing, data fusion, artificial intelligence (AI), machine learning (ML), and augmented reality (AR). QinetiQ US's dedicated experts in defense, aerospace, security, and related fields all
Posted 16 days ago | Updated 2 hours ago