Apache Spark Jobs in Columbia, MD

Refine Results
1 - 20 of 301 Jobs

Spark/Big Data Developer

The Depository Trust & Clearing Corporation

McLean, Virginia, USA

Full-time

Short Description for Internal Candidates The data engineer role is a technical person who is involved with architecting, building, testing, and maintaining the data platform. Data engineers will implement infrastructure for data processing, analysis, reporting, integrations, and machine learning model deployment Description for Internal Candidates Are you ready to make an impact at DTCC? Do you want to work on innovative projects, collaborate with a dynamic and supportive team, and receive inv

Data Engineer (Spark)

The Depository Trust & Clearing Corporation

McLean, Virginia, USA

Full-time

Job Tittle: Data Engineer Duration: Full-time Location: Mclean, VA/TX/FL/NJ (Hybrid 3 days onsite, Rest days remote) Must Have: Spark Your Primary Responsibilities: Work with large, complex data sets and high throughput data pipelines that meet business requirements. Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources. Build data and analytics tools that utilize the data pipeline to provide actionable insights to ope

Software Engineer-Spark

Veear

Remote

Contract

Title: Software Engineer (Spark) Duration: 03+ months contract (possible extension) Location: Cupertino, CA(Remote) Job Summary: Strong understanding of distributed systems and cloud computing principles.Demonstrated experience with Apache Spark.Extensive hands-on experience and strong understanding of Kubernetes environments, preferably on AWS Cloud.Extensive experience with major cloud providers, especially with AWS services related to computing (EKS, EC2), storage (S3), and networking (VPC, N

Big Data Developer (Spark, Scala, AWS, EMR)

People Force Consulting Inc

Remote

Third Party, Contract

Role: Big Data Developer - Healthcare Remote Minimum: 12+Years Mandatory Skills: SparkScalaAWS EMRAWSJob Description Requirements: Bachelor s degree preferably Computer Science, Engineering, or other quantitative fields6+ years of related experience in designing and implementing enterprise applications using big data5+ years of experience in a senior level engineering role mentoring other engineers, which includes engineering best practices, unblocking, code reviews, unit testing, managing dep

Databricks Developer ( Spark , PySpark ) | Remote

Bramkas Inc.

Remote

Contract

Title: Databricks Developer Experience: 7 + yrs exp Position Type : Contract Location : Remote Must Have Skill : Spark , Pyspark ,Python ,Data BricksWe are seeking a skilled Databricks Developer to join our team . As a Databricks Developer, you will be responsible for designing, building, and maintaining data pipelines and analytics solutions using the Databricks platform. You will collaborate with cross-functional teams to analyze data requirements, develop data models, and implement solutions

Data Architect ( Spark, PySpark, and Python) | Full Time Position | Remote

Bramkas Inc.

Remote

Full-time

Data Architect Location: RemoteEmployment Type: Full-time PositionExperience: 9+ yrs expMust have : Data Architect , Spark , Pyspark , PythonWe are currently seeking a skilled and experienced Data Architect to join our team. The ideal candidate will have a strong background in data architecture, along with expertise in Spark, PySpark, and Python. As a Data Architect, you will play a critical role in designing and implementing data solutions to support our organization's objectives. Responsibili

Senior Spark Data Engineer

Randstad Digital

Remote or Akron, Ohio, USA

Full-time

job summary: Senior Level Data Engineer - Fully REMOTE - Direct Hire! Our client is seeking a Data Engineering Leader to join their team and serve as Subject Matter Expert and Mentor, as they build data pipelines and drive analytic solutions. This position requires a Bachelor's Degree in Computer Science, MIS, or related field, with at least 8-10 years of related experience. Bonus Eligible, Minimal Travel, and Opportunities for career growth! The following skillsets are strongly preferred: Expe

Data Quality Engineer - Spark/PySpark/Databricks - Looking Who Can Work On Our W2

IntelliSavvy

Remote

Contract

Job Description Technical Skills: Azure Databricks, Synapse Analytics, SQL Hyperscale. Python, and PySpark for test automation for test frameworks in Azure environments Familiarity with version control systems and CI/CD pipelines for automated testing and deployment. Familiarity with data modeling, ETL processes, and data warehousing concepts. 6-10 years of experience in QA automation, with 5+ using Spark/PySpark. Key Responsibilities Develop comprehensive test strategies with a clear understa

Software Engineer (Spark)

Bayside Solutions

Remote or

Contract

Software Engineer (Spark) W2 Contract Salary Range: $145,600 - $166,400 per year Location: Seattle, WA - Remote Role Requirements and Qualifications: Strong understanding of distributed systems and cloud computing principles Demonstrated experience with Apache Spark Extensive hands-on experience and strong understanding of Kubernetes environments, preferably on AWS Cloud Experience with major cloud providers, especially with AWS services related to computing (EKS, EC2), storage (S3), and net

Senior Data Engineer - Scala, Spark, Kafka, Azure

BayOne Solutions

Remote

Full-time

Job Title: Senior Data Engineer Job Type: Full Time Remote Eligible: Yes Skills: Scala programming, Spark, Kafka, Azure Responsibilities: Streamline the intake of the raw data into our Azure Data lake.Perform production support and deployment activities.Proactively drive the execution of our core data engineering, business intelligence, and data warehouse frameworksBuild data pipelines from systems such as CRM, Ecommerce etc. with the emphasis on scalability and reliabilityLeverage central data

Spark Scala Developer

Infosys Technologies Ltd

Remote

Full-time

Job Description :In the role of Spark Scala Developer, you will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation, Application Architecture definition and Design. You will play an important role in creating the high-level design artifacts. You will also deliver high quality code deliverables for a module, lead validation for all types of testing and support activities related to i

AWS Data Engineer

Applet Systems

McLean, Virginia, USA

Full-time, Third Party

Title: AWS Data Engineer Locations: Mc Lean, VA, Plano, TX , Chicago, IL (Hybrid) Duration: Long term. W2 only -Mid-Senior level Data Engineer- 5+ Years Data Engineering experience -Python, Spark, AWS and experience working with data pipelines -Strong experience maintaining and building the new data pipelines -EMRs please search for the candidates ( with AWS Certification) and Seniors Must Have cloud Deployment

Sr. Back end Java Developer (Healthcare)

Xoriant Corporation

Washington, District of Columbia, USA

Contract

Job Description: We are looking for an experienced Java Lead resource who also has good experience in Java Frontend and Backend development along with Kafka, DevOps, and OpenShift.Proficiency in Java 8 and above, with a deep understanding of Streams, Lambda expressions, and Concurrent programming.Very strong with min 5 years of hands on experience in Kafka, DevOps, and OpenShift is mandatory.Candidate should have strong development experience in Java and should have end-to-end project experience

AWS Data Architect

Unisoft Technology Inc

Maryland City, Maryland, USA

Contract, Third Party

Looking for AWS Data Architect Must to be local to Maryland, Virginia & District of Columbia (DC). Job Description: Work closely with development teams and customers to design, architect, implement, and support big data solutions. Provide design and development of cloud based solutions and is responsible for technical design and implementation of the architecture. Experience: At least Fifteen (15) years of experience in architecting on-prem/cloud based multi user environments with expertise in

Data Engineer (Snowflake)

Motion Recruitment Partners, LLC

Arlington, Virginia, USA

Full-time

Our client is seeking a Data Engineer to join their team. They work with consumer and voter data to enable their clients to make data-driven strategies and insights. They have been utilizing predictive modeling to advance their advocacy on a local, state, and national, and level. Requirements 5+ years of technical experience PostgreSQL Java / Python ElasticSearch Spark Snowflake Offer / Benefits Medical, dental, and vision PTO and holidays Competitive pay Applicants must be currently authorize

Sr. Java Developer

Xoriant Corporation

Washington, District of Columbia, USA

Contract

Sr. Java Developer Location: Washington DC-Need Only Locals to DC Duration: 12 Months + (Onsite- Hybrid model) Note: The successful candidate should have at least 9 years of experience as a Sr Java Developer, and expertise in managing PHI data. Job Description: We are looking for an experienced Java Lead resource who also has good experience in Java Frontend and Backend development along with Kafka, DevOps, and OpenShift.Proficiency in Java 8 and above, with a deep understanding of Streams, L

Big Data Architect

Rishabh Software Pvt. Ltd

Washington, District of Columbia, USA

Contract, Third Party

Title: Big Data Architect Location: Washington, DC Duration: 12 Months + Possible Extension Candidate needs to have at least 16 years of IT experience The ideal candidate has 16+ years of experience planning, coordinating, and monitoring project activities in an enterprise environment, 5+ years of knowledge of Big Data, Data Architecture, and Implementation best practices, and 10+ years of knowledge of Data-centric systems for the analysis and visualization of data, such as Tableau, MicroStrateg

Data Engineer (TS/SCI)

Motion Recruitment Partners, LLC

Fort Meade, Maryland, USA

Full-time

A provider of analytics and software services for the intelligence and defense communities is seeking a Data Engineer. You would be at the forefront of designing, developing, and validating AI/ML solutions. In summary, this position offer a unique opportunity to shape data-driven transformation. Required Skills & Experience Bachelors in Sciences, Mathematics or Engineering At least 5 years of professional experience in a Data Engineer position Experience with Java, Parquet, Nifi, and Kafka Exper

Data Scientist

Kforce Technology Staffing

Remote or Belcamp, Maryland, USA

Contract

RESPONSIBILITIES: Kforce has a client that is seeking a Data Scientist for a remote role. REQUIREMENTS: * MS or PhD in Data Science and Undergrad in Computer Science or Software Engineering * Experience with Python, Spark, R; MS Azure preferred * AWS cloud experience * Self-driven * Presentation skills * Experience with MS Office, Lucidchart, Visio, etc. The pay range is the lowest to highest compensation we reasonably in good faith believe we would pay at posting for this role. We may ultimat

AI Architect

TEKsystems c/o Allegis Group

Hanover, Maryland, USA

Full-time

Description: The Architect is a dynamic, strategic and creative role. We are seeking a talented, proactive, collaborative, analytical innovator who enjoys building and optimizing elegant solutions to some of AI's most interesting and complex problems. In this role, you may be asked to contribute your skills and ideas to existing programs or in support of business expansion efforts. The successful candidate will possess exceptional customer engagement (written and verbal) skills; will be highly e