Apache spark jobs in columbia, md

Databricks Azure Consultant with Apache Spark- Onsite NJ- and - no corps

Remote or Jersey City, New Jersey

•

Today

Please contact Renu Goel Location: NJ - No corps Must Haves: -Azure -Databricks -Apache Spark -CI/CD Databricks / Azure Consultant Job Summary Seeking two experienced Databricks / Azure Consultants to support the design, implementation, and ongoing development of the Databricks data platform. The consultants will work with technology and data teams to build and enhance scalable data solutions using Databricks and Microsoft Azure, with a strong focus on data engineering, integration, securit

Easy Apply

Full-time

Competitive

Senior AI Engineer, Databricks, ML, Spark ML

Remote

•

Today

We are looking for a Senior AI Engineer to build, test, and deploy ML and GenAI components for asset onboarding, industrial diagnostics, and device analytics on Databricks. This specialist will create predictive models, anomaly-detection algorithms, RAG pipelines, document extraction, and AI agent capabilities. Responsibilities Construct, test, and deploy ML and GenAI components on Databricks Create predictive models for asset onboarding and device analytics Architect and implement anomaly-detec

Full-time

Lead Data Software Engineer with Databricks with Apache Kafka, Apache Spark, Kubernetes

Remote

•

Today

We are looking for a Lead Data Software Engineer to drive the migration of an existing data analytics platform, originally built on Azure resources such as Data Factory, Databricks, Event Hub, and Cassandra, to a cloud-agnostic platform deployable on-premises. Responsibilities Implement streaming and batch Spark pipelines running on Kubernetes Lead the implementation of objects within the data generator framework Oversee deployment and testing across local and development environments Drive impr

Full-time

Lead AI Engineer with Spark, AWS Services

Remote

•

Today

We're looking for a Lead AI Engineer skilled in Spark and AWS Services to become part of the RBQM Production Pod within the program. In this position, you'll construct and sustain data pipelines that drive AI/GenAI applications supporting Risk-Based Quality Management for clinical trials. The primary focus of this role includes RAG document ingestion, vector indexing, and developing data APIs for AI applications. Responsibilities Architect and construct RAG document ingestion pipelines (chunking

Full-time

Senior Data Software Engineer/ Databricks, Apache Spark, PySpark

Remote

•

Today

We are seeking a skilled Senior Data Software Engineer with strong expertise in PySpark , SQL , and unit testing to join our data engineering team. The ideal candidate will have hands-on experience with Apache Spark , preferably within the Databricks environment, and will be responsible for building scalable data pipelines, optimizing data workflows, and ensuring code quality through rigorous testing practices. Responsibilities Design, develop, and maintain scalable data pipelines using Apache S

Full-time

Senior Data Software Engineer/ AI Agents, Azure, Spark

Remote

•

Today

We are looking for an experienced Senior Data Software Engineer with strong hands-on expertise in Azure and the Spark ecosystem , primarily focused on building and maintaining data transformation pipelines. The candidate should be comfortable with any Spark-adjacent technology (PySpark, Spark SQL, Scala Spark, Databricks, Synapse, etc.) rather than being locked into one specific flavor. Experience with Microsoft Fabric is a strong plus but not a requirement. The ideal candidate combines great te

Full-time

Data Management Specialist - Data Bricks

Washington, District of Columbia

•

16d ago

Job Title: Data Management Specialist Location: Washington, DC (onsite) Type: Contract Compensation: $52.99/HR on W2 We are looking for a highly skilled Databricks Admin to serve as the go-to technical authority for all things Databricks within our organization. The ideal candidate will have deep expertise in the Databricks Lakehouse platform, including data engineering, data science, machine learning workflows, performance optimization, and best practices for scalable data solutions. This role

Easy Apply

Contract

Depends on Experience

Senior AI Engineer with Spark, AWS Services

Remote

•

Today

We are seeking a Senior AI Engineer with Spark and AWS Services expertise to join the RBQM Production Pod within the program. You will build and maintain data pipelines that power AI/GenAI applications for Risk-Based Quality Management in clinical trials. This role focuses on RAG document ingestion, vector indexing, and building data APIs for AI applications. Responsibilities Design and build RAG document ingestion pipelines (chunking, embedding, vector indexing) for clinical trial quality data

Full-time

Remote Data Engineer (Snowflake, Spark/Scala)

Remote or Jacksonville, Florida

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Remote Data Engineer (Snowflake and Spark/Scala) for a contract assignment with one of our premier Healthcare Services clients in Jacksonville, FL . This role will be remote. Top Skills Needed: Snowflake Spark/Scala Responsibilities : Development, programming, coding of Information Technology solutions. Documenting detailed system specifications, participation in unit testing and maintenance of planned and unplanned internally dev

Contract

USD 50.00 - 55.00 per hour

Remote Sr. IT Developer with Hadoop & Spark

Remote or Jacksonville, Florida

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Sr. IT Developer with Hadoop & Spark for a contract assignment with one of our premier Healthcare Services clients in Jacksonville, FL . This role will be remote. Top Experience Needed: -HBASE/Scala/Spark development required (all three) -Experience using Hadoop Distributed File System (HDFS) required -Development experience with Kafka required -Data warehousing experience required Responsibilities : Responsible for the design, d

Contract

USD 62.86 - 67.86 per hour

Senior Data Engineer

McLean, Virginia

•

23d ago

Job OverviewWe are seeking a Senior Data Engineer to join a large-scale banking data migration initiative supporting the integration of Discover and Capital One platforms. The team is responsible for migrating and processing high volumes of customer and transactional data across banking products, including checking, savings, money market accounts, IRAs, and CDs. This is a data engineering and data pipeline-focused role, with a strong emphasis on Java, Spring Boot, Scala, Spark/PySpark, and AWS d

Easy Apply

Contract

65 - 80

Software Engineer 2 - Spark/MapReduce/SQL/NoSQL/Pandas/Numpy/SciPy

Annapolis, Maryland

•

Today

Build to something to be proud of. Captivation has built a reputation on providing customers exactly what is needed in a timely manner. Our team of engineers take pride in what they develop and constantly innovate to provide the best solution. Captivation is looking for software developers who can get stuff done while making a difference in support of the mission to protect our country. Description Captivation Software is looking for a mid level software engineer who will performing as a Clou

Full-time

USD 130,000.00 - 270,000.00 per year

Software Engineer 2 (Hybrid) - Linux/Bash/Apache Airflow/Apache Spark/Docker/Podman/Git/AWS

Annapolis, Maryland

•

Today

Full-time

USD 130,000.00 - 270,000.00 per year

Software Engineer 3 - (Python, Java, Apache Spark)

Fort Meade, Maryland

•

Today

Software Engineer 3 - (Python, Java, Apache Spark) Clearance: TS/SCI - Polygraph required Position ID: 02-492-SWE3 Location: Fort Meade, Maryland Description: The Software Engineer designs, develops, tests, deploys, documents, maintains, and enhances complex and diverse software systems based upon documented requirements. These systems might include, but are not limited to, processing-intensive analytics, novel algorithm development, manipulation of extremely large data sets, real-time system

Full-time

USD 218,000.00 - 266,000.00 per year

Software Engineer 2 - (Cloud, Analytics, Spark)

Annapolis, Maryland

•

Today

Software Engineer 2 - (Cloud, Analytics, Spark) Clearance: TS/SCI - Polygraph required Position ID: 25-SS-8838-SWE2 Location: Annapolis Junction, Maryland Description: The Software Engineer develops, maintains, and enhances complex and diverse software systems (e.g., processing-intensive analytics, novel algorithm development, manipulation of extremely large data sets, real-time systems, and business management information systems) based upon documented requirements. Works individually or as

Full-time

USD 208,000.00 - 254,000.00 per year

Data Software Engineer (Annapolis Junction, MD)

Annapolis, Maryland

•

Today

**Active TS/SCI w/Polygraph REQUIRED** Please do not apply if you do not currently possess this level of clearance. Telework: None Basic Requirements: 14 years of experience as a software engineer Bachelor's degree in a technical discipline 4 additional years of experience as a software engineer may be substituted for a degree Job Description: Develop, maintain and enhance complex and diverse software systems. Essential Duties and Responsibilities: Analyze user requirements to derive software de

Full-time

USD 220,000.00 - 230,000.00 per year

Senior Databricks DevOps Engineer

Washington, District of Columbia

•

8d ago

Senior Databricks DevOps Engineer Location: Washington, DC Employment Type: Full-Time Experience: 8+ Years Clearance: Public Trust / Secret (U.S. Citizenship required) About the Role Satsyil Corp is seeking an experienced Senior Databricks DevOps Engineer to design, automate, and maintain enterprise-scale Databricks environments. You will build the platform foundations that let data engineers, data scientists, and analysts work efficiently and securely. You'll own CI/CD pipelines, infrastructure

Easy Apply

Full-time

Depends on Experience

AWS Cloud Engineer

McLean, Virginia

•

Today

Detailed Job Description: Title: Cloud Engineer Professional Location: McLean, VA 22102 (5 Days onsite) Mode: 6 Months Contract (Possible extension) Job Description: Hands-on experience developing and supporting cloud-based data pipelines and applications on AWSHands-on experience with AWS services including S3, Glue, EMR, Lambda, Step Functions, CloudWatch, CloudTrail, SNS, SQS, EC2, VPC, RDS, and IAM Proficiency in Python and/or PySpark/Spark Experience with ETL and Data Integration tools such

Easy Apply

Contract

$50 - $65

Watsonx.data Consultant with Spark and scala experience

Remote

•

28d ago

Hi, Watsonx.data Consultant with Spark and scala experience Remote 6 months Required Skills: databricks or watsonx.data Spark Scala Sincerely, Sr. Manager nFolks Data Solutions LLC Phone: Email:

Easy Apply

Third Party, Contract

Depends on Experience

Architectural Designer, Community

McLean, Virginia

•

Today

Little, nationally recognized as a "Best Firm to Work For" and one of the nation's most progressive design firms, is seeking an Architectural Designer with a passion for high quality design and a positive, collaborative work style, for our growing Community Studio in our DC (Tysons Corner) office. Responsibilities include: Providing conceptual design and design support documentation (Conceptual physical and digital models, renderings, diagrams, technical drawings) as part of teams working on a

Full-time

Apache spark jobs in Columbia, MD, USA