Lead Data Platform Engineer

Overview

On Site
Full Time

Skills

Big Data
Project Management
Cross-functional Team
Training
Innovation
Data Management
COTS
Cyber Security
STIG
Storage
Artificial Intelligence
Machine Learning (ML)
Leadership
Software Design
Prototyping
Decision-making
Security Clearance
Software Engineering
Cloud Architecture
SAN
Linux
System Administration
Databricks
Apache Spark
Data Processing
Management
Extract
Transform
Load
Apache Airflow
Python
Bash
Scripting
Programming Languages
Continuous Integration
Continuous Delivery
DevSecOps
Communication
Collaboration
Computer Science
Amazon Web Services
Cloud Computing
Open Source
Database
PostgreSQL
MongoDB
Data Engineering
Workflow
Data Governance
Meta-data Management
Regulatory Compliance
DoD
SAP BASIS
Law
FOCUS

Job Details

Job Description

ECS is seeking a Lead Data Platform Engineer to work in our Fairfax, VA office.

Position Overview:

ECS is seeking a Lead Data Platform Engineer to support the development of a next-generation data management platform focused on Artificial Intelligence/Machine Learning (AI/ML) and Big Data/Cloud Solutions. This is not a project management role; however, it requires strong leadership and hands-on technical expertise in areas such as cloud architecture, data engineering, and compliance. The candidate will collaborate closely with the Project Manager and a cross-functional team of engineers and scientists to design, build, and deploy a scalable platform that ingests data from multiple sources, performs ETL operations, and produces curated datasets for AI/ML training. The ideal candidate fosters a culture of innovation, collaboration, and technical excellence in a mission-driven environment.

Position Description:

The Lead Data Platform Engineer will define the technical vision and lead the design and implementation of a secure, scalable, and compliant data management platform incorporating a mix of COTS and open-source components. This individual will partner with the Project Manager to guide a multidisciplinary team including data engineers, data scientists, DevSecOps specialists, cloud engineers, and cybersecurity professionals.

Key responsibilities include:
  • Leading the design and deployment of AWS-based environments to support IL5/IL6 requirements.
  • Building and managing data pipelines using Databricks, Apache Spark, and related ETL technologies (e.g., AWS Glue, Apache Airflow).
  • Ensuring compliance with DoD security and accreditation standards, including STIGs and Impact Level controls.
  • Providing architectural oversight on data ingestion, curation, and storage to produce reliable, high-quality datasets for AI/ML vendors.
  • Supporting DevSecOps practices, CI/CD pipelines, and automation to streamline delivery.
  • Acting as the primary technical interface with project stakeholders, ensuring alignment between technical execution and mission needs.
This role blends hands-on technical work and architectural leadership, with direct involvement in solution design, prototyping, and technical decision-making.

Required Skills

  • Active Secret clearance and eligible for a Top-Secret Clearance with the capability of obtaining SCI / CI-Poly to meet contract requirements.
  • 10+ years of experience in software engineering, data engineering, or cloud architecture.
  • Strong expertise with AWS cloud services (compute, storage, networking, IAM).
  • Proficiency with Linux Environments (system administration, scripting, troubleshooting).
  • Hands-on experience with Databricks and Apache Spark for large-scale data processing.
  • Proficiency in building and managing ETL pipelines (e.g. AWS Glue, Apache Airflow).
  • Strong understanding of data engineering principles, including data ingestion, transformation, and curation workflows.
  • Proficient in Python, Bash, or equivalent scripting/programming languages used in cloud and data environments.
  • Experience implementing CI/CD pipelines and modern DevSecOps workflows.
  • Demonstrated ability to work in a fast paced matrixed, multidisciplinary team environment.
  • Strong communication skills with the ability to interface and collaborate with project managers, stakeholders, vendors, and technical staff.


Desired Skills

  • Master's degree in Computer Science or related technical field.
  • AWS Professional-level certifications (e.g., AWS Solutions Architect Professional).
  • Experience with cloud-native or open-source databases (e.g., PostgreSQL, MongoDB) for supporting data engineering workflows.
  • Experience with data governance, metadata management, and compliance frameworks.
  • Prior experience supporting DoD, Intelligence Community, or other U.S. Government programs.
  • Understanding of security accreditation processes for IL5/IL6 environments.
#ECS1

ECS is an equal opportunity employer and does not discriminate or allow discrimination on the basis any characteristic protected by law. All qualified applicants will receive consideration for employment without regard to disability, status as a protected veteran or any other status protected by applicable federal, state, or local jurisdiction law.

ECS is a leading mid-sized provider of technology services to the United States Federal Government. We are focused on people, values and purpose. Every day, our 3300+ employees focus on providing their technical talent to support the Federal Agencies and Departments of the US Government to serve, protect and defend the American People.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.