Overview
On Site
Full Time
Skills
Security Clearance
Crystal Reports
Innovation
Prototyping
Collaboration
Health Care
Apache Airflow
FOCUS
Artificial Intelligence
Messaging
Apache Kafka
Real-time
Elasticsearch
Streaming
Data Processing
Accessibility
Regulatory Compliance
Cloud Computing
Amazon S3
Data Storage
PKI
DIAS
Computer Science
Data Science
Data Engineering
Python
Big Data
Extract
Transform
Load
Workflow
SQL
Kubernetes
Management
Amazon Web Services
Cloud Architecture
PostgreSQL
Apache HTTP Server
Apache Hive
HDFS
Apache Spark
DoD
Law
Job Details
Overview
LMI is seeking a Lead Data Engineer supporting Special Operations Command (SOCOM) on-site in Crystal City. The position involves providing big data ETL support on classified data and systems to directly support client mission.
LMI is a new breed of digital solutions provider dedicated to accelerating government impact with innovation and speed. Investing in technology and prototypes ahead of need, LMI brings commercial-grade platforms and mission-ready AI to federal agencies at commercial speed.
Leveraging our mission-ready technology and solutions, proven expertise in federal deployment, and strategic relationships, we enhance outcomes for the government, efficiently and effectively. With a focus on agility and collaboration, LMI serves the defense, space, healthcare, and civilian sectors-helping agencies navigate complexity and outpace change. Headquartered in Tysons, Virginia, LMI is committed to delivering impactful results that strengthen missions and drive lasting value.
Responsibilities
Responsibilities will include:
Design, develop, and implement scalable data pipelines and ETL processes using Apache Airflow, with a focus on data for AI applications.
Develop messaging solutions utilizing Kafka to support real-time data streaming and event-driven architectures.
Build and maintain high-performance data retrieval solutions using ElasticSearch/OpenSearch.
Implement and optimize Python-based data processing solutions.
Integrate batch and streaming data processing techniques to enhance data availability and accessibility.
Ensure adherence to security and compliance requirements when working with classified data.
Work closely with cross-functional teams to define data strategies and develop technical solutions aligned with mission objectives.
Deploy and manage cloud-based infrastructure to support scalable and resilient data solutions, including AWS S3.
Optimize data storage, retrieval, and processing efficiency, focusing on big data.
Utilize Trino for distributed SQL query processing.
Leverage OpenMetaData for data discovery and governance.
Implement APIs using FastAPI for streamlined data interaction.
Ensure proper implementation of PKI's & ACCM's.
Integrate DIAS solutions within the data pipeline framework.
Qualifications
Required Skills
Bachelor's degree or higher in data engineering, computer science, data science, or similar
At least 5 years of experience in data engineering or related work
Expert in Python with significant on the job experience
Significant experience with big data technology and ETL
Experience with Airflow as an ETL workflow technology
Advanced proficiency in SQL (especially Postgres and/or Trino) with significant on the job experience
Experience with Kubernetes as an operating environment and Helm as infrastructure management
Experience with AWS services and cloud architecture
Desired Skills
Experience with Postgres or Trino
Experience with Apache Iceberg, Hive, HDFS, or Spark
Previous DOD experience
Options
Apply for this job onlineApply
Share
Email this job to a friendRefer
Sorry the Share function is not working properly at this moment. Please refresh the page and try again later.
Share on your newsfeed
LMI is an Equal Opportunity Employer. LMI is committed to the fair treatment of all and to our policy of providing applicants and employees with equal employment opportunities. LMI recruits, hires, trains, and promotes people without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, pregnancy, disability, age, protected veteran status, citizenship status, genetic information, or any other characteristic protected by applicable federal, state, or local law. If you are a person with a disability needing assistance with the application process, please contact
Colorado Residents: In any materials you submit, you may redact or remove age-identifying information such as age, date of birth, or dates of school attendance or graduation. You will not be penalized for redacting or removing this information.
Need help finding the right job?
LMI is seeking a Lead Data Engineer supporting Special Operations Command (SOCOM) on-site in Crystal City. The position involves providing big data ETL support on classified data and systems to directly support client mission.
LMI is a new breed of digital solutions provider dedicated to accelerating government impact with innovation and speed. Investing in technology and prototypes ahead of need, LMI brings commercial-grade platforms and mission-ready AI to federal agencies at commercial speed.
Leveraging our mission-ready technology and solutions, proven expertise in federal deployment, and strategic relationships, we enhance outcomes for the government, efficiently and effectively. With a focus on agility and collaboration, LMI serves the defense, space, healthcare, and civilian sectors-helping agencies navigate complexity and outpace change. Headquartered in Tysons, Virginia, LMI is committed to delivering impactful results that strengthen missions and drive lasting value.
Responsibilities
Responsibilities will include:
Design, develop, and implement scalable data pipelines and ETL processes using Apache Airflow, with a focus on data for AI applications.
Develop messaging solutions utilizing Kafka to support real-time data streaming and event-driven architectures.
Build and maintain high-performance data retrieval solutions using ElasticSearch/OpenSearch.
Implement and optimize Python-based data processing solutions.
Integrate batch and streaming data processing techniques to enhance data availability and accessibility.
Ensure adherence to security and compliance requirements when working with classified data.
Work closely with cross-functional teams to define data strategies and develop technical solutions aligned with mission objectives.
Deploy and manage cloud-based infrastructure to support scalable and resilient data solutions, including AWS S3.
Optimize data storage, retrieval, and processing efficiency, focusing on big data.
Utilize Trino for distributed SQL query processing.
Leverage OpenMetaData for data discovery and governance.
Implement APIs using FastAPI for streamlined data interaction.
Ensure proper implementation of PKI's & ACCM's.
Integrate DIAS solutions within the data pipeline framework.
Qualifications
Required Skills
Bachelor's degree or higher in data engineering, computer science, data science, or similar
At least 5 years of experience in data engineering or related work
Expert in Python with significant on the job experience
Significant experience with big data technology and ETL
Experience with Airflow as an ETL workflow technology
Advanced proficiency in SQL (especially Postgres and/or Trino) with significant on the job experience
Experience with Kubernetes as an operating environment and Helm as infrastructure management
Experience with AWS services and cloud architecture
Desired Skills
Experience with Postgres or Trino
Experience with Apache Iceberg, Hive, HDFS, or Spark
Previous DOD experience
Options
Apply for this job onlineApply
Share
Email this job to a friendRefer
Sorry the Share function is not working properly at this moment. Please refresh the page and try again later.
Share on your newsfeed
LMI is an Equal Opportunity Employer. LMI is committed to the fair treatment of all and to our policy of providing applicants and employees with equal employment opportunities. LMI recruits, hires, trains, and promotes people without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, pregnancy, disability, age, protected veteran status, citizenship status, genetic information, or any other characteristic protected by applicable federal, state, or local law. If you are a person with a disability needing assistance with the application process, please contact
Colorado Residents: In any materials you submit, you may redact or remove age-identifying information such as age, date of birth, or dates of school attendance or graduation. You will not be penalized for redacting or removing this information.
Need help finding the right job?
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.