Data Engineer

  • Arlington, VA
  • Posted 2 days ago | Updated 7 hours ago

Overview

On Site
Full Time

Skills

Security Clearance
Preventive Maintenance
Performance Management
Project Management
Crystal Reports
Apache Airflow
Messaging
Apache Kafka
Real-time
Elasticsearch
Streaming
Data Processing
Accessibility
Regulatory Compliance
Data Storage
Computer Science
Data Science
Software Engineering
Data Engineering
Python
SQL
Big Data
Extract
Transform
Load
Workflow
Unstructured Data
Amazon Web Services
Cloud Computing
Amazon S3
PostgreSQL
Apache HTTP Server
Apache Hive
HDFS
Apache Spark
Kubernetes
Management
DoD
Continuous Integration

Job Details

Title: Data Engineer
Timeline to Start: ASAP
Clearance: TS/SCI required. CI Poly preferred
Worksite Address: Crystal City, VA, On-Site in SCIF
Work Schedule: M-F 9-5 pm EST, Full-time 40 hours

Required Education
  • Bachelor's degree in data engineering, computer science, data science, or similar

Job Description:
ALTA IT is seeking a Senior Software/Data Engineer supporting Special Operations Command (SOCOM) on-site in Crystal City. The position involves providing big data ETL support on classified data and systems to directly support the client's mission.

RESPONSIBILITIES WILL INCLUDE:
  • Design, develop, and implement scalable data pipelines and ETL processes using Apache Airflow
  • Implement and optimize Python-based data processing solutions.
  • Utilize Trino for distributed SQL query processing.
  • Develop messaging solutions utilizing Kafka to support real-time data streaming and event-driven architectures.
  • Build and maintain high-performance data retrieval solutions using ElasticSearch/OpenSearch.
  • Integrate batch and streaming data processing techniques to enhance data availability and accessibility.
  • Ensure adherence to security and compliance requirements when working with classified data
  • Work closely with cross-functional teams to define data strategies and develop technical solutions aligned with
MISSION OBJECTIVES:
  • Deploy and manage cloud-based infrastructure to support scalable and resilient data solutions, including AWS S3.
  • Optimize data storage, retrieval, and processing efficiency, focusing on big data.
REQUIRED SKILLS:
  • Bachelor's degree or higher in data engineering, computer science, data science, or similar
  • At least 10 years of experience in software engineering, data engineering, or related work
  • Expert in Python with significant on the job experience
  • Advanced proficiency in SQL (especially Postgres and/or Trino) with significant on the job experience
  • Significant experience with big data technology and ETL
  • Experience with Airflow (or equivalent) as an ETL workflow technology
  • Significant experience creating scalable data pipelines with structured and unstructured data. Experience with AWS or equivalent cloud-based services (e.g. S3 or S3-like services)
DESIRED SKILLS:
  • Experience with Postgres or Trino
  • Experience with Apache Iceberg, Hive, HDFS, or Spark
  • Experience with Kubernetes as an operating environment and Helm as infrastructure management
  • Previous DOD experience D (Especially Special and Joint Operations)
  • Active CI Poly


System One, and its subsidiaries including Joul, ALTA IT Services, and Mountain Ltd., are leaders in delivering outsourced services and workforce solutions across North America. We help clients get work done more efficiently and economically, without compromising quality. System One not only serves as a valued partner for our clients, but we offer eligible employees health and welfare benefits coverage options including medical, dental, vision, spending accounts, life insurance, voluntary plans, as well as participation in a 401(k) plan.

System One is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, age, national origin, disability, family care or medical leave status, genetic information, veteran status, marital status, or any other characteristic protected by applicable federal, state, or local law.

#M-M2
#LI-RF1
#DI-RF1

Ref: #850-Rockville (ALTA IT)
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.