Apply Now

Data & Software Engineer

Chantilly, VA, US • Posted 7 hours ago • Updated 7 hours ago

Full Time

On-site

Fitment

Dice Job Match Score™

🛠️ Calibrating flux capacitors...

Job Details

Skills

Data Flow
Java
Data Security
Privacy
Regulatory Compliance
Extract
Transform
Load
Workflow
Conflict Resolution
Problem Solving
Debugging
Data Quality
Data Migration
Data Engineering
Documentation
Design Patterns
Security Clearance
PySpark
Pandas
NumPy
Docker
Amazon S3
Step-Functions
SQL
NoSQL
Amazon DynamoDB
Unity
Operations Support Systems
Apache HTTP Server
Terraform
PostGIS
Python
Orchestration
Apache Spark
Cloud Computing
Amazon Web Services
MySQL
PostgreSQL
Performance Tuning
Query Optimization
Analytical Skill
Git
Geospatial Analysis
Bash
Scripting
Data Processing
Machine Learning (ML)
Artificial Intelligence
Biometrics
Spectrum
Business Process

Summary

The Data & Software Engineer works with a small team to build complex data flows for a custom application. Successful candidate will have advanced Python programming skills, familiarity with Java, an understanding of data security, privacy, governance and compliance principles and a demonstrated history of building production data pipelines and ETL workflows at scale.

Responsibilities

Work with stakeholders to understand data requirements, assess feasibility, and design appropriate solutions with minimal oversight
Leverage strong problem-solving and debugging skills for data quality issues, pipeline failures, and performance bottlenecks
Leverage a background in large-scale data migration or platform modernization efforts
Contribute to data engineering documentation, best practices, and design patterns

Requirements

TS/SCI FSP Clearance
Minimum of 5 years' experience with:
- Apache Spark & PySpark
- Advanced Python skills (including Pandas & NumPy)
- Docker, Podman
- AWS S3, Lambda & Step functions
- Apache Iceberg, Airflow, etc.
- SQL (with Trino)
- NoSQL, DynamoDB
- Unity Catalog OSS, Apache Polaris
- Apache Superset
- Terraform or CloudFormation
- OpenLineage
- H3, PostGIS
Candidate must have experience in:
- Building end-to-end data pipelines leveraging Python
- Using orchestration tools to deploy data pipelines, including configuring and updating Spark Jobs
- Containerizing and deploying applications in cloud environments like AWS
- Working with MySQL and PostgreSQL including performance tuning, schema design, and query optimization for complex, analytical workloads
- Leveraging industry standard tools for code control (Git, IaaC control, etc.)
- Working with data catalogs, tracking data lineage and handling a variety of data formats, including Geospatial
- Using Bash scripting for automation and data processing tasks
- Integrating Al/ML services and models

About Us
For more than 20 years, NewGen Technologies has solved our clients' toughest IT challenges with integrity, security, and outstanding service by delivering both technology and talent. We have helped secure borders, have used artificial intelligence (AI) to fight terror, aided the identification of criminals, and have helped to prevent crime through the introduction of biometrics. Our team of Highly Cleared Specialists have hard-to-find skills and expertise in a wide spectrum of technologies to provide solutions that transform business processes and solve problems of national significance. #CJ

Beth Morris
NewGen Technologies
Lead Senior Recruiter
bmorris @newgentechnologies.com

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10153280
Position Id: be2ecc8ba3adb3cca99591ea451417e6
Posted 7 hours ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Data & Software Engineer

McLean, Virginia

•

Today

Overview We are seeking a Data & Software Engineer works with a small team to build complex data flows for a custom application. Successful candidate will have advanced Python programming skills, familiarity with Java, an understanding of data security, privacy, governance and compliance principles and a demonstrated history of building production data pipelines and ETL workflows at scale. Candidate must have experience: What will you do? Building end-to-end data pipelines leveraging Python U

Full-time

Data Engineer

Reston, Virginia

•

8d ago

ICF is seeking a skilled Data Engineer to join our Corporate IT organization. You will design, build, and maintain the data infrastructure that powers insights and decision-making across our practices and support organizations. Working at the intersection of enterprise data platforms and client-facing analytics, you will have direct impact on how our firm manages and monetizes its most asset - data. This is a high-visibility role reporting to the Sr. Director of Solution Architecture. You will c

Full-time

USD 98,614.00 - 167,644.00 per year

Data Engineer

Herndon, Virginia

•

Today

Altus Consulting is seeking a skilled Data Engineer to join our dynamic team. You will be responsible for designing, developing, and maintaining data pipelines and infrastructure that provide reliable and high-quality data for our clients' analytics needs. You will leverage your understanding of data engineering principles, best practices, and technologies to deliver efficient and scalable solutions. Responsibilities: Design and develop data pipelines using industry-standard tools and technolog

Full-time

Data Engineer

Springfield, Virginia

•

Today

M9 Solutions is dedicated to providing IT services and solutions to the Federal Government by mobilizing the right people, skills, clearance levels, and technologies to help organizations that desire improved performance and modern, sustainable change. M9 has provided quality IT services and support to more than 30 Federal Agencies and multiple commercial customers nationwide. Our capabilities include IT Talent Solutions, Data Delivery & Analytics, Cyber Security, Cloud Migration, Applications a

Full-time

USD 60,000.00 per year

Search all similar jobs

More jobs at Newgen Software Technologies in Chantilly, VA