Apply Now

Data & Software Engineer

Chantilly, VA, US • Posted 30+ days ago • Updated 12 hours ago

Full Time

On-site

Fitment

Dice Job Match Score™

🎯 Assessing qualifications...

Job Details

Skills

Data Flow
Java
Data Security
Privacy
Regulatory Compliance
Extract
Transform
Load
Workflow
Problem Solving
Conflict Resolution
Debugging
Data Quality
Data Migration
Data Engineering
Documentation
Design Patterns
Security Clearance
PySpark
Pandas
NumPy
Docker
Amazon S3
Step-Functions
SQL
NoSQL
Amazon DynamoDB
Unity
Operations Support Systems
Apache HTTP Server
Terraform
PostGIS
Python
Orchestration
Apache Spark
Cloud Computing
Amazon Web Services
MySQL
PostgreSQL
Performance Tuning
Query Optimization
Analytical Skill
Git
Geospatial Analysis
Bash
Scripting
Data Processing
Machine Learning (ML)
Artificial Intelligence
Biometrics
Spectrum
Business Process

Data Flow
Java
Data Security
Privacy
Regulatory Compliance
Extract
Transform
Load
Workflow
Problem Solving
Conflict Resolution
Debugging
Data Quality
Data Migration
Data Engineering
Documentation
Design Patterns
Security Clearance
PySpark
Pandas
NumPy
Docker
Amazon S3
Step-Functions
SQL
NoSQL
Amazon DynamoDB
Unity
Operations Support Systems
Apache HTTP Server
Terraform
PostGIS
Python
Orchestration
Apache Spark
Cloud Computing
Amazon Web Services
MySQL
PostgreSQL
Performance Tuning
Query Optimization
Analytical Skill
Git
Geospatial Analysis
Bash
Scripting
Data Processing
Machine Learning (ML)
Artificial Intelligence
Biometrics
Spectrum
Business Process

Summary

The Data & Software Engineer works with a small team to build complex data flows for a custom application. Successful candidate will have advanced Python programming skills, familiarity with Java, an understanding of data security, privacy, governance and compliance principles and a demonstrated history of building production data pipelines and ETL workflows at scale.

Responsibilities

Work with stakeholders to understand data requirements, assess feasibility, and design appropriate solutions with minimal oversight
Leverage strong problem-solving and debugging skills for data quality issues, pipeline failures, and performance bottlenecks
Leverage a background in large-scale data migration or platform modernization efforts
Contribute to data engineering documentation, best practices, and design patterns

Requirements

TS/SCI FSP Clearance
Minimum of 5 years' experience with:
- Apache Spark & PySpark
- Advanced Python skills (including Pandas & NumPy)
- Docker, Podman
- AWS S3, Lambda & Step functions
- Apache Iceberg, Airflow, etc.
- SQL (with Trino)
- NoSQL, DynamoDB
- Unity Catalog OSS, Apache Polaris
- Apache Superset
- Terraform or CloudFormation
- OpenLineage
- H3, PostGIS
Candidate must have experience in:
- Building end-to-end data pipelines leveraging Python
- Using orchestration tools to deploy data pipelines, including configuring and updating Spark Jobs
- Containerizing and deploying applications in cloud environments like AWS
- Working with MySQL and PostgreSQL including performance tuning, schema design, and query optimization for complex, analytical workloads
- Leveraging industry standard tools for code control (Git, IaaC control, etc.)
- Working with data catalogs, tracking data lineageand handling a variety of data formats, including Geospatial
- Using Bash scripting for automation and data processing tasks
- Integrating Al/ML services and models

About Us
For more than 20 years, NewGen Technologies has solved our clients' toughest IT challenges with integrity, security, and outstanding service by delivering both technology and talent. We have helped secure borders, have used artificial intelligence (AI) to fight terror, aided the identification of criminals, and have helped to prevent crime through the introduction of biometrics. Our team of Highly Cleared Specialists have hard-to-find skills and expertise in a wide spectrum of technologies to provide solutions that transform business processes and solve problems of national significance. #CJ

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10153280
Position Id: be2ecc8ba3adb3cca99591ea451417e6
Posted 30+ days ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Data & Software Engineer

Chantilly, Virginia

•

Today

The Data & Software Engineer works with a small team to build complex data flows for a custom application. Successful candidate will have advanced Python programming skills, familiarity with Java, an understanding of data security, privacy, governance and compliance principles and a demonstrated history of building production data pipelines and ETL workflows at scale. Candidate must have experience: Building end-to-end data pipelines leveraging PythonUsing orchestration tools to deploy data pipe

Full-time

Data & Software Engineer

McLean, Virginia

•

Today

The Data & Software Engineer works with a small team to build complex data flows for a custom application. Successful candidate will have advanced Python programming skills, familiarity with Java, an understanding of data security, privacy, governance and compliance principles and a demonstrated history of building production data pipelines and ETL workflows at scale. The candidate must have experience: Building end-to-end data pipelines leveraging Python. Using orchestration tools to deploy da

Full-time

Data/Software Engineer

McLean, Virginia

•

Today

Build modern data solutions that drive mission-critical decision making. NS2 Mission is seeking a Data & Software Engineer to support the team in McLean, VA. In this role, you'll work as part of a small, highly collaborative engineering team to design, develop, and maintain scalable data pipelines and software solutions supporting mission operations. You'll leverage modern cloud technologies, big data frameworks, and AI/ML capabilities to build high-performance applications and data workflows th

Full-time

Data Engineer

Rockville, Maryland

•

Today

Role: Data Engineer Client: MD State Reference# 71 Number of Positions: Multiple Location: Primary place of performance is HYBRID with 40% onsite requirement in Baltimore City, MD. One week per month onsite is required. On-site attendance may also be required during system rollout activities in addition to the monthly requirement. May require travel to other offices in the Baltimore area as needed. About the Role: The client is seeking a hands-on Data Engineer to design, develop, and optimi

Full-time

Search all similar jobs

More jobs at Newgen Software Technologies in Chantilly, VA