Senior Data Engineer (Annapolis Junction, MD)

Annapolis, MD, US • Posted 11 hours ago • Updated 11 hours ago
Full Time
On-site
USD $230,000.00 - 240,000.00 per year
Fitment

Dice Job Match Score™

✨ Finding the perfect fit...

Job Details

Skills

  • Security Clearance
  • Telecommuting
  • Data Flow
  • Analytics
  • Command-line Interface
  • Linux
  • Bash
  • Scripting
  • Software Development
  • Python
  • Java
  • Apache Airflow
  • Scheduling
  • Sensors
  • Workflow
  • Big Data
  • Apache Spark
  • SQL
  • MySQL
  • PostgreSQL
  • Jupyter
  • Data Wrangling
  • Pandas
  • NumPy
  • Unstructured Data
  • Apache Parquet
  • JSON
  • Computerized System Validation
  • XML
  • Data Quality
  • Data Validation
  • Git
  • Version Control
  • HPC
  • Job Scheduling
  • Atlassian
  • JIRA
  • Confluence
  • Health Care
  • Law

Summary

**Active TS/SCI w/Polygraph REQUIRED** Please do not apply if you do not currently possess this level of clearance.

Telework: None

Basic Requirements:
  • 7 years of experience as a software engineer
  • Bachelor's degree in a technical discipline
    • 2 additional years of experience as a software engineer may be substituted for a degree

Job Description:
  • The Software Engineer shall possess extensive expertise in dataflow design, data transport mechanisms, and Apache Spark based distributed processing.
  • In this role, the Software Engineer shall be responsible for designing, implementing, and optimizing data ingress/egress pathways to ensure efficient, scalable, and reliable processing of the organization's analytics workloads.

Required Experience:
  • Experience using the Linux CLI and Linux tools
  • Experience developing Bash scripts to automate manual processes
  • Recent software development experience using Python and Java
  • Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows
  • Experience with Distributed Big Data processing engines including Apache Spark
  • Familiar with SQL technologies such as MySQL, MariaDB, and PostgreSQL for querying, joining, and aggregating large datasets
  • Experience using Jupyter Notebook
  • Experience with data wrangling and preprocessing using tools such as pandas, NumPy
  • Experience working with structured, semi-structured, and unstructured data such as Parquet, JSON, CSV, XML
  • Familiarity with data quality concepts, data validation, and anomaly detection
  • Experience with Git Source Control System

Desired Experience:
  • Familiar with HPC Job Scheduling tools including Slurm
  • Experience using the Atlassian Tool Suite (JIRA, Confluence)

Salary: $230,000 - $240,000 annually

Excellent benefits package including 25 days PTO, 11 paid holidays, 100% employer-paid healthcare for employees and dependents - available day 1, 8% 401(k) employer match - immediate vesting.

Disclaimer: The salary range provided is an estimate based on current market conditions and may be adjusted based on factors such as experience, skills, and qualifications. The final salary offer will be determined after a thorough review of the candidate's background and alignment with the role. Please note that this range is subject to change and should be considered as a guideline rather than a definitive figure.

Shield Consulting Solutions is an equal opportunity/affirmative action employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law.
This is a full time position
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10329471
  • Position Id: 7c5de738e05f9a70f408a2a0ad5597fb
  • Posted 11 hours ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Annapolis, Maryland

Today

Full-time

USD 230,000.00 - 240,000.00 per year

Annapolis, Maryland

Today

Full-time

USD 130,000.00 - 270,000.00 per year

Fort Meade, Maryland

Today

Full-time

Annapolis, Maryland

Today

Full-time

USD 130,000.00 - 270,000.00 per year

Search all similar jobs