Apply Now

Sr. IT Data Engineer

• Posted 1 day ago • Updated 4 hours ago

Full Time

On-site

Fitment

Dice Job Match Score™

📋 Comparing job requirements...

Job Details

Skills

Data Quality
Extract
Transform
Load
Database
Cloudera
Data Extraction
Performance Tuning
Streaming
Git
DevOps
PySpark
Pandas
Python
Data Integration
SQL
Java
Microsoft SQL Server
Apache NiFi
Apache Hadoop
MapReduce
Apache Hive
Apache HBase
Apache Kafka
Apache Spark
Scrum
Kanban
Unix
Linux
Shell Scripting
Continuous Integration and Development
Continuous Integration
Continuous Delivery
Management

Summary

Job Title: Sr. IT Data Engineer

Duration: Long Term

Location: Washington DC

Job Summary:

Participates in the planning and execution of policies, practices, and projects that acquire, control, protect, and enhance the value of data assets.
Facilitates obtaining data from a variety of different sources, in the right formats, assuring that it adheres to data quality standards, as well as resolving any information flow and content issues.
Builds a robust data pipeline that cleans, transforms, and aggregates unorganized data into databases.

Experience Required:

Proficiency in developing, maintaining, monitoring, and the long-term operations of data pipelines or processing systems running in Cloudera Data Platform. Understanding of data extraction, transformation, loading, and performance tuning of solutions utilizing multiple streams of input data code-based, git and DevOps-enabled technologies using Python or SQL such as PySpark, pandas, or dbt
5+ years of experience in application/data development (i.e., Python)
5+ years of experience with data integration/ingestion tools (i.e., Apache NiFi)
Advanced level knowledge of SQL, Java, Microsoft SQL Server, distributed data/computing platforms (i.e., Apache NiFi, Hadoop, MapReduce, Hive, HBase, Kafka, Spark)
Experience with Scrum and Kanban methodologies
Experience with UNIX/Linux including basic commands and shell scripting
Experience in implementing and maintaining continuous integration continuous delivery (CI/CD) pipelines and data platform management

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: RTL939169
Position Id: 310190cf2404fee4765f19492a6fd06d
Posted 1 day ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Senior IT Data Engineer - Onsite

Washington, District of Columbia

•

4d ago

Title: Senior IT Data Engineer - Onsite Mandatory skills: application development, data development, Python, data integration, ingestion tools, Apache NiFi, SQL, Java, Microsoft SQL Server, distributed data, computing platforms, Hadoop, MapReduce, Hive, HBase, Kafka, Spark, Scrum, Kanban methodologies, UNIX, Linux, basic commands, shell scripting, continuous integration continuous delivery, CI/CD pipelines, data platform management, data quality, data pipeline, Cloudera Data Platform, processing

Easy Apply

Contract

Depends on Experience

Senior Data Engineer

Alexandria, Virginia

•

Today

This Department of War enterprise data and analytics program delivers mission-critical capabilities that enable leaders across the Department to make faster, better-informed decisions using trusted data at scale. Leidos Digital Modernization sector is seeking an experienced Senior Data Engineer to support the delivery, enhancement, and adoption of enterprise data and analytics products used across multiple DoD organizations. In this role, you will work alongside government partners, engineers,

Full-time

USD 92,300.00 - 166,850.00 per year

Data Engineer Specialist

Arlington, Virginia

•

Today

At Accenture Federal Services, nothing matters more than helping the US federal government make the nation stronger and safer and life better for people. Our 13,000+ people are united in a shared purpose to pursue the limitless potential of technology and ingenuity for clients across defense, national security, public safety, civilian, and military health organizations. Join Accenture Federal Services, a technology company within global Accenture. Recognized as a Glassdoor Top 100 Best Place to

Full-time

USD 108,400.00 - 203,400.00 per year

Senior Data Engineer Lead

Alexandria, Virginia

•

Today

This Department of War enterprise data and analytics program delivers mission-critical capabilities that enable leaders across the Department to make faster, better-informed decisions using trusted data at scale. Leidos Digital Modernization sector is seeking an experienced Senior Data Engineer Lead to support the delivery, enhancement, and adoption of enterprise data and analytics products used across multiple DoD organizations. In this role, you will work alongside government partners, engine

Full-time

USD 92,300.00 - 166,850.00 per year

Search all similar jobs