Sr. IT Data Engineer

Washington, DC, US • Posted 19 hours ago • Updated 19 hours ago
Contract W2
Contract Independent
No Travel Required
On-site
Depends on Experience
Fitment

Dice Job Match Score™

🎯 Assessing qualifications...

Job Details

Skills

  • SQL
  • Python
  • Hadoop
  • Kafka
  • CI/CD pipelines
  • Apache Spark
  • Apache NiFi
  • Linux and Shell Scripting
  • Data Engineering and ETL
  • Cloudera Data Platform

Summary

Job Title:   Sr. IT Data Engineer

Duration: Long Term

Location: Washington DC

Job Summary:

  • Participates in the planning and execution of policies, practices, and projects that acquire, control, protect, and enhance the value of data assets.
  • Facilitates obtaining data from a variety of different sources, in the right formats, assuring that it adheres to data quality standards, as well as resolving any information flow and content issues.
  • Builds a robust data pipeline that cleans, transforms, and aggregates unorganized data into databases.

Experience Required:

  • Proficiency in developing, maintaining, monitoring, and the long-term operations of data pipelines or processing systems running in Cloudera Data Platform. Understanding of data extraction, transformation, loading, and performance tuning of solutions utilizing multiple streams of input data­­ code-based, git and DevOps-enabled technologies using Python or SQL such as PySpark, pandas, or dbt
  • 5+ years of experience in application/data development (i.e., Python)
  • 5+ years of experience with data integration/ingestion tools (i.e., Apache NiFi)
  • Advanced level knowledge of SQL, Java, Microsoft SQL Server, distributed data/computing platforms (i.e., Apache NiFi, Hadoop, MapReduce, Hive, HBase, Kafka, Spark)
  • Experience with Scrum and Kanban methodologies
  • Experience with UNIX/Linux including basic commands and shell scripting
  • Experience in implementing and maintaining continuous integration continuous delivery (CI/CD) pipelines and data platform management
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 90987422
  • Position Id: 5300-3634-
  • Posted 19 hours ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Washington, District of Columbia

Yesterday

Easy Apply

Contract

Depends on Experience

Washington, District of Columbia

Today

Easy Apply

Contract

$50 - $60

Remote or Washington, District of Columbia

4d ago

Easy Apply

Contract

Depends on Experience

Arlington, Virginia

Today

Easy Apply

Contract, Third Party

Depends on Experience

Search all similar jobs