Senior IT Data Engineer

Hybrid in Washington, DC, US • Posted 1 day ago • Updated 1 hour ago
Full Time
On-site
Fitment

Dice Job Match Score™

👤 Reviewing your profile...

Job Details

Skills

  • Python
  • Data Integration
  • Scrum
  • Kanban
  • Data Processing
  • PySpark
  • Pandas
  • Apache NiFi
  • SQL
  • Java
  • Microsoft SQL Server
  • Distributed Computing
  • Apache Hadoop
  • MapReduce
  • Apache Hive
  • Apache HBase
  • Apache Kafka
  • Apache Spark
  • Git
  • DevOps
  • Unix
  • Linux
  • Shell Scripting
  • IT Operations
  • Data Extraction
  • Extract
  • Transform
  • Load
  • Performance Tuning
  • Data Acquisition
  • Database
  • Cloudera
  • Issue Resolution
  • Continuous Integration and Development
  • Continuous Integration
  • Continuous Delivery
  • Management
  • Strategic Planning

Summary

Project Description :
This role involves participating in the planning and execution of policies, practices, and projects designed to acquire, control, protect, and enhance the value of organisational data assets.

Qualification Requirements :
General Experience: 5+ years of experience in application/data development, specifically with Python.Specialized Experience: 5+ years of experience with data integration and ingestion tools, such as Apache NiFi.Methodology: Experience working with Scrum and Kanban methodologies.Platform Experience: Proficiency in the long-term operations of data pipelines or processing systems running in the Cloudera Data Platform.**ship is a requirement for this position

Skills Requirements :
Data Processing & Engineering: Proficiency in PySpark, pandas, or dbt.Data Ingestion: Expertise in Apache NiFi.Languages & Databases: Advanced knowledge of SQL, Java, and Microsoft SQL Server.Distributed Computing: Experience with platforms including Hadoop, MapReduce, Hive, HBase, Kafka, and Spark.DevOps & Tools: Understanding of git and DevOps-enabled technologies.Systems: Proficiency in UNIX/Linux, including basic commands and shell scripting.Technical Operations: Knowledge of data extraction, transformation, loading (ETL), and performance tuning.

Responsibilities :
Included but not limited to:Data Acquisition: Facilitate obtaining data from variety of sources in correct formats while adhering to quality standards.Pipeline Development: Build robust data pipelines that clean, transform, and aggregate unorganized data into databases.Platform Operations: Develop, maintain, monitor, and manage the long-term operations of data pipelines or processing systems within the Cloudera Data Platform.Issue Resolution: Resolve information flow and content issues as they arise.CI/CD Implementation: Implement and maintain continuous integration and continuous delivery (CI/CD) pipelines and manage data platforms.Strategic Planning: Participate in the planning of practices and projects to enhance data asset value

Job ID : 1532
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10301578
  • Position Id: 1532
  • Posted 1 day ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Washington, District of Columbia

Today

Full-time

Washington, District of Columbia

6d ago

Easy Apply

Contract

Depends on Experience

Arlington, Virginia

Today

Full-time

USD 113,000.00 - 188,000.00 per year

Alexandria, Virginia

Today

Full-time

USD 92,300.00 - 166,850.00 per year

Search all similar jobs