Apply Now

Sr IT Big Data Developer

Washington, DC, US • Posted 1 day ago • Updated 3 hours ago

Full Time

On-site

Fitment

Dice Job Match Score™

🫥 Flibbertigibetting...

Job Details

Skills

Big Data
Statistics
Data Flow
Database Design
Data Wrangling
Management
Data Architecture
Computer Science
Information Technology
SQL
RDBMS
PostgreSQL
Microsoft SQL Server
MySQL
Python
R
Data Engineering
Analytics
Distributed Computing
Data Storage
Optimization
Extract
Transform
Load
ELT
Data Integration
Data Processing
Orchestration
Apache Airflow
Step-Functions
Migration
Workflow
Unstructured Data
Linux
Version Control
GitLab
GitHub
Root Cause Analysis
Business Process
Information Architecture
Database
Data Lake
Software Engineering
Development Testing
Communication
Customer Service
Problem Solving
Conflict Resolution
Time Series
Analytical Skill
Forecasting
Research
Finance
NoSQL
Graph Databases
Training
Machine Learning (ML)
Cloud Computing
Amazon Web Services
Microsoft Azure
Snow Flake Schema
Data Warehouse
Change Data Capture
Continuous Integration
Continuous Delivery
Scripting
Java
Scala
JavaScript
Perl

Summary

Role: Sr IT Big Data Developer

Location: Washington, DC

Duration: Long Term

Job description:

The Data Architecture, Technology, and Analytics (DATA) section is tasked with transforming how the client's Division of Research & Statistics (R&S) ingests, organize, uses, and visualizes data.

The Data Architecture, Technology, and Analytics (DATA) section is looking for an experienced detailed oriented Data Architect/Engineer who will be responsible for expanding and optimizing data and data pipeline architecture, as well as optimizing data flow and collection for economic policy and research teams. The ideal candidate is an experienced hands-on data modeler with working knowledge of database design and administration, data pipeline building, and data wrangling who enjoys improving existing data systems and/or building them from the ground up. The Data Architect/Engineer will support economists and technical experts and will ensure optimal data delivery architecture is designed and developed. They must have a service mindset, be self-directed, and be comfortable supporting the data needs of multiple teams and systems. The right candidate will be excited by the prospect of optimizing or even re-designing the R&S division's data architecture to support next generation of data initiatives

Technical Skills:

Bachelor's degree in computer science, Information Technology, Engineering or a related technical field and at least 7 years of related experience; advanced degree preferred.
Advanced working knowledge of SQL and experience working with relational database platforms including PostgreSQL, Microsoft SQL Server, and MySQL.
Advanced working knowledge of Python, R, and other scripting languages used for data engineering and analytics.
Experience working with large-scale data systems, including distributed computing, scalable data processing, data storage architecture, and optimization of high-volume data workloads.
Experience designing, developing, and automating ETL/ELT workflows and data integration pipelines.
Experience building, optimizing, and maintaining scalable databases, data pipelines and data processing frameworks
Experience with workflow orchestration and pipeline automation tools such as Apache Airflow, Prefect, Dagster, or AWS Step Functions.
Experience migrating workflows and data pipelines between on-premises and cloud environments.
Experience processing, analyzing, and integrating structured and unstructured data sources.
Experience developing in Linux environments and using source control platforms such as GitLab and/or GitHub.
Experience performing root cause analysis on internal and external data and business processes to answer business questions and identify opportunities for improvement.
Ability to design and communicate enterprise information architecture at conceptual, logical, and physical levels.
In-depth experience designing and implementing database, data lake, and enterprise data platform solutions.
Strong hands-on software engineering and implementation experience, including development, testing, and deployment of data applications and services.
Excellent oral and written communication skills with a strong customer service orientation.
Exceptional analytical, problem-solving, and troubleshooting skills.
Understanding of time series data and related analytical and forecasting techniques.
Experience working in a research environment and/or with economic or financial data.
Experience with NoSQL and graph database technologies.
Experience developing, training, deploying, and maintaining machine learning models.
Working experience with cloud technologies such as AWS, Microsoft Azure, and Snowflake.
Experience implementing data warehouses utilizing Change Data Capture (CDC) methodologies.
Experience implementing and maintaining CI/CD pipelines and DataOps platforms.
Working knowledge of additional programming and scripting languages such as Java, Scala, JavaScript, or Perl

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: RTL939169
Position Id: 2198803f73fe5d95a36d6a35dd2cb7e2
Posted 1 day ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Senior IT Big Data Developer

Washington, District of Columbia

•

Today

Project Description : We are seeking an experienced, detail-oriented Data Architect/Engineer to expand and optimize data and data pipeline architecture, as well as optimize data flow and collection for economic policy and research teams at a large, highly regulated federal financial institution. The ideal candidate is a hands-on data modeler with working knowledge of database design and administration, data pipeline building, and data wrangling who enjoys improving existing data systems and/or

Easy Apply

Full-time

Senior IT Data Engineer

Washington, District of Columbia

•

Today

Role: Senior IT Data Engineer Location: Washington, DC Duration: Long Term Only US Citzens for this role Job description: The Data Architecture, Technology, and Analytics (DATA) section is tasked with transforming how the client's Division of Research & Statistics (R&S) ingests, organize, uses, and visualizes data. The Data Architecture, Technology, and Analytics (DATA) section is looking for an experienced detailed oriented Data Architect/Engineer who will be responsible for expanding and optim

Full-time

Senior IT Big Data Engineer

Washington, District of Columbia

•

Today

Overview The Senior IT Big Data Developer supports the Data Architecture, Technology, and Analytics (DATA) function, enabling advanced data capabilities across enterprise environments. This role is responsible for designing, building, and optimizing scalable data architectures and pipelines that support large-scale analytics, reporting, and mission-critical research initiatives. The ideal candidate is a hands-on data engineer and architect with strong experience in data modeling, pipeline deve

Full-time

USD 166,000.00 - 174,500.00 per year

Senior Data Engineer - Onsite

Washington, District of Columbia

•

29d ago

Title: Senior Data Engineer - Onsite Mandatory skills: Python, R, data engineering, analytics, data systems, distributed computing, scalable data processing, data storage architecture, high-volume data workloads, ETL/ELT workflows, data integration pipelines, scalable databases, data pipelines, data processing frameworks, migrating workflows, cloud environments, workflow orchestration, pipeline automation tools, Apache Airflow, Prefect, Dagster, AWS Step Functions, structured, unstructured data

Easy Apply

Contract

Depends on Experience

Search all similar jobs

More jobs at Yale University in Washington, DC