Data Engineer

Overview

Hybrid
$150,000 - $180,000
Full Time
10% Travel

Skills

Data Engineering
Python
Polars/Pandas
AWS S3
RDS
Elastic Cache
PostGreSql

Job Details

Our client is a sports analytics company that specializes in leveraging advanced data engineering and analytics to transform raw sports data into actionable insights. They work across college and professional sports to empower organizations to make data-driven decisions that optimize performance and drive business growth.

 

<>Job Description:</>

As a Data Engineer, you will play a pivotal role in designing and implementing the systems and

processes that capture, store, and process sports data. You will collaborate with the data science team to build scalable data pipelines and architecture, ensuring data accessibility and integrity to drive insights that support our lines of business.

 

<>Responsibilities:</>
  • Data Pipeline Development: Design, build, and maintain scalable data pipelines to ingest, process, and store data from various sources.
  • Data Integration: Develop processes to integrate data from various structured and unstructured sources to create a cohesive and usable dataset.
  • Data Quality and Governance: Ensure the accuracy, consistency, and reliability of data through data validation, cleaning, and governance processes.
  • Performance Optimization: Monitor and optimize data pipeline performance, troubleshooting issues as they arise.
  • Collaboration with Teams: Work closely with data scientists to understand data requirements and implement solutions.
  • Automation: Identify and automate repetitive tasks in data processing and integration
  • Documentation: Maintain clear documentation for data processes, pipeline architectures, and data models.

 

<>Qualifications:</>
  • Education: Bachelor’s degree in computer science
  • Experience: 5+ years of experience as a Data Engineer or in a related
  • Technical Skills: Proficiency in Python, Polars/Pandas, Pydantic, Package Management with uv
  • Data Infrastructure: Knowledge of AWS S3 and Delta Lake
  • Database Management: Strong experience with MySQL and PostgreSQL
  • Project Management: Experience with GitHub
  • Security: Familiarity with data governance, security, and compliance

 

Our client is based in the Washington, DC area and needs someone that can go to the office occasionally.

 

If this sounds like you, please respond with your Salary requirements as soon as possible.

 

Please no agencies. 

 

 

About AAJ Interactive Technologies:

 

AAJ Interactive Technologies, established in 1997 by cutting-edge technology executives, is a technology professional-services company supplying project-based consulting, staff augmentation and recruiting services to leading firms throughout Metropolitan Washington, DC.

 

We work differently from most of our competition.  We have been in both a position of hiring, mentoring and managing large staffs inside a corporate culture, as well as consultants for hire.  This unique perspective allows us to understand both sides of this business.  We take the time to ensure our consultants/candidates placed will be successful.

 

We believe that because of our principals we have succeeded where others have failed.  The greater DC technology space can be full of companies that are not really looking out for your interests. Ask around, we’re not one of them!  We want you to succeed, and we’ll do everything we can to help you do just that!

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.