Data Engineer

Data Engineer

McLean, VA – Hybrid

Contract

70-80/hr W2

Candidates with previous Cap 1 Experience a huge plus

Candidates must take a Glider Test

We are seeking a skilled Data Engineer to join our team. The successful candidate will be responsible for designing, building, and maintaining our data infrastructure. You will work closely with data scientists, analysts, and engineers to ensure that our data pipelines are efficient, scalable, and reliable. This role requires a strong understanding of data engineering principles and hands-on experience with various data technologies.

Responsibilities

• Design, develop, and maintain efficient data pipelines using Python and Scala.
• Work with AWS services such as EMR and Glue to process and transform large datasets.
• Implement and manage Kafka streaming solutions for real-time data processing.
• Develop and maintain SQL databases to support data analytics and reporting needs.
• Create and manage RESTful APIs for data access and integration.
• Collaborate with data scientists and analysts to understand data requirements and provide solutions.
• Ensure data quality and integrity through data validation and monitoring processes.
• Optimize data storage and retrieval processes to improve performance and reduce costs.
• Stay up-to-date with the latest trends and technologies in data engineering and AI.

Requirements

• Proficiency in Python and Scala programming languages.
• Experience with AWS services, including EMR, Glue, and Kafka streaming.
• Strong knowledge of SQL and database management.
• Experience with RESTful API design and implementation.
• Ability to write efficient, maintainable, and scalable code.
• Strong problem-solving skills and attention to detail.
• Excellent communication and collaboration skills.

• Experience with artificial intelligence (AI) and machine learning (ML) technologies.
• Previous experience in a Cap 1 environment is highly desirable.
• Familiarity with data governance and data security best practices.