Overview
Remote
$45 - $48
Contract - W2
No Travel Required
Skills
Data Engineer + AWS + java + microservices +NIFI + Apache + Bigdata and hadoop
Job Details
Responsibilities
Seeking a Data Engineer II to support the design, development, testing, and deployment of software applications on a new program. This role requires a strong technical background, excellent problem-solving skills, and the ability to work collaboratively in a SAFe Agile environment. The Data Engineer will play a critical role in maintaining the quality and efficiency of data and solutions to support the Centers for Medicare & Medicaid Services (CMS) in detecting and preventing fraud, waste, and abuse within government-sponsored health programs.
Day to Day work Responsibilities:
- Design, maintain, and lead the development and implementation of robust ETL pipelines using Apache NiFi and Java Spring Boot microservices, to ingest, transform, and integrate large volumes of complex data from multiple sources.
- Possess deep technical expertise in Java programming, Spring Boot microservices, and big data technologies in the AWS cloud environment (Redshift, Athena, etc.).
- Extensive experience in Java programming, Spring Boot microservices, and big data technologies.
- Strong understanding of data integration principles, ETL best practices, and data governance frameworks. Familiarity with machine learning concepts and data preparation techniques.
- Lead the optimization of existing ETL scripts for enhanced performance and scalability.
- Conduct in-depth analysis to integrate complex data sources into a single system, considering optimal data ingestion strategies.
- Collaborate closely with data scientists and machine learning engineers and provide data preparation and analysis support for model building.
- Lead the creation and maintenance of comprehensive data documentation, including database design, configuration, and performance reports.
- Establish and enforce best practices for secure data storage, backup, and archiving and ensure compliance with relevant regulations.
- Partner with the data management team and data stewards to define and implement data governance initiatives.
- Foster a collaborative and supportive team environment, promoting knowledge sharing and continuous learning.
- Effectively communicate complex technical concepts to both technical and non-technical stakeholders. Represent the data engineering team in meetings with stakeholders, clearly articulating team progress and addressing technical challenges.
- Delegate tasks and responsibilities while ensuring project completion within timelines and budget constraints.
- Guide and mentor junior data engineers, providing technical expertise and fostering professional growth.
- Excellent communication, collaboration, and problem-solving skills.
Qualifications
Required Qualifications:
- BS/BA Degree and 2+ years experience, MS/MA and 0 years experience
- Must have the ability to obtain and maintain a Public Trust clearance.
- Extensive Expertise with Apache NiFi, JAVA and JAVA Spring boot Microservices, AWS, Red Shift, Athena and Big Data technologies
Experienced with CI/CD processes
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.