Lead Data Engineer
SUMMARY:
The Lead Data Engineer will play a crucial role in designing, implementing, and maintaining robust data pipelines and architectures. This position requires a forward thinking approach to solve complex data challenges and support our advanced AI and machine learning initiatives.
As a Lead Data Engineer, you will be responsible for building, and optimizing data pipelines, data warehouses, and data lakes to support business initiatives. You will collaborate with cross-functional teams, including data scientists, business analysts, and IT departments, to develop and implement data-driven solutions that provide business value.
ESSENTIAL DUTIES AND RESPONSIBILITIES
Include the following. Other duties and special projects may be assigned.
- Design, develop, and optimize data pipelines using AWS services such as Lambda, Glue, Redshift, and Athena.
- Collaborate with data scientists and business analysts to support AI and machine learning projects using AWS SageMaker and Bedrock.
- Implement and maintain data visualization solutions using Tableau and Amazon QuickSight.
- Develop and maintain data models, data warehouses, and data lakes to support business initiatives.
- Develop and consume APIs for eAicient data integration and pipeline development.
- Perform root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
- Work closely with business stakeholders to gather requirements and translate them into technical solutions.
- Ensure data quality, governance, and security standards are met throughout all data processes.
- Work in a team environment, using Agile and Scrum methodologies.
- Communicate complex ideas eAectively, both verbally and in writing.
- Anticipate future needs and develop solutions that are robust and future-proof.
- Perform root cause analysis on internal and external data processes to identify opportunities for improvement.
EDUCATION
Bachelor''s Degree in Computer Science, Data Science, or a related field.
EXPERIENCE
- 5+ y ears of work experience in data management disciplines, including data integration, modeling, optimization, and data quality.
- Experience with popular database programming languages, including SQL and PL/SQL for relational databases.
- Strong experience with Cybersecurity / cyber data.
- Strong experience with advanced analytics tools for object-oriented/object function scripting using languages such as Python.
- Experience with AWS data services (eg, Lambda, Glue, Redshift, Athena).
Never miss an opportunity! Create an alert based on the job you applied for.
