Lead Ab Initio ETL Administrator

  • Posted 31 days ago | Updated 31 days ago

Overview

Remote
$60+
Contract - W2
Contract - 12 Month(s)
No Travel Required

Skills

Ab Initio
Terraform
Amazon Web Services
Amazon EC2
PostgreSQL
Kubernetes
Apache Spark
Amazon S3
Cloud Storage

Job Details

Lead Ab Initio ETL Administrator 12 Month Contract Remote

We are looking for a highly skilled Lead Ab Initio ETL Administrator to join our dynamic IT team. This role requires deep expertise in Ab Initio administration, with hands-on experience in cloud environments such as AWS and Cloudera. The Lead Administrator will oversee the administration of the Ab Initio ETL tool, focusing on both on-premises and cloud-based data integration and data warehousing solutions. This role also involves mentoring junior team members, providing guidance, and potentially leading a team of matrixed resources.

Key Responsibilities:

  • Lead the administration and engineering of Ab Initio ETL processes within a cloud environment (AWS).
  • Support the implementation and maintenance of Data Integration/Data Warehouse solutions, both on-premises and in AWS, for data products.
  • Provide hands-on technical expertise and support for ETL tasks and troubleshooting.
  • Guide and mentor junior team members, fostering a collaborative environment to share knowledge and best practices.
  • Design and manage data pipelines (ETL) from on-premises systems to Data Lakes, Data Factories, and cloud storage solutions like AWS S3 or EBS.
  • Collaborate in architectural and design discussions, representing the team and providing expert input on best practices and implementation strategies.
  • Troubleshoot and resolve issues across various components, including Ab Initio, Cloudera, AWS, and related technologies.
  • Automate ETL processes and workflows using tools like Ansible, Terraform, and scripting languages.
  • Address complex technical challenges related to Kerberos, TLS/SSL, Hive, ICFF, HDFS, and data science workflows.
  • Monitor and track the progress of projects and tasks, ensuring alignment with business goals and timelines.

Qualifications:

  • 10+ years of experience in the administration and engineering of ETL tools, with deep expertise in Ab Initio (including Graphical Development Environment (GDE), Meta Data Hub, and Operational Console).
  • Strong knowledge and experience working with Big Data platforms, particularly Cloudera (Hadoop, HDFS, YARN, Hive, Spark).
  • AWS Cloud experience is required, with hands-on expertise in services such as EC2, S3, RDS, IAM, VPC, and others.
  • Proven ability to design and manage ETL pipelines that integrate on-premises and cloud-based data systems.
  • Expertise in UNIX/Linux, Shell scripting, and SQL.
  • Experience in managing and troubleshooting metadata components like the Metadata Hub (MDH) and operational consoles.
  • Hands-on experience in troubleshooting and addressing issues with cloud infrastructure, including Kerberos, TLS/SSL, and data science tools.
  • Familiarity with CI/CD tools (e.g., Jenkins, GitLab CI) and experience with automation tools (e.g., Ansible, Terraform).
  • Knowledge of containerization technologies (e.g., Docker, Kubernetes) is a plus.
  • Expertise with DB2 and relational databases (e.g., MySQL, PostgreSQL, MongoDB, RDS) is strongly preferred.
  • Ability to track and manage projects, ensuring timely delivery and resolution of technical challenges.

Desirable Skills:

  • Familiarity with cloud-native technologies, such as containerization and orchestration tools (Docker, Kubernetes).
  • Experience with AWS Lambda, Glue, Redshift, and other cloud-based data solutions.
  • Ability to represent the team in architectural and design discussions, providing credible technical input.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.