Data Reliability Engineer- PostgreSQL

As a Data Reliability Engineer, you will play a crucial role in developing, optimizing, and managing several large data lakes and data warehouses, comprising data from multiple disparate sources.

Responsibilities:

• Need a data engineer with extensive experience in PostgreSQL and AWS, who has previous experience creating data pipelines (ETL/ELT). He / She who have previous experience in creating data pipelines ( ETL / ELT)
• Proactively monitor PostgreSQL RDS instances for performance, availability, and resource utilization (CPU, memory, storage, connections) using established monitoring tools (e.g., CloudWatch, Prometheus).
• Assist in identifying performance bottlenecks in PostgreSQL RDS. Apply basic performance tuning techniques like reviewing query execution plans, adding missing indexes, and recommending parameter adjustments.
• Monitor the health and performance of Debezium and Kafka Connect connectors, identifying and troubleshooting basic issues related to data capture and delivery.
• Monitor ETL workflows and data pipelines for errors, performance bottlenecks, and processing delays. Troubleshoot and resolve issues to ensure reliable and timely data movement.
• Provide support for data-related issues and participate in root cause analysis.
• Monitor the execution of Apache Airflow DAGs, identify failed tasks, and troubleshoot and re-run them.
• Develop and maintain automation scripts and infrastructure as code (IAC) templates (e.g., using Crossplane, Terraform) to automate routine database tasks, deployments, and updates.
• Participate in on-call rotations to respond to database-related incidents and perform troubleshooting and root cause analysis.
• Assist in implementing and maintaining security best practices for cloud databases, including access controls, encryption, and compliance with regulatory requirements.
• Regularly audit and assess database security configurations.
• Configure and manage database backup and recovery strategies to ensure data integrity and availability in case of failures or data loss.
• Analyse database query performance and collaborate with developers to optimize SQL queries and schemas.
• Participate in continuous improvement initiatives to enhance the reliability, scalability, and performance of cloud databases.

Experience and Qualifications:

• Bachelor's degree in computer science, Information Technology, or a related field.
• 5-8 years of experience in data Engineering, with a focus on PostgreSQL.
• 2-4 years of hands-on experience with PostgreSQL RDS

Regards,

Raj Dakshinapu | Recruiter, Dotcom Team LLC

Phone:

Web:  | Email:

2023 Best Places to Work – Boston Business Journal

Minority Certified – Boston Business Journal’s Top Ten 2022, 2023

Certified National Minority Supplier – NMSDC