Title: Senior Data Engineer
Location: Texas / Arizona / North Carolina
Mode of work: hybrid model, 3 days office, 2 days WFH.
Duration: Long term contract
Note: Candidates who do not require Visa sponsorship are encouraged to apply
Job Description:
The position is responsible for designing, developing, and maintaining data pipelines and infrastructure. This role implements data integration, processing, and analytics solutions in an agile environment while collaborating with cross-functional teams to deliver efficient and scalable data systems.
Responsibilities
Data Pipelines - Design, develop, and maintain data pipelines for efficient data processing and integration for real-time and batch-processing. Implement and optimize ETL processes to extract, load, transform, and integrate data from various sources. Enhance data flows and storage solutions for improved performance
Data Warehousing - Design and implement data warehouse structures. Ensure data quality and consistency within the data warehouse. Apply data modeling techniques for efficient data storage and retrieval
Data Governance, Quality & Compliance - Implement data governance policies and procedures. Implement data quality frameworks, standards and documentation. Ensure compliance with relevant data regulations and standards
Security & Access Management - Implement data security measures and access controls. Maintain data protection protocols
Performance Optimization and Troubleshooting - Analyze and optimize system performance for large-scale data operations. Troubleshoot data issues and implement robust solutions
Testing & Automation Write unit test cases, validate the data integrity & consistency requirements, adopt automated data pipelines using GitLab, Github, CICD tools.
Code Deployment & Release Management - Adopt release management processes to promote code deployment to various environments including production, disaster recovery, and support activities.
Cross-Functional Collaboration - Collaborate with data scientists, analysts, and other teams to understand and meet data requirements. Participate in cross-functional projects to support data-driven initiatives
Qualifications:
Bachelor's Degree and 2 years of experience in Data engineering, database management, or related field OR High School Diploma or GED and 6 years of experience in Data engineering, database management, or related field.
Preferred Experience/Technical/Business Skills: