Data Engineer - St. Louis , O'Fallon, MO.

Overview

On Site
$DOE
Contract - W2
Contract - 12+Months Contract

Skills

Python
Java
Spark
Hadoop

Job Details

Job Title: Data Engineer
Location : St. Louis , O'Fallon, MO
Duration : Long Term Contract
Only W2. No C2C
Roles & Responsibilities:
Design, develop, and maintain new data capabilities and infrastructure for utilizing Mastercard, third-party, and partner data to enhance Mastercard's data products and solutions
Create new data pipelines, data transfers, and compliance-oriented infrastructure to facilitate seamless data utilization within cloud environments
Identify existing data capability and infrastructure gaps or opportunities within and across initiatives and provide subject matter expertise in support of remediation
Collaborate with technical team and business stakeholders to understand data requirements and translate them into technical solutions
Work with large datasets, ensuring data quality, accuracy, and performance
Implement data transformation, integration, and validation processes to support analytics and reporting needs
Optimize and fine-tune data pipelines for improved speed, reliability, and efficiency
Implement best practices for data storage, retrieval, and archival to ensure data accessibility and security
Troubleshoot and resolve data-related issues, collaborating with the team to identify root causes
Document data processes, data lineage, and technical specifications for future reference
Participate in code reviews, ensuring adherence to coding standards and best practices
Collaborate with DevOps teams to automate deployment and monitoring of data pipelines
Additional tasks as required
Best Regards:
Ramdeep B
Phone: +1-
Email:
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.