Data Engineering Architect (W2 ONLY)

Data Engineering Architect / W2 ONLY / Remote OK, but Charlotte NC Preferred

About our Customer:

Our direct customer, a global Fortune 500 company & a leader in the Food Services industry is looking for a Data Engineering Architect, who will be responsible for designing and implementing robust, scalable, and high-performing data solutions on AWS. Works closely with data engineers, software developers, and business stakeholders to ensure our cloud data infrastructure meets the needs of our growing organization.

Technology Stack: Data Architecture, Python and Angular/TypeScript, AWS services like S3, PostgreSQL, DynamoDB, Athena, Snowflake, Lambda, and Glue.

Must have:       

1. Good background on SQL query writing
2. Strong background on Python coding
3. Data Audit trails
4. Proactive communication

Responsibilities:

• Define, build, test, and implement scalable data pipelines.
• Design and implement cloud-native data architectures on AWS, including data lakes, data warehouses, and real-time data processing pipelines.
• Perform data analysis required to troubleshoot data-related issues and assist in the resolution of data issues.
• Collaborate with development, analytics, and reporting teams to develop data models that feed business intelligence tools.
• Design and build API integrations to support the needs of analysts and reporting systems.
• Develop, deploy, and manage AWS Lambda functions written in Python.
• Develop, deploy, and manage AWS Glue jobs written in Python.
• Ensure efficient and scalable serverless operations.
• Debug and troubleshoot Lambda functions and Glue jobs.
• Collaborate with other AWS service teams to design and implement robust solutions.
• Optimize data storage, retrieval, and pipeline performance for large-scale distributed systems.
• Ensure data security, compliance, and privacy policies are integrated into solutions.
• Develop and maintain technical documentation and architecture diagrams.
• Stay current with AWS updates and industry trends to continuously evolve the data architecture.
• Mentor and provide technical guidance to junior team members and stakeholders.

Qualifications:

• Experience in data architecture, engineering, or similar roles.
• Programming with Python.
• Experience in ETL or Data Engineering role building and implementing data pipelines.
• Strong understanding of design best practices for OLTP systems, ODS reporting needs, and dimensional database practices.
• Hands-on experience with AWS Lambda, AWS Glue, and other AWS services.
• Proficient in Python and SQL with the ability to write efficient queries.
• Experience with API-driven data access (API development experience a plus).
• Solid experience with database technologies (SQL, NoSQL) and data modeling.
• Understanding of serverless architecture benefits and challenges.
• Experience working in agile development environments.
• Highly self-motivated, detail-oriented, and able to work independently.
• Strong analytical thinking, problem-solving, and communication skills.
• AWS certifications (e.g., AWS Certified Data Analytics - Specialty, AWS Certified Solutions Architect) are highly desirable.

Preferred Skills:

• Experience with modern data stack technologies (e.g., dbt, Snowflake, Databricks).
• Familiarity with machine learning pipelines and AI-driven analytics.
• Background in DevOps practices and Infrastructure as Code (IaC) using tools like Terraform or AWS CloudFormation.
• Knowledge of CI/CD pipelines for data workflows.