Senior Data Engineer

Work Location

Hybrid, 3 days onsite & 2 days remote

Office Location: 1900 Aldrich St Austin, TX 78723

Candidates must be local to Austin, TX or surrounding areas.**

Job Description

We are currently seeking a contract Senior Data Engineer to be a key resource on a technical services team for our client, the Teacher Retirement Systems of Texas (TRS).

Responsibilities

Client is seeking a hands-on Senior Data Engineer with extensive experience (Hands on) in Azure data services and Databricks.

Responsibilities:

• Design and implement data solutions using Azure services (e.g., Synapse Analytics, Databricks, Snowflake, Azure SQL, Azure Blob Storage, ADLS Gen2, Azure Functions, Azure Key Vault, AI/ML).
• Develop data pipelines and transformations (ETL/ELT).
• Collaborate with stakeholders to understand data requirements and deliver solutions.
• Ensure data solutions are scalable, reliable, and secure.
• Implement CI/CD and DevOps practices.
• Maintain and publish code to GitHub.
• Follow PMO/Scrum master instructions using Agile/Scrum methodologies.

Qualifications

Minimum (Required):

• 10+ years of: IT experience, including a minimum of 5 years as a Data Engineer.
• 5+ years of: Experience with the Azure cloud platform.
• Proven experience with Azure data services (e.g., Azure Key Vault, Azure Blob Storage, ADLS Gen2, Databricks Pipeline, Log Analytics, Logic App, Purview, Azure Functions).
• Experience with Databricks, Microsoft Fabric, Power Automate, Power BI and SQL.
• Proficiency in Python, SQL, API, and PySpark.
• Expertise in optimizing ETL processes, data warehouse, and data lake management.
• Experience with CI/CD and DevOps practices.
• Experience with structured, unstructured, and semi-structured data.
• Experience with maintaining and publishing code to GitHub.
• Ability to work in a cross-functional team and coordinate with Infra/Ops and Information Security departments.
• Experience with requirement gathering and Scrum methodologies

Preferred (Optional):

• Experience with on premises to Azure cloud migration.
• Knowledge of Snowflake, Microsoft Fabric, Microsoft Purview, AI/ML, streaming data services, and marketplace data services.
• Relevant certifications.
• Experience with multiple cloud implementations.

Company Overview

Allied Consultants has been contracted with the Texas State Government for 34 years, we are a Top Ten ranked vendor, and premier provider of technical and business staffing solutions. Allied Consultants offers its family of consultants excellent rates, a local support staff, and an attractive benefits package which includes medical insurance (Allied shares a percentage of the cost), life insurance, a matching 401(k) plan and a cafeteria plan. Candidates selected for interview will be required to undergo criminal background checks and may be required to complete a drug screen in accordance with Federal and State Law. Offers of Employment are contingent on a successful background check. Allied Consultants is an equal opportunities employer.