AI Azure Data & Software Engineer

AI Azure Data Engineer/Software Engineer

Top Consulting is seeking an AI Azure Data Engineer/Software Engineer to design, develop, and maintain scalable data platforms, backend services, and AI-enabled applications. This role combines Azure data engineering, Python development, API integration, and cloud-based application architecture to support reliable data processing, analytics, and machine learning solutions.

Responsibilities

• Design, develop, and maintain Azure data pipelines using Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake Storage Gen2.
• Build and optimize data processing solutions using SQL and Python, ensuring data quality, accuracy, and reliability.
• Develop backend services, REST APIs, and application integrations using Python and FastAPI.
• Implement cloud-based solutions using Azure Functions, containerized services, and event-driven architectures.
• Integrate machine learning models into applications and support feature pipelines and model-serving APIs.
• Leverage Azure AI services to support AI-driven applications and emerging agentic architectures.
• Implement automated testing, CI/CD pipelines, and deployment processes using GitHub and related tools.
• Collaborate with data, software engineering, and AI teams to deliver scalable, secure, and maintainable solutions.

Qualifications

• Experience developing data platforms and pipelines within Microsoft Azure.
• Proficiency in Python and SQL for data processing and application development.
• Hands-on experience with Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake Storage Gen2.
• Experience developing REST APIs and backend services using frameworks such as FastAPI.
• Understanding of cloud-based application development, data orchestration, and application integration.
• Experience with GitHub, CI/CD pipelines, automated testing, and software deployment.
• Knowledge of data quality, validation, and reliable data processing practices.
• Experience with Azure Functions, containerized applications, and event-driven architectures.
• Experience integrating machine learning models into applications and supporting model-serving APIs.
• Familiarity with Azure AI services and AI-enabled application development.
• Understanding of agentic application architectures and AI-driven workflows.
• Experience implementing scalable, production-ready data and software solutions in cloud environments.
• Preferred energy industry experienced.