ADF Lead / Architect

Position Title: ADF Lead / Architect



Location: New Albany OH (Columbus area)-



Contract Length: - 6+ Months



Tax Term: W2







Job Summary:



We are seeking an experienced Azure Data Factory (ADF) Lead / Architect to design, develop, and support scalable data integration solutions. The ideal candidate will lead end-to-end implementation of ADF workflows, ensure high-quality delivery, and provide production support for data pipelines.






Key Responsibilities:





1. Solution Design & Architecture



Design robust, scalable, and secure data integration solutions using Azure Data Factory (ADF).



Define architecture for data pipelines, ETL/ELT workflows, and data movement strategies.



Collaborate with stakeholders to understand business requirements and translate them into technical solutions.



Establish best practices, standards, and governance for ADF implementations.






2. Development & Implementation



Lead the development of ADF pipelines, data flows, triggers, and linked services.



Implement complex ETL/ELT workflows integrating multiple data sources (SQL, APIs, Blob Storage, etc.).



Optimize pipeline performance, cost, and reliability.



Ensure code quality through reviews and adherence to development standards.






3. Team Leadership



Lead and mentor a team of ADF developers and data engineers.



Allocate tasks, monitor progress, and ensure timely delivery of projects.



Drive technical discussions and decision-making.






4. Production Support & Maintenance



Provide L2/L3 support for production data pipelines and workflows.



Troubleshoot and resolve data pipeline failures, performance issues, and data discrepancies.



Implement monitoring, alerting, and logging mechanisms.



Ensure SLA adherence and system stability.






5. Stakeholder Management



Work closely with business, data, and IT teams for requirement gathering and delivery.



Provide regular status updates and technical guidance to stakeholders.



Participate in client discussions and solution presentations.






Required Skills & Qualifications:



Strong hands-on experience with Azure Data Factory (ADF).



Expertise in designing and implementing ETL/ELT pipelines.



Experience with Azure ecosystem (Azure SQL, Data Lake, Blob Storage, Synapse).



Proficiency in SQL and data modeling concepts.



Knowledge of data warehousing and data integration patterns.



Experience with CI/CD pipelines and deployment automation.



Strong troubleshooting and debugging skills.

Experience:



8+ years of experience in data engineering.



3+ years of hands-on experience with Azure Data Factory.



Prior experience in a lead or architect role is mandatory.






Preferred Skills:



Experience with Python / PySpark / Databricks.



Knowledge of Azure DevOps.



Familiarity with data governance and security practices.



Experience working in Agile environments.