Machine Learning Validation Automation Engineer

We are the Product Systems Quality team and we are looking for a highly motivated and experienced automation engineer with a passion for delivering robust, inclusive, and state-of-the-art Computer Vision and Machine Learning algorithms in Apple's next generation of products. You'll enjoy working on a team of quality engineers with a diverse group of backgrounds as we refine the model pipelines that power Apple's trademark simple and intuitive user experience.\\n\\nCome be a part of our team and use both creativity and technical expertise to bring experiences to life that our customers love!

We are seeking an experienced Automation Engineer to lead the design and implementation of data collection and evaluation pipelines for Apple's ML systems. In this role, you will design, develop and maintain automation frameworks and validation pipelines for machine learning models.\n\nYour work will require close partnership with algorithm development teams to build tools for analyzing and visualizing data, evaluate and represent the true customer experience, design and implement experiments for engineering studies. You will develop and execute validation strategies to ensure the models meet accuracy & reliability requirements as well as create visualization for comparing model validation results across configurations to enable root cause analysis for failures. You'll have opportunity to take ownership of issues, drive them to resolution and continuously improve tests and processes with a drive towards innovation and automation.\n\nYou'll be working through every step of the product development cycle and will help make Apple products more reliable, flexible, and easy to use.

Bachelor's degree or equivalent in Computer Science, Machine Learning or related field\nA minimum of 3 years of hands-on industry experience developing or validating ML/AI systems\nProficiency in Python with strong background in test automation and test infrastructure design\nExperience working with large datasets for testing products utilizing computer vision or machine learning\nAbility to communicate effectively and collaborate with partner teams

5 or more years of ML industry experience, including time spent debugging or improving deployed models\nExperience with analytical tools such as Jupyter, Pandas, NumPy, Matplotlib\nExperience in training models using frameworks like PyTorch, TensorFlow\nData analysis, visualization, and reporting experience with tools such as Tableau, or Splunk