Software Engineer - Hardware to Software Integration

Summary:

• Client is looking for a software engineer to join the Research Incubation team, which is dedicated to delivering AI models that perceive and interpret human behaviors and actions on wearable devices. The team is currently developing a research prototype for wearables, and this role will work closely with machine learning research scientists to deploy advanced models onto these devices and integrate them with user experiences. The ideal candidate will understand model capabilities, collaborate with the glass hardware teams, and partner with designers to build proof-of-concept experiences that ensure the technology delivers intuitive and impactful user interactions.

Job Responsibilities:

• Develop software systems for research prototypes that run on a cascaded edge-device plus cloud compute architecture
• Work with designers and prototypers to build interactive experiences across smartglasses, cloud, and mobile devices
• Work with ML engineers and researchers to integrate machine learning models to the prototype system.
• Maintain and update the prototype system to accommodate evolving interactive experiences and progress in ML models.

Skills:

• Experience with Android development on edge devices such as smart glasses and phones
• Strong programming ability in C/C++ and Python
• Creativity, verbal and written communication skills and problem-solving ability are required.
• Expert problem solving and conflict resolution skills

Preferred Skills:

• Experience with integrating computer vision and machine learning models such as hand tracking in real-time experiences
• Development experiences on glasses or other smartglasses
• Experience with real-time 3D development for AR/VR, including in Unity or Unreal
• Strong ability integrating various data streams into Unity to enable prototyping
• Strong ability to visualize in 3D and understanding of user experiences for wearable devices
• Experience integrating LLMs such as Llama into applications

Education/Experience:

• Bachelor's degree in relevant field or equivalent work experience required

Top 3 must-have HARD skills:

• Experience with Android development on edge devices such as smart glasses and phones
• Strong programming ability in one or more languages (C#, C/C++, Python, Java)
• Creativity, verbal and written communication skills and problem solving ability are required.
• Expert problem solving and conflict resolution skills

Good to have skills:

• Experience with integrating computer vision and machine learning models such as hand tracking in real-time experiences
• Development experiences on glasses or other smartglasses
• Experience with real-time 3D development for AR/VR, including in Unity or Unreal
• Strong ability integrating various data streams into Unity to enable prototyping
• Strong ability to visualize in 3D and understanding of user experiences for wearable devices
• Experience integrating LLMs such as Llama into applications