This is a remote position.

We’re hiring a Senior Engineer to build production mobile apps and services that integrate with Meta’s Glasses SDK for RayBan Meta smart glasses. You’ll design and ship hands-free, voice-first, vision-enabled experiences that span the glasses, a companion iOS/Android app, and cloud AI. This is a highly cross-functional role at the intersection of mobile, real-time audio/video, Bluetooth/WiFi transport, and multimodal AI.

What You’ll Do

Own end-to-end development of a companion mobile app that interfaces with RayBan Meta smart glasses via Meta’s Glasses SDK
Implement reliable capture and streaming pipelines for camera preview frames, stills, and multichannel audio, with strict attention to latency, battery, and privacy indicators (camera LED, permissions)
Build voice-first UX: wakeword handoff, push-to-talk flows, VAD/ASR/TTS, earcons, and low-latency audio playback on openear speakers
Integrate on-phone computer vision and speech models (Core ML, MediaPipe, ONNX Runtime, NNAPI) and orchestrate cloud inference for multimodal LLMs (e.g., Llama 3family vision/voice) via streaming APIs
Handle transport and connectivity: Bluetooth LE control channels, WiFi/WiFi Direct media streaming, reconnect logic, and state machines for device pairing and session lifecycles
Design resilient, observable pipelines with backpressure, retries, offline fallbacks, and graceful degradation when thermals, bandwidth, or permissions change
Collaborate with product/design on voice-first interaction patterns; run user tests; instrument metrics for latency, accuracy, and task completion
Establish mobile CI/CD, automated testing (unit/integration/BT device in the loop), crash/error analytics, and release processes
Champion privacy by design and compliance with platform and bystander safety policies

Jobs

Senior Mobile Engineer – iOS/Android, Realtime AI

Posts