The Workly logo

Senior Mobile Engineer – iOS/Android

The Workly·Salary not specified

Primary stack

iOSSwiftAndroidKotlinAIJetpack ComposegRPC

Nice to have's

ONNX RuntimeAIPythonNode.jsWhisperExpress

Job description

About the Position

We’re hiring a Senior Mobile Engineer for iOS/Android to develop mobile apps for RayBan Meta smart glasses, focusing on voice-first UX and real-time AI integration.

Responsibilities

  • Own end-to-end development of a companion mobile app that interfaces with RayBan Meta smart glasses via Meta’s Glasses SDK.
  • Implement reliable capture and streaming pipelines for camera preview frames, stills, and multichannel audio, with strict attention to latency, battery, and privacy indicators (camera LED, permissions).
  • Build voice-first UX: wake-word handoff, push-to-talk flows, VAD/ASR/TTS, earcons, and low-latency audio playback on open-ear speakers.
  • Integrate on-phone computer vision and speech models (Core ML, MediaPipe, ONNX Runtime, NNAPI) and orchestrate cloud inference for multimodal LLMs (e.g., Llama 3-family vision/voice) via streaming APIs.
  • Handle transport and connectivity: Bluetooth LE control channels, WiFi/WiFi Direct media streaming, reconnect logic, and state machines for device pairing and session lifecycles.
  • Design resilient, observable pipelines with backpressure, retries, offline fallbacks, and graceful degradation when thermals, bandwidth, or permissions change.
  • Collaborate with product/design on voice-first interaction patterns; run user tests; instrument metrics for latency, accuracy, and task completion.
  • Establish mobile CI/CD, automated testing (unit/integration/BT device-in-the-loop), crash/error analytics, and release processes.
  • Champion privacy-by-design and compliance with platform and bystander-safety policies.

Requirements

  • Minimum qualifications:

    • 5+ years professional mobile engineering experience, shipping native apps at scale on iOS or Android (preferably both).
    • Deep proficiency in:
      • iOS: Swift, SwiftUI/UIKit, AVFoundation, CoreBluetooth, CoreMotion, background modes, concurrency (GCD/AsyncAwait), audio units.
      • Android: Kotlin, Jetpack Compose/Views, Bluetooth/BLE, Camera/Media, Foreground services, Coroutines/Flow.
    • Hands-on with real-time media pipelines and streaming: audio capture/playback, echo cancellation, noise suppression, lipsync/latency budgeting, WebSockets/gRPC/WebRTC, codecs (Opus/AAC/PCM).
    • Solid networking and systems skills: state machines, threading, buffering, backpressure, power/thermal profiling, and debugging on constrained devices.
    • Experience integrating cloud AI services (LLM/ASR/TTS) and handling streaming inference results in the UI.
    • Strong product sense for voice-first UX and accessibility in eyes-up, hands-free contexts.
    • Excellent communication; comfortable working with early/preview SDKs and ambiguous requirements.
  • Preferred qualifications:

    • Prior work with Meta’s Glasses SDK (RayBan Meta) or similar wearables (Apple Watch/visionOS audio, Snap Spectacles, Bose Frames) – if you don’t have this experience, it is fine provided that you are willing to learn Meta Glasses SDK quickly.
    • On-device ML on phone: Core ML/Metal/Accelerate (iOS), MediaPipe/TFLite/NNAPI/GPU delegates (Android), ONNX Runtime Mobile.
    • Multimodal AI integration: experience with Llama-family models, Whisper/Seamless/other ASR, TTS providers, prompt and latency optimization, partial results/streaming UX.
    • BLE expertise: GATT design, connection strategies, MTU/throughput tuning, coexistence with WiFi transport, device provisioning and firmware update flows.
    • WebRTC for low-latency A/V; adaptive bitrate, jitter buffers, AEC/VAD tuning.
    • Backend exposure sufficient to move fast with AI:
      • Python or Node.js for inference gateways (FastAPI/Express), WebSocket servers, request fanout, token streaming.
      • Deploying model servers (Triton, vLLM) and vector/RAG stacks (FAISS/Pinecone), observability (OpenTelemetry), and autoscaling on AWS/GCP/Azure.
    • Security and privacy: keychain/keystore, secure BLE pairing, PII handling, consent UX, regional data controls.
    • QA for hardware-in-the-loop: writing automated tests that exercise glasses events (connect, capture, LED state, battery, IMU), and performance tests for end-to-end latency.

We Offer

  • Competitive salary
  • Remote work options

About the Company

The Workly s.r.o.

4D CENTER, Kodaňská 1441/46,

101 00, Praha 10.

Contact: [email protected] + 420 775 371 991

©2023, All right reserved.

Apply for this position

Our team will review your application within the next 5 days.

Upload Resume

© The Workly. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.

More at The Workly

All 270 roles

Popular searches