Smart glass applications

What runs on smart
glasses, and what to build

A source-checked 2026 scan of the smart-glasses application market, the use cases shipping today, and what a studio like ours can realistically build, on which platforms.

The shape of the market

Two engines, pulling in different directions

The market is not one thing. A consumer wave of camera-and-voice glasses is booming, and a steady enterprise business of hands-free work apps keeps growing. They need different apps and different devices.

Consumer surging

Display-less AI glasses, a camera plus voice plus audio, no screen. Meta owns it. The apps are capture, a voice assistant, live translation, and accessibility.

Ray-Ban Meta and Oakley Meta, Rokid, RayNeo. Volume is here, but the platform is closed and Meta-led.

Enterprise proven

Rugged hands-free glasses for real work. The proven apps are see-what-I-see remote help, vision picking, guided assembly, and inspection.

RealWear, Vuzix, Rokid, Moziware, Epson, driven by device-agnostic platforms like TeamViewer Frontline and VSight.

The numbers

A consumer boom, led by Meta

These are analyst estimates from IDC, Counterpoint, and Omdia. Each firm counts the category a little differently, so do not add the totals, but the direction is the same: steep growth.

+0%
display-less AI glasses growth, Q1 2026 year on year (IDC)
0M
AI glasses shipped in 2025, up 322% (Omdia)
0M+
AI glasses forecast for 2026 (Omdia)
~0%
Meta share of the market, the runaway leader

IDC also forecasts the steepest growth in display glasses (41.9% CAGR to 2030) and mixed reality (34.4% CAGR), but from a small base today. The volume right now is the no-display camera-and-voice glass.

The application map

Where each app sits, drawn out

Every use case placed by its market (consumer or enterprise) and how proven it is today. The top row is shipping at scale. The bottom is still emerging.

PROVEN & SHIPPING AT SCALE EMERGING ◀ Consumer Enterprise ▶ How proven today → POV capture & livestream AI voice assistant Live translation Live captions & accessibility Heads-up navigation Notifications & HUD Remote assist · see-what-I-see Vision picking Inspection & QA Guided assembly Field service Training & onboarding
Consumer use case Enterprise use case

Placement is our read of the verified 2026 evidence. Healthcare, surgery, and fitness exist but did not reach confirmed deployment data in this pass, so they are not plotted.

See the consumer apps for real

The six proven jobs, each in a real video

The same six consumer use cases from the top-left of the map, each shown working on real shipping glasses. These are vendor and reviewer clips, not our own build. Meta leads the consumer market, so it appears more than once.

POV capture & livestream

Ray-Ban Meta glasses streaming a hands-free, first-person view straight to Instagram.

Ray-Ban Meta · CNET ↗
AI voice assistant

Talking to the Meta AI assistant on Ray-Ban Meta, hands-free with "Hey Meta" and look-and-ask.

Ray-Ban Meta · Waveform ↗
Live translation

TCL RayNeo display glasses translating a spoken conversation into captions on the lens.

TCL RayNeo · CNET ↗
Live captions & accessibility

XRAI turning live speech into real-time subtitles on the lens, built for deaf and hard-of-hearing users.

XRAI AR2 · XRAI Glass (official) ↗
Heads-up navigation

Voice-activated Google Maps turn-by-turn navigation shown on the lens of Rokid Glasses.

Rokid Glasses · Rokid (official) ↗
Notifications & HUD

The Even Realities G1 showing messages and a quiet heads-up display in everyday wear.

Even Realities G1 · MrMobile ↗

What each one does, and where it stops

The honest limits, function by function

For each consumer job above, what it really does today and where it falls short, checked against 2026 sources. The green line is what you get. The crosses are what not to expect.

POV capture & livestream

Ray-Ban Meta · Oakley Meta · Rokid

Hands-free photos, short first-person video, and livestream, by a tap or your voice.

  • Livestream goes only to the maker's own apps (Facebook, Instagram, Twitch), not straight to YouTube or TikTok.
  • No viewfinder, so you aim with your head, and a live session lasts about 30 minutes before heat and battery stop it.
  • It only works while tied by Bluetooth to the maker's app on a nearby phone.

AI voice assistant

Ray-Ban Meta · Rokid · Even G1

Hands-free "Hey Meta" voice answers, plus look-and-ask about what the camera sees.

  • Not standalone. It needs a paired phone and the internet, because answers run in the cloud.
  • Look-and-ask is English-first and does not work in Japanese or Thai.
  • Answers can be wrong or made up and get worse in noise. Meta's on-glass AI is closed, so you cannot swap in Gemini or Siri.

Live translation

Ray-Ban Meta (audio) · RayNeo / Even / Rokid (on-lens)

Turns foreign speech into your language a second or two later, by ear or as on-lens captions.

  • A 1 to 5 second lag, and accuracy drops in noise, fast talk, accents, and slang.
  • Most need the phone, the internet, and sometimes a paid plan, and weaken offline.
  • Japanese works on display glasses but not Ray-Ban Meta's live chat, and Thai is rare (mainly Rokid).

Live captions & accessibility

XRAI AR2 · Meta Ray-Ban Display · Even G1/G2

Shows nearby speech as live text on the lens, so a deaf or hard-of-hearing user can read a conversation.

  • Accuracy is high only up close in a quiet room, and falls to about 85% a few meters away or in noise.
  • Most need a paired phone and the internet, and battery lasts only a few hours.
  • A support tool, not a replacement for hearing aids or human interpreters. Thai is weak or absent.

Heads-up navigation

Meta Ray-Ban Display · Even G1 · audio glasses

Shows a walking arrow, street name, and a mini-map on the lens, or speaks the turns on audio glasses.

  • Walking only. It shuts off at bike or car speed and hands driving back to the phone.
  • It needs the phone and precise location, and GPS drifts between tall buildings.
  • It uses the maker's own map, not Google Maps, and is not sold or supported in Japan or Thailand yet.

Notifications & HUD

Even G1/G2 · Halliday · Rokid

Shows phone notifications, messages, calendar, and a teleprompter on a small lens display.

  • On most glasses you can only read or dismiss, not reply, so you still reach for the phone.
  • The display is a tiny green text window (about 25 degrees) with no images, and it washes out in sunlight.
  • It depends on the phone and the app, and the smarter features run in the cloud.
The common thread

Every consumer function leans on a paired phone, a cloud connection, and the maker's own closed platform, and Japanese and Thai support is patchy. That is exactly why the client's plan keeps the heavy work on a phone we control and does not depend on consumer on-glass AI. See the decision and the preview.

The clearest opening of 2026

Microsoft is leaving the room

Microsoft is retiring Dynamics 365 Guides and Remote Assist. New sales and renewals stopped on 1 November 2025, and support ends on 31 December 2026. A flagship HoloLens-era guided-work and remote-assist product is being switched off while demand stays.

That vacates a large incumbent slot and creates a real migration window. Displaced customers need somewhere to go, and the proven independent platforms (TeamViewer Frontline, VSight, Librestream, Help Lightning) are the obvious targets. A studio can build the migration, the integration, or a focused custom app around it.

What is possible to develop

Easy now, harder, and not yet

The honest build picture for a studio. Most enterprise value sits in the easy tier on cheap glasses. The rich spatial work is real but heavier, and a few things are still blocked.

Easy, buildable now

  • 2D hands-free voice apps on industrial glasses, checklists, work instructions, data capture (RealWear, Vuzix).
  • See-what-I-see and camera apps, barcode, OCR, photo capture (Vuzix Camera2, or integrate a platform).
  • POV capture companions on Meta consumer glasses, through the new Wearables Device Access Toolkit.
  • WebXR experiences, light AR with broad reach and no install.

Harder, more effort

  • Full 6DoF spatial apps on XREAL (NRSDK), Snapdragon Spaces, Android XR, or Unity with OpenXR.
  • On-headset vision and measurement on Quest 3, with the Passthrough Camera, Depth, and Mesh APIs.
  • Reliable ±1–2 cm measurement, which needs depth or 6DoF hardware and must be tested on the device.

Not yet, or blocked

  • Meta's on-glass AI and voice are not exposed. A consumer AI-assistant app must run in the paired phone, not on the glasses.
  • Glass-only metrology on lightweight 3DoF glasses, there is no depth to build on.
  • Rich consumer AR display apps at scale, the display-glasses base is still small.

Platforms and SDKs

What each one lets you build

The toolkits a studio would actually use, and the kind of app each one is for. Difficulty is the build effort, not the price.

Platform / SDKWhat you buildOpennessEffort
RealWear WearML / WearHF
Industrial glasses
2D hands-free voice and heads-up apps. Checklists, forms, work steps. No camera CV or depth.Open Android, voice and display onlyEasy
Vuzix SDK
Android, Camera2
2D heads-up plus camera apps. See-what-I-see, barcode, OCR, capture, on-device CV.Open AndroidEasy
Meta Wearables Device Access Toolkit
Ray-Ban / Meta AI glasses
Camera and audio into your own iOS or Android app, POV capture flows. Meta AI and voice are NOT exposed.Curated, camera and audio onlyEasy
WebXR · Unity + OpenXR
Cross-device
Web AR with broad reach, and cross-engine spatial apps. Good for prototypes and portability.Open standardsMedium
XREAL NRSDK
6DoF AR glasses
Raw camera, 6DoF tracking, and a depth mesh. Spatial overlays and measurement on 6DoF models.Open, 6DoF models onlyMedium
Qualcomm Snapdragon Spaces
OpenXR
Portable 6DoF AR across Snapdragon glasses and phones. Being folded into Google Android XR, so target Android XR for new work.Open, OpenXRHarder
Meta Quest · Spatial SDK + Passthrough Camera
MR headset
Full 6DoF mixed reality, raw camera CV, depth, and room mesh. Training, design review, measurement.Open store, full accessHarder
Google Android XR · Jetpack XR
New platform
Next-generation open Android spatial apps, with the Play store. Early in 2026, the long-term bet.Open Android XRHarder

The Meta toolkit and the market data are verified in this pass. The deeper SDK capabilities (Quest, XREAL, RealWear, ARCore) are verified in our earlier build-feasibility research. Treat the newest platforms (Android XR) as moving fast, re-check before committing.

Which device for which app

Match the app to the glass

Cheap industrial glasses

RealWear · Vuzix · Moziware · Epson

  • See-what-I-see remote help
  • Vision picking and inspection
  • Voice-driven work instructions
  • Data capture and checklists

Consumer AI glasses

Meta · Rokid · RayNeo

  • POV capture and livestream
  • Live translation and captions
  • Accessibility (Be My Eyes)
  • AI assistant, run in the phone

MR / VR headsets

Quest 3 · Vision Pro

  • Full spatial training and simulation
  • 3D measurement and design review
  • Rich guided assembly
  • Anything needing depth and 6DoF

Where the opportunity is

What we would build

Safest demand

See-what-I-see remote help, vision picking, and inspection on industrial glasses. Proven, with a clear buyer. Build a focused app or integrate a platform, and ride the Microsoft migration.

Biggest reach

Camera and POV companion apps on Meta glasses, the dominant consumer platform. Keep the AI in the phone for now, since the on-glass AI is not open.

Growth bet

Spatial apps on display glasses and MR headsets, the steepest growth curves. A two-to-four year horizon for differentiated visual and 3D work.

Sources and confidence. Market figures are analyst estimates from IDC, Counterpoint, and Omdia, with different category definitions, so the totals should not be added. Capability claims rest on vendor and platform pages (TeamViewer, VSight, Meta developer docs) and Microsoft's official lifecycle notice, separated from marketing outcome claims. Healthcare, surgery, training, and guided-assembly demand are real categories but did not reach confirmed 2026 deployment data in this pass. See the strategy and journey for the device-level detail.