AR Operator AssistAugmented Machine Guidance
UI / UX Concept · v1

Point. Ask. Be guided through the machine — step by step.

The operator raises a question by voice or text and points the phone at the console. The app recognizes the screen and overlays exactly which control to touch — correcting them in real time if they stray off-path.

Download the Android demoAPK · Android 7+ · ~50 MB
PROJECT  AR Machine Assistant
PLATFORM  iOS · Android
RUNTIME   On-prem · No cloud
DATE      2026·06·18
9:415G  ▮▮▮  87%
On-prem · Secure
// Operator · Line 3
What do you
want to do?
⚡ Change temperature Start a new batch Calibrate sensor Safe shutdown
Injection Molder X200● Recognized · console online
Ask or speak a task
01 · Intake

Ask by voice or text

Chatbot-style intake. The app already knows which machine it's looking at, and an on-prem badge keeps the trust signal front and centre.

9:415G  ▮▮▮  86%
Heater · Zone 1 setpoint
180→ 200°C
MODE: MANUAL● READY
MENU
TEMP ▲
Raise heat
TEMP ▼
START
STOP
ESC
CONSOLE · MOLDER X200MATCH 98%
On track
Step 2 of 4
Press TEMP ▲ to raise the Zone 1 setpoint toward 200 °C.
This is the heater increase key — hold it until the display reads 200°C.
I pressed it →
02 · Guidance

The control, highlighted live

A pulsing HUD reticle locks onto the exact key. The instruction card states the move and the reason, with one-tap voice replay. Re-checks after every action.

9:415G  ▮▮▮  86%
⚠ Maintenance · diagnostics
SVCmenu
LOCKED● NOT YOUR STEP
◀ BACK
Go back here
DIAG
LOGS
SVC
CAL
EXIT
CONSOLE · MAINTENANCEOFF PATH
Wrong screen
Off track · paused
This is the Maintenance menu. Press ◀ BACK to return to the main screen.
You've stepped off the temperature task — guidance is paused until you're back on the right screen.
Take me back
03 · Self-correct

Catches a wrong turn

If the operator opens the wrong menu, the app detects it, pauses the task, and guides them back — the differentiator that makes this more than a chatbot.