🕶️ Mentra Live

Continuous, ambient memory recording. Connect Mentra Live smart glasses directly to your private Digital Memory database — capturing your visual world without any cloud relay.

Overview

Mentra Live glasses integrate with Companion Hub to provide always-on, ambient memory capture. Every moment worth remembering — a meeting, a whiteboard session, a spontaneous idea — is logged directly to your local Digital Memory Server without passing through any third-party server.

The CI-Mentra integration handles the Bluetooth/Wi-Fi connection between the glasses and your Hub, transcribes audio using your on-premise Whisper instance, and stores video clips, photos, and transcripts as timestamped memory events.

Key Features

Ambient video capture — configurable continuous or trigger-based recording
On-premise ASR — audio transcribed by your local Whisper model (no cloud)
Visual scene indexing — captured frames are indexed into Digital Memory with CLIP-based embeddings for semantic image search
Companion Agent integration — agents can query visual memories in conversations (“show me the whiteboard from yesterday’s meeting”)
Automatic privacy controls — configurable capture blackout zones (e.g. home network, specific Bluetooth beacons)
Battery-aware capture — reduces capture rate automatically when glasses battery is low

Use Cases

Capture meetings, lectures, and conversations for searchable, private recall
Log visual context throughout your day for Digital Memory enrichment
Ask your local agent “what did I see earlier that mentioned X?”
Build a passive visual diary without using cloud-based lifelogging apps
Combine with Omi for both visual and audio capture

Architecture


Mentra Live Glasses
  │  Bluetooth LE / Wi-Fi Direct
  ▼
CI-Mentra Bridge (Hub app)
  ├──▶  Audio stream ──▶ Whisper (local ASR) ──▶ transcript
  ├──▶  Video/photo ──▶ CLIP embedder ──▶ vector index
  └──▶  Raw media storage ──▶ Hub file store
                               │
                               ▼
                    Digital Memory Server
                    (visual memories, transcripts)

Setup

Install CI-Mentra from the Hub app store

Search for Mentra Live in Companion Hub and install.

Pair your glasses

Put your Mentra Live glasses in pairing mode (hold the side button for 3 seconds until the LED pulses blue)
Open http://mentra.ci.localhost → Devices → Pair New Glasses
Select your glasses from the Bluetooth device list and confirm the pairing code

Configure capture settings

In the Mentra dashboard under Capture Settings:

Set capture mode: Continuous, Motion-triggered, or Manual
Set video resolution and frame rate (lower settings extend battery life)
Configure ASR: select your local Whisper model or disable audio capture

Set privacy zones

Under Privacy → Blackout Zones, define networks (by SSID) or Bluetooth beacons where capture is automatically paused.

Usage

Manual Capture

Double-tap the glasses frame to capture a still photo. Triple-tap to start/stop a video clip.

Reviewing Captures

All captures appear in the Digital Memory timeline under the Mentra source filter. Click any capture to view its transcript, associated embeddings, and related memories.

Searching Visual Memories

From Digital Memory’s search bar, use natural language: “whiteboards from last week” or “outdoor scenes in March”.

Troubleshooting

Glasses not appearing in Bluetooth scan Confirm glasses are in pairing mode. Restart Bluetooth on your Hub machine. Ensure the CI-Mentra container has access to the host’s Bluetooth stack (check Hub → Apps → Mentra → Permissions).

No transcripts appearing Verify a Whisper model is installed and running in Hub. Check Mentra → Settings → ASR → Test Transcription.

Capture dropping frames Reduce resolution or frame rate in capture settings. Check Hub CPU/memory usage — heavy LLM inference can starve the capture pipeline.