Paper 2510.14359
AI for Service: Proactive Assistance with AI Glasses
- Published
- Oct 2025
- Research lab
- Independent
- Citations
- 16
- GitHub
- Not linked
01 In brief
Summary
The paper introduces AI for Service (AI4Service), a paradigm for proactive, real-time assistance via AI glasses, contrasting with reactive AI that only responds to explicit commands.
It proposes Alpha-Service, a framework inspired by the von Neumann architecture, comprising five components: Input Unit (perception via dual MLLMs), Central Processing Unit (task orchestration via LLM), Arithmetic Logic Unit (tool use, e.g., web search), Memory Unit (long-term personalization), and Output Unit (human-friendly synthesis).
The system addresses two challenges: 'Know When' (detecting service opportunities from egocentric video) and 'Know How' (providing generalized and personalized services).
Implemented as a multi-agent system on AI glasses, it is validated in three case studies: a Blackjack advisor that proactively suggests hitting/standing based on card analysis, a museum tour guide that identifies artifacts and provides historical context, and a shopping fit advisor that offers styling and purchase advice.
The paper also discusses challenges including computational constraints, generalization vs.
personalization trade-offs, scalability, privacy, and user trust.
Future work includes enhancing memory personalization, expanding tools, and conducting large-scale user studies.
02 From the paper
Abstract
In an era where AI is evolving from a passive tool into an active and adaptive companion, we introduce AI for Service (AI4Service), a new paradigm that enables proactive and real-time assistance in daily life. Existing AI services remain largely reactive, responding only to explicit user commands. We argue that a truly intelligent and helpful assistant should be capable of anticipating user needs and taking actions proactively when appropriate. To realize this vision, we propose Alpha-Service, a unified framework that addresses two fundamental challenges: Know When to intervene by detecting service opportunities from egocentric video streams, and Know How to provide both generalized and personalized services. Inspired by the von Neumann computer architecture and based on AI glasses, Alpha-Service consists of five key components: an Input Unit for perception, a Central Processing Unit for task scheduling, an Arithmetic Logic Unit for tool utilization, a Memory Unit for long-term personalization, and an Output Unit for natural human interaction. As an initial exploration, we implement Alpha-Service through a multi-agent system deployed on AI glasses. Case studies, including a real-time Blackjack advisor, a museum tour guide, and a shopping fit assistant, demonstrate its ability to seamlessly perceive the environment, infer user intent, and provide timely and useful assistance without explicit prompts.