SnapLink: Fast and Accurate Vision-Based Appliance Control in Large Commercial Buildings

Kaifei Chen, Jonathan Fürst, John Kolb, Hyung-Sin Kim, Xin Jin, David E Culler, Randy H Katz

Publikation: Konference artikel i Proceeding eller bog/rapport kapitelKonferencebidrag i proceedingsForskningpeer review

Abstract

As the number and heterogeneity of appliances in smart buildings increases, identifying and controlling them becomes challenging. Existing methods face various challenges when deployed in large commercial buildings. For example, voice command assistants require users to memorize many control commands. Attaching Bluetooth dongles or QR codes to appliances introduces considerable deployment overhead. In comparison, identifying an appliance by simply pointing a smartphone camera at it and controlling the appliance using a graphical overlay interface is more intuitive. We introduce SnapLink, a responsive and accurate vision-based system for mobile appliance identification and interaction using image localization. Compared to the image retrieval approaches used in previous vision-based appliance control systems, SnapLink exploits 3D models to improve identification accuracy and reduce deployment overhead via quick video captures and a simplified labeling process. We also introduce a feature sub-sampling mechanism to achieve low latency at the scale of a commercial building. To evaluate SnapLink, we collected training videos from 39 rooms to represent the scale of a modern commercial building. It achieves a 94% successful appliance identification rate among 1526 test images of 179 appliances within 120 ms average server processing time. Furthermore, we show that SnapLink is robust to viewing angle and distance differences, illumination changes, as well as daily changes in the environment. We believe the SnapLink use case is not limited to appliance control: it has the potential to enable various new smart building applications.
OriginalsprogEngelsk
TitelProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Antal sider27
ForlagAssociation for Computing Machinery
Publikationsdato2018
Sider129:1-129:27
Artikelnummer129
ISBN (Trykt)2474-9567
DOI
StatusUdgivet - 2018
NavnProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Emneord

  • Smart Buildings
  • Appliance Identification
  • Vision-Based Control
  • Image Localization
  • 3D Models

Fingeraftryk

Dyk ned i forskningsemnerne om 'SnapLink: Fast and Accurate Vision-Based Appliance Control in Large Commercial Buildings'. Sammen danner de et unikt fingeraftryk.

Citationsformater