Smart Kitchen: A Multi-Modal AR System

Research output: Other contributionNet publication - Internet publicationResearchpeer-review

Augmented Reality(AR) is a novel technology that will revolutionize how we work, learn, and play. AR utilizes computer vision, computer graphics, spatial and tangible interaction to augment our perception and understanding of the environment. As academia and industry are improving computer vision and computer graphics methods to facilitate better AR use, current display technologies, such as mobile and projector-camera (Pro-Cam) hinder its widespread adoption and usefulness due to considerable usability challenges. We propose a novel multi-modal AR system that combines both mobile and pro-cam display technologies. By combining mobile and pro-cam systems will not only remove each displays limitations, but complement each others usability strengths to provide longer, higher fidelity AR usage. We apply this contribution in the form of a smart kitchen application, that allows users to be provided instant cooking recommendations and intuitive instructions to prepare dishes. We evaluate our system on several participants, and discuss the potential this system brings for widespread adoption of AR.
Original languageEnglish
Publication date2017
Number of pages10
Publication statusPublished - 2017
Externally publishedYes

ID: 307526282