Human‐centric design personalization of 3D glasses frame in markerless augmented reality

This paper presents a virtual try‐on system based on augmented reality for design personalization of facial accessory products. The system offers several novel functions that support real‐time evaluation and modification of eyeglasses frame. 3D glasses model is embedded within video stream of the person who is wearing the glasses. Machine learning algorithms are developed for instantaneous tracking of facial features without use of markers. The tracking result enables continuously positioning of the glasses model on the user’s face while it is moving during the try‐on process. In addition to color and texture, the user can instantly modify the glasses shape through simple semantic parameters. These functions not only facilitate evaluating products highly interactive with human users, but also engage them in the design process. This work has thus implemented the concept of human‐centric design personalization.