A method of two-handed gesture interactions with applications based on commodity devices

Recent progress on human–computer interface technology has enabled more intuitive and natural communications between humans and sensor‐based devices in many fields such as games, e‐learning, augmented reality (AR), and medical image processing. While traditional human–computer interface devices such as the keyboard and mouse still dominate in our daily life, we propose a new method of two‐handed gesture interactions to control applications based on commodity devices such as Wiimote, the primary controller for Nintendo’s Wii game console. Our main goal is to construct a unified way to interact with computers and their application systems just like using home appliances. The proposed system allows users to track their fingers moving in three‐dimensional space in real time and define each gesture’s function by using the commodity devices.