Int J Performability Eng ›› 2022, Vol. 18 ›› Issue (6): 396-406.doi: 10.23940/ijpe.22.06.p2.396406

Previous Articles     Next Articles

Human Computer Interaction using Virtual User Computer Interaction System

Shaorya Raj, Tuhin Kalia, Shivansh Aggarwal, Sahil Jaglan, Nikita Nijhawan*, and Mugdha Sharma   

  1. Department of Computer Science and Engineering, BPIT, GGSIPU, Delhi, India
  • Submitted on ; Revised on ; Accepted on
  • Contact: * E-mail address: nikita.nijhawan12@gmail.com

Abstract: This paper proposes a real-time hand gesture recognition interface called VUCIS (Virtual User Computer Interaction System) to operate a mouse, keyboard and stylus. OpenCV and MediaPipe Hands are used to achieve this. OpenCV is utilized for its powerful image processing capabilities and computer vision. MediaPipe Hands library is used to generate 21 landmarks on a hand. By using a combination of various landmarks, a distinct gesture is assigned to a task performed by the input devices. The proposed interface allows users to interact with computers easily, reduces the need for keyboard and mouse as external hardware in certain circumstances and eliminates any form of contact with a surface, minimizing the spread of COVID-19.

Key words: human computer interaction (HCI), hand gesture recognition, virtual mouse, virtual keyboard, virtual stylus