Volume 14 No 2 (2022): International Journal of Early Childhood Special Education
Gesture Based Virtual I/O System
Pravinkumar Sonsare, Aryan Gupta, Shefali Jindal, Shruti Chittora, Sumeet Gedam and Sushant Dhote
DOI: 10.9756/INT-JECSE/V14I2.289
Keywords: Virtual Keyboard, Hand and Finger Detection, Keystroke Detection, ArUco Marker, Mediapipe, OpenCV
Abstract
This paper presents an advancement in the technology by replacing mechanical keyboard with Virtual Keyword. The objective is to develop a virtual keyboard using hand/finger recognition which tracks the finger position on the keyboard layout. Real time system is being developed by using camera to capture the stream of hand gestures on keyboard printout. ArUco marker is then used to locate the orientation of keyboard in space in camera's field of view. OpenCv library is further used for perspective transformation of frames. The frames obtained are then used to detect the finger position with respect to the keyboard using Mediapipe. Keystroke are then detected by the hover duration.
References
Issue
Volume 14 No 2 (2022): International Journal of Early Childhood Special EducationSection
Research ArticlesCopyright (c) 2020 International Journal of Early Childhood Special Education
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
I accept that the Owner of International Journal of Early Childhood Special Education, the Editor, Associate Editors, Reviewers and the Editorial Board cannot be hold responsible regarding the scope, the findings, the discussion and conclusion of the manuscript submitted. I declare to the editorship of International Journal of Early Childhood Special Education that the manuscript is original and has not been published anywhere else or is not under evaluation process for any other journal. I approve that I grant International Journal of Early Childhood Special Education as the sole and exclusive right and license to publish for the full legal term of copyright of my manuscript concurring with article 5846 / 22-23-25 while I retain copyright in the work.