Article Sidebar
Published:
Apr 6, 2022Article Details
Tanzania Journal of Engineering and Technology (Tanz. J. Engrg. Technol.) publications are written as a basis for academic discussions. Whereas effort is made by the Editorial Board to screen out inaccurate or misleading statements, data or opinions, Tanz. J. Engrg. Technol. wishes to make it clear that the contents of the articles are the sole responsibility of the authors. Accordingly, the Editorial Board and editors, publisher, College of Engineering and Technology and the University of Dar es Salaam accept no responsibility or liability whatsoever for the opinions, inaccurate or misleading data or statement and views expressed by the authors.
However, the College of Engineering and Technology, the publisher of the Journal, reserve all rights of the articles published in the Journal. Whereas the contents of the articles are available electronically without cost, no part of the publication may be transmitted in any form or reproduced electronically or mechanically, except for short extract in critical scholarly review, research or discourse with an acknowledgement.
Main Article Content
Real-time Complex Hand Gestures Recognition Based on MultiDimensional Features
Abstract
Gesture recognition is broadly utilized within the field of sensing. There are basically three gesture recognition methods based on computer vision, depth sensor and motion sensor. Motion sensor-based gesture recognition has few input data, fast speed, and direct access to threedimensional information of the hand. The advantages of traditional motion sensor-based gesture recognition have gradually become a current research hotspot. The essence of traditional motion sensor-based gesture recognition is a pattern recognition problem, and its accuracy depends heavily on the feature dataset extracted from prior experience. Unlike traditional pattern recognition methods, deep learning can be used to a large extent, reducing the workload of artificial heuristic extraction of features. In order to solve the problems of traditional pattern recognition, this paper proposes a real-time recognition method of multifeature gestures based on a long short-term memory network (LSTM), which is verified by sufficient experiments. The method first defines a gesture library of five (5) basic gestures and seven (7) complex gestures. Based on the kinematic characteristics of the hand posture, the angle features and displacement features are further extracted, and then short-time Fourier transform (SFTF) is used. The frequency domain features of sensor data are extracted, and the three features are input into the deep neural network LSTM to train, classify and recognize the collected gestures. At the same time, to verify the effectiveness of the proposed method, a selfdesigned handheld experience stick is collected. The gesture data of six (6) volunteers is used as an experimental data set. The collected experimental results show that the proposed recognition method has a recognition accuracy of 93.50% for basic and complex gestures. Compared with other methods, the recognition accuracy has increased by nearly 2%.
