Zum Diktieren von einfachen Texten habe ich bis jetzt immer eine Online App verwendet. Da ich aber nicht mehr möchte, dass meine Stimme auf irgendwelchen Servern verarbeitet wird, habe ich eine einfache App entwickelt, welche rein lokal arbeitet.
This paper focuses on enhancing touch-typing skills through state-of-the-art deep learning technologies. It has been demonstrated that writing posture can be assessed using integrated keyboard detection and hand pose estimation in real-time browser environments. A unique dataset was created for training the object detection model to recognize individual keyboards. The object detection models were trained using various architectures and then assessed for both inference time and accuracy. In addition, a hand pose estimation was implemented to precisely recognize 21 knuckle points of the hand and compute their exact positions. In order to implement object detection and hand pose estimation, a stream transmission of the keyboard and hand scene is required. For this purpose, server-client communication via a QR code connection is implemented to transfer the stream between two mobile devices. Based on these deep learning technologies, a mobile web app was developed that offers 170 learning courses for touch-typing training. With the help of the Typing Learning Academy prototype, a study was conducted as part of this paper to evaluate the usability and utility of the learning app. This research demonstrates the potential for enhancing the development of writing skills through touch typing through the utilization of advanced deep learning technologies.