Bengali Air Writing Using Wearable Wireless Motion Sensors
Date
2025-10-25
Journal Title
Journal ISSN
Volume Title
Publisher
Department of Computer Science and Engineering(CSE), Islamic University of Technology(IUT), Board Bazar, Gazipur-1704, Bangladesh
Abstract
Air-writing with body-worn inertial sensors is a promising, camera-free pathway to
text input on constrained or screenless devices. Yet Bengalione of the worlds most
widely used scriptsremains sparsely represented in public corpora, limiting repro
ducibility andcomparativeprogress. Weintroduceamotion-sensorBengaliair-writing
dataset comprising 3,996 single-character trials spanning 60 core symbol classes (vow
els, consonants, digits), captured with a wrist/hand-mounted 6-DoF IMU at 200 Hz
under a controlled 2×3×2 protocol varying handedness (dominant/non-dominant),
writingspeed(slow/normal/fast),andenvironment(normal/noisy). Acue-basedready
go–write–hold procedure, deterministic file naming, and self-describing CSVs with
user/session metadata support transparent filtering, canonical splits, and faithful re
analysis.
We benchmark recognition using classical machine-learning pipelines built on com
pact time/frequency and cross-axis features, alongside sequence models that consume
minimally processed IMU streams. The baselines verify the feasibility of IMU-based
Bengalicharacterrecognitionwhilesurfacingpersistentfine-grainedconfusionsamong
kinematically similar graphemes, cross-condition generalization gaps (hand/speed/en
vironment), and the difficulty of writer-independent performance without personal
ization. We further outline evaluation tracks for streaming, online decoding (joint
boundary detection and classification) to bridge from trial-bounded clips to real-time
interfaces.
As of our study, this is the second publicly described IMU-captured Bengali air-writing
corpus with adocumented acquisitionprotocol andreproduciblebaselines. Byreleas
ing data, canonical splits, and challenge definitions, weprovidearigorousfoundation
for future work on rotation-/tempo-robust representations, few-shot personalization,
and low-latency decodingadvancing inclusive, privacy-preserving text input for non
Latin scripts
Description
Supervised by
Mr. Mohammad Ridwan Kabir,
Assistant Professor,
Dr. Hasan Mahmud,
Professor,
Department of Computer Science and Engineering (CSE)
Islamic University of Technology (IUT)
Board Bazar, Gazipur, Bangladesh
This thesis is submitted in partial fulfillment of the requirement for the degree of Bachelor of Science in Computer Science and Engineering, 2025
Keywords
Citation
[1] M.S. Alam, K. C. Kwon, M. A. Alam, M. Y. Abbass, S. M. Imtiaz, and N. Kim, “Trajectory-based air-writing recognition using deep neural network anddepth sensor,” Sensors, vol. 20, no. 2, p. 376, 2020. doi: 10.3390/s20020376 [2] C.Amma,M.Georgi,andT.Schultz,“Airwriting:Awearablehandwritingrecog nition system,” Personal and Ubiquitous Computing, vol. 18, no. 1, pp. 191–203, 2014. doi: 10.1007/s00779-013-0637-3 [3] A. Brink, M. Tahir, J. Fierrez, and R. Guest, “Knowledge transfer for writer identification,” in Progress in Pattern Recognition, Image Analysis, Computer Vi sion, and Applications (CIARP 2017), ser. Lecture Notes in Computer Science, vol. 10657,Springer,2017,pp.163–170.doi:10.1007/978-3-319-75193-1_13 [4] R. R. Chowdhury, M. S. Hossain, R. U. Islam, K. Andersson, and S. Hossain, “Banglahandwrittencharacterrecognitionusingconvolutionalneuralnetwork with data augmentation,” in 2019 Joint 8th International Conference on Infor matics,ElectronicsandVision(ICIEV)and3rdInternationalConferenceonImag ing,Vision&PatternRecognition(icIVPR),IEEE,2019,pp.91–95.doi:10.1109/ ICIEV.2019.8858545 [5] O.De,P.Deb,S.Mukherjee,S.Nandy,T.Chakraborty,andS.Saha,“Computer vision based framework for digit recognition by hand gesture analysis,” 2021 IEEE 12th Annual Information Technology, Electronics and Mobile Communi cation Conference (IEMCON), pp. 1–5, Oct. 2016. doi: 10.1109/iemcon.2016. 7746361 [Online]. Available: https://doi.org/10.1109/iemcon.2016. 7746361 [6] W. H. Gomaa and A. Khamis, “Feature engineering and preprocessing tech niques for inertial data in har,” Sensors, vol. 23, no. 5, pp. 1125–1142, 2023. [7] Y.Gu,H.Oku,andM.Todoh,“Americansign language recognition and trans lation using perception neuron wearable inertial motion capture system,” Sen sors, vol. 24, no. 2, p. 453, 2024. doi: 10.3390/s24020453 50 [8] C.-H.Hsieh,Y.-S.Lo,J.-Y.Chen,andS.-K.Tang,“Air-writingrecognitionbased ondeepconvolutionalneuralnetworks,”IEEEAccess,vol.9,pp.142827–142836, 2021. doi: 10.1109/ACCESS.2021.3121093 [9] H.Jeon, H. Choi, D. Noh, T. Kim, and D. Lee, “Wearable inertial sensor-based hand-guiding gestures recognition method robust to significant changes in the body-alignment of subject,” Mathematics, vol. 10, no. 24, p. 4753, 2022. doi: 10.3390/math10244753 [10] F.OttandM.Wehbi,“Theonhwdataset:Onlinehandwritingrecognitionfrom imu-enhanced ballpoint pens with machine learning,” Proceedings of the ACM on Interactive,Mobile,WearableandUbiquitousTechnologies,vol.4,no.2,pp.1 23, 2020. doi: 10.1145/3411842 [11] A. Qedear, A. AlMatrafy, A. Al-Sowat, A. Saigh, and A. Alayed, “Real-time air-writing recognition for arabic letters using deep learning,” Sensors, vol. 24, no. 18, p. 6098, 2024. doi: 10.3390/s24186098 [12] C. Qu, “Online kinect handwritten digit recognition based on dynamic time warping and support vector machine,” Journal of Information and Computa tionalScience,vol.12,no.1,pp.413–422,Jan.2015.doi:10.12733/jics20105578 [Online]. Available: https://doi.org/10.12733/jics20105578 [13] M.Raquib,M.Hossain,K.Islam,andM.S.Miah,“Vashanet:Anautomatedsys tem for recognizing handwritten bangla basic characters using deep convolu tional neural network,” MachineLearningwithApplications, vol. 17, p. 100568, 2024. doi: 10.1016/j.mlwa.2024.100568 [14] R. Singh, A. Kumar, and Y. Zhao, “Benchmarking human activity recognition using uci-har and pamap2: Toward reproducible experiments,” IEEE Transac tions on Human-Machine Systems, 2025. [15] S.K.SinghandA.Chaturvedi,“Machinelearningforsensor-basedhandwritten character recognition: A brief survey,” in Distributed Computing and Intelligent Technology, Springer, 2024, pp. 288–305. doi: 10.1007/978-3-031-81404 4_21 [16] Y.Song,M.Liu,F.Wang,J.Zhu,A.Hu,andN.Sun,“Gesturerecognitionbased on a convolutional neural network–bidirectional lstm network for a wearable wrist sensor withmulti-walledcarbonnanotube/cottonfabricmaterial,”Micro machines, vol. 15, no. 2, p. 185, 2024. doi: 10.3390/mi15020185 [17] H. Wang et al., “Mems devices-based hand gesture recognition via wearable computing,”Micromachines,vol.14,no.5,p.947,2023.doi:10.3390/mi14050947 51 [18] L. Wang, T. Zhang, and X. Liu, “Improving gesture recognition with signal filtering and normalization,” Journal of Ambient Intelligence and Humanized Computing, vol. 14, no. 3, pp. 1129–1144, 2023. [19] T.Watanabe,M.Maniruzzaman,M.A.Hasan,H.-S.Lee,S.-W.Jang,andJ.Shin, “2d camera-based air-writing recognition using hand pose estimation and hy briddeeplearningmodel,”Electronics,vol.12,no.4,p.995,2023.doi:10.3390/ electronics12040995 [20] M.Wehbietal.,“Towardsanimu-basedpenonlinehandwritingrecognizer,”in Document Analysis and Recognition ICDAR 2021, Springer, 2021, pp. 289–303. doi: 10.1007/978-3-030-86334-0_19 [21] H. Zhang et al., “A wearable real-time character recognition system based on edgecomputing-enableddeeplearningforair-writing,”Sensors,vol.2022,2022. doi: 10.1155/2022/8507706
