Automatic will enabled system of multi-modal operation

Abstract

AWESOMMO(Automatic Will Enabled System of Multi-Modal Operation)uses Sony PS3 Eye image sensor for high speed image processing and a microphone for voice recognition commands. Armed with 3 degrees of freedom of operation, provides the ability to move freely and interact with the physical objects around it. This robot uses a M.M.O (massively multiplayer online) server named 'Spider Monkey', which enables the robot to be operated remotely. For the first time, a game engine has been customized with serial communication protocol addition to control microcontroller unit of a robot as the game engine handles multithreaded operation in the best possible way. This paper discusses the physical, mechanical and computational methods used in design and construction of the robot along with its multi-modal control feature. This paper also demonstrates the abilities and benefits of using M.M.O and PS3 Eye in such a way that it becomes platform for developing software for robotics and embedded system development.