Mitsubishi Electric Develops World's First Voice-activated Drawing Function that Displays Spoken Words Where Finger is Traced on Screen

For smooth communication that transcend disabilities or foreign languages

PDF Version (PDF:230.8KB)

TOKYO, February 9, 2016 - Mitsubishi Electric Corporation (TOKYO: 6503) announced today that it has developed the world's first* technology combining voice-recognition and drawing functions to enable users to display their spoken words on a tablet or smartphone by simply dragging their finger across the screen. The technology is expected to be combined with other functions, such as, picture drawing and multilingual translation, to help people transcend disabilities and foreign languages for smoother global communication.

*As of the date of release: February 9, 2016

Press down and hold Drag finger while speaking Words appear behind finger

Key Features

World's first user interface for voice-activated drawing

- By pressing down on the screen and then speaking, spoken words can be displayed wherever the finger is dragged across the screen.
- Words stream behind the user's fingertip for an intuitive and enjoyable experience.
- No need to write out words, so easier than conversing by writing.
- Other functions can be added for innovative and diverse applications.

Works with other functions for wider applicability

- The technology can be combined with a picture-drawing function to create illustrations, maps and other graphics augmented with text, enabling richer expressiveness and enhanced understanding.
- The addition of multilingual translation would enable displayed words to be translated for face-to-face communication with speakers of other languages.

Note that the releases are accurate at the time of publication but may be subject to change without notice.