Synthesizing Robotic Handwriting Motion by Learning from Human Demonstrations

Published in IJCAI, 2016

Recommended citation: H. Yin, P. Alves-Olivera, F. S. Melo, A. Billard and A. Paiva, Synthesizing Robotic Handwriting Motion by Learning from Human Demonstrations, In Proceedings of International Joint Conference on Artificial Intelligence (IJCAI), New York, USA, 2016

This paper is about modeling multi-mode motion to generate diverse human-like handwriting motion.

Download paper here

@inproceedings{Yin2016-ID961,

author = {Yin, H. and Alves-Olivera, P. and Melo, F. S. and Billard, A. and Paiva, A.},

title = {Synthesizing Robotic Handwriting Motion by Learning from Human Demonstrations},

booktitle = {In Proceedings of International Joint Conference on Artificial Intelligence (IJCAI)},

year = {2016},

abstract = {This paper contributes a novel framework that enables a robotic agent to efficiently learn and synthesize believable handwriting motion. We situate the framework as a foundation with the goal of allowing children to observe, correct and engage with the robot to learn themselves the handwriting skill. The framework adapts the principle behind ensemble methods - where improved performance is obtained by combining the output of multiple simple algorithms - in an inverse optimal control problem. This integration addresses the challenges of rapid extraction and representation of multiple-mode motion trajectories, with the cost forms which are transferable and interpretable in the development of the robot compliance control. It also introduces the incorporation of a human movement inspired feature, which provides intuitive motion modulation to generalize the synthesis with poor robotic written samples for children to identify and correct. We present the results on the success of synthesizing a variety

of natural-looking motion samples based upon the learned cost functions. The framework is validated by a user study, where the synthesized dynamical motion is shown to be hard to distinguish from the real human handwriting.},

}