Personal tools
Document Actions

Astrid Weiss, Thomas Scherndl, Manfred Tscheligi, and Aude Billard (2009)

Evaluating the ICRA 2008 HRI challenge

In: HRI '09: Proceedings of the 4th ACM/IEEE international conference on Human robot interaction. ACM, New York, NY, USA, pages 261–262.

This paper reports on the evaluation of the ICRA 2008 Human-Robot Interaction (HRI) Challenge. Five research groups demonstrated state-of-the-art work on HRI with a special focus on social and learning abilities. The demonstrations were rated by expert evaluators, in charge of awarding the prize, and 269 participants, i.e. 20 percent of the conference attendees through a standardized questionnaire (semantic differential). The data was analyzed with respect to six independent variables: expert evaluators vs. attendees, nationality of participants, origin region of the demo, age, gender and knowledge level of the attendees. Conference attendees tended to give higher scores for Social Skills, General Impression, and Overall Score than the expert evaluators. Irrespectively of the level of knowledge, age, and gender, conference attendees rated all demos relatively homogeneously. However, a comparative analysis of the conference attendees's ratings nationality-wise showed that demonstrations were rated differently depending on the region of origin. Conference attendees for the USA and Asian countries tended to rate demos from the same country of origin more frequently and more positively.
 
by Astrid Weiss last modified 2009-09-23 16:40

Powered by Plone CMS, the Open Source Content Management System
About this portal