Sign in
Author
|
Conference
|
Journal
|
Organization
|
Year
|
DOI
Look for results that meet for the following criteria:
since
equal to
before
between
and
Search in all fields of study
Limit my searches in the following fields of study
Agriculture Science
Arts & Humanities
Biology
Chemistry
Computer Science
Economics & Business
Engineering
Environmental Sciences
Geosciences
Material Science
Mathematics
Medicine
Physics
Social Science
Multidisciplinary
Keywords
(7)
a priori knowledge
Computer Vision
Human Robot Interaction
Image Analysis
Machine Vision
Scene Understanding
Three Dimensional
Subscribe
Academic
Publications
Enhanced visual scene understanding through human-robot dialog
Enhanced visual scene understanding through human-robot dialog,10.1109/IROS.2011.6048219,Matthew Johnson-Roberson,Jeannette Bohg,Gabriel Skantze,Joaki
Edit
Enhanced visual scene understanding through human-robot dialog
(
Citations: 2
)
BibTex
|
RIS
|
RefWorks
Download
Matthew Johnson-Roberson
,
Jeannette Bohg
,
Gabriel Skantze
,
Joakim Gustafson
,
Rolf Carlson
,
Babak Rasolzadeh
,
Danica Kragic
We propose a novel human-robot-interaction framework for robust visual scene understanding. Without any a-priori knowledge about the objects, the task of the robot is to correctly enumerate how many of them are in the scene and segment them from the background. Our approach builds on top of state-of-the-art
computer vision
methods, generating object hypotheses through segmentation. This process is combined with a natural dialog system, thus including a 'human in the loop' where, by exploiting the natural conversation of an advanced dialog system, the robot gains knowledge about ambiguous situations. We present an entropy-based system allowing the robot to detect the poorest object hypotheses and query the user for arbitration. Based on the information obtained from the human-robot dialog, the scene segmentation can be re-seeded and thereby improved. We present experimental results on real data that show an improved segmentation performance compared to segmentation without interaction.
Conference:
International Conference on Intelligent RObots and Systems - IROS - IROS
, pp. 3342-3348, 2011
DOI:
10.1109/IROS.2011.6048219
Cumulative
Annual
View Publication
The following links allow you to view full publications. These links are maintained by other sources not affiliated with Microsoft Academic Search.
(
ieeexplore.ieee.org
)
(
ieeexplore.ieee.org
)
Citation Context
(2)
...In [
13
] the authors demonstrated a system where the segmentation could be improved with voice commands, an interface that is easily integratable with our method...
...Such information can for instance be provided as spoken cues as demonstrated in [17], [
13
]...
Niklas Bergstrom
,
et al.
Generating object hypotheses in natural scenes through human-robot int...
...Johnson-Roberson et al. [
22
] extracted novel objects through the user teaching a robot how many objects there are...
Tomoaki Nakamura
,
et al.
Learning Novel Objects for Extended Mobile Manipulation
References
(30)
Robot Programming by Demonstration - a Probabilistic Approach
(
Citations: 17
)
Sylvain Calinon
Published in 2009.
Foveated Figure-Ground Segmentation and Its Role in Recognition
(
Citations: 6
)
M. Bj
,
J. O. Eklundh
Conference:
British Machine Vision Conference - BMVC
, 2005
Learning grasping points with shape context
(
Citations: 13
)
Jeannette Bohg
,
Danica Kragic
Journal:
Robotics and Autonomous Systems - RaS
, vol. 58, no. 4, pp. 362-377, 2010
Attention-based active 3D point cloud segmentation
(
Citations: 2
)
Matthew Johnson-Roberson
,
Jeannette Bohg
,
M. Björkman
,
D. Kragic
Conference:
International Conference on Intelligent RObots and Systems - IROS - IROS
, pp. 1165-1170, 2010
The Symbol Grounding Problem
(
Citations: 1265
)
Stevan Harnad
Journal:
Computing Research Repository - CORR
, vol. cs.AI/9906, 1999
Sort by:
Citations
(2)
Generating object hypotheses in natural scenes through human-robot interaction
Niklas Bergstrom
,
Marten Bjorkman
,
Danica Kragic
Conference:
International Conference on Intelligent RObots and Systems - IROS - IROS
, pp. 827-833, 2011
Learning Novel Objects for Extended Mobile Manipulation
Tomoaki Nakamura
,
Komei Sugiura
,
Takayuki Nagai
,
Naoto Iwahashi
,
Tomoki Toda
,
Hiroyuki Okada
,
Takashi Omori
Journal:
Journal of Intelligent and Robotic Systems - JIRS
, pp. 1-18