This proposal aims to perform fundamental research on planning, perception and probabilistic reasoning in the context of a deceptively simple challenge task: A robot is given a crude description of a relatively easily recognizable object to find, and sent into a new environment to find this object. The robot is expected to return with a map showing the location of the object. The following can be said about this task: 1) It is a prerequisite or enabling technology for many other tasks of economic and practical importance; 2) It ought to be possible given existing hardware and computing power; 3) It is not adequately addressed by existing techniques; and 4) It reveals fundamental shortcomings in our understanding of core AI problems. This proposal aims to address these challenges directly with novel approaches to acquiring, representing, and planning with sense data.
This project considered the problem of how robots or distributed collections of sensors can construct representations of their environment. This is a challenging problem for several reasons: 1) Sensors provide incomplete information about the world: The have limited range, accuracy and field of view. 2) The exact positions of the robots or sensors may not always be known. For example, even when GPS is available it is accurate only up to several meters. 3) Modern sensors are capable of providing a vast amount information, but it is not always practical to use all of this information at once due to the computational considerations, as well as the time and cost of transmitting information, and 4) Raw sensor information may require substantial additional processing to be useful to people. For example, it's not that hard to send a mobile robot out in the environment and have it take lots of pictures, but it's much more difficult to ask a robot to use this information to help you find your keys or report if something has been stolen. Some of the key research accomplishments of this project are summarized below: - A technique by which a robot can use digital still images to determine its position with accuracy very close to what can be achieved with much larger and more expensive laser range finders.* - A technique by which a network of pan/tilt cameras can be intelligently managed to detect the presence of objects, e.g. intruders, using a small number of camera movements. - A technique by which surveillance devices with taskable (capable of being aimed) sensors (e.g., drones or satellites) can be used to pinpoint a moving adversary using a small number of sensor aims. - A family of techniques by which a robot can autonomous or semi-autonomously discover a set of "interesting" objects in an environment by monitoring the environment over a period of time. Interesting objects would be objects that are capable of being manipulated by people.* * Starred items in the above list have publicly available computer code and data sets.