Contents

Volume 34, Issue 1, 2009

Interactive Policy Learning through Confidence-Based Autonomy

S. Chernova and M. Veloso . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

1

A Heuristic Search Approach to Planning with Continuous Resources in Stochastic Domains

N. Meuleau, E. Benazera, R. I. Brafman, E. A. Hansen, and Mausam . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

27

Asynchronous Forward Bounding for Distributed COPs

A. Gershman, A. Meisels, and R. Zivan . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

61

Policy Iteration for Decentralized Control of Markov Decision Processes

D. S. Bernstein, C. Amato, E. A. Hansen, and S. Zilberstein . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

89

Generic Preferences over Subsets of Structured Objects

M. Binshtok, R. I. Brafman, C. Domshlak, and S. E. Shiomony . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

133

Behavior Bounding: An Efficient Method for High-Level Behavior Comparison

S. A. Wallace . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

165

Mechanisms for Making Crowds Truthful

R. Jurca and B. Faltings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

209

Unsupervised Methods for Determining Object and Relation Synonyms on the Web

A. Yates and O. Etzioni . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

255

Monte Carlo Sampling Methods for Approximating Interactive POMDPs

P. Doshi and P. J. Gmytrasiewicz . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

297

Identification of Pleonastic It Using the Web

Y. Li, P. Musilek, M. Reformat, and L. Wyard-Scott . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

339

J

ournal of

A

rtificial

I

ntelligence

R

esearch

AN INTERNATIONAL ELECTRONIC AND PRINT JOURNAL

Editors and Staff, 2009

Editor-in-Chief

Adnan Darwiche

Associate Editor-in-Chief

Shlomo Zilberstein

Associate Editors

Chitta Baral

Regina Barzilay

Christian Bessiere

Ronen Brafman

Gerhard Brewka

Vincent Conitzer

Giuseppe De Giacomo

Dieter Fox

Hector Geffner

Lise Getoor

Joerg Hoffman

Adele Howe

Thorsten Joachims

Jerome Lang

Lillian Lee

Kevin Leyton-Brown

Shaul Markovitch

Chris Meek

Pedro Meseguer

Andrew Ng

Dragomir Radev

Jeff Rosenschein

Sylvie Thiebaux

Gerard Verfaillie

Michael Wooldridge

Editorial Board

Blai Bonet

David Blei

Yiling Chen

Xiaoping Chen

David Chiang

Alessandro Cimatti

Minh Dinh Do

Prashant Doshi

Stefan Edelkamp

Edith Elkind

Alan Fern

Amir Globerson

Judy Goldsmith

Eric Hansen

Patrik Haslum

Malte Helmert

Holger Hoos

Manfred Jaeger

Kristian Kersting

Dan Klein

Javier Larrosa

Kathryn Laskey

Felipe Manya

Lluis Marquez

Pierre Marquis

Hwee Tou Ng

Ilkka Niemela

Bo Pang

Simon Parsons

Joelle Pineau

Pascal Poupart

Ariel Procaccia

Daniel Reeves

Riccardo Rosati

Wheeler Ruml

Ashish Sabharwal

Lakhdar Sais

Torsten Schaub

Christian Shelton

Tobias Scheffer

Thomas Schiex

Ben Taskar

Kristen Venable

Kiri Wagstaff

Neil Yorke-Smith

Advisory Board

Fahiem Bacchus

Peter Bartlett

Walter Daelemans

Rina Dechter

Luc De Raedt

Oren Etzioni

Boi Faltings

Maria Fox

Russell Greiner

Subbarao Kambhampati

Sven Koenig

Gerhard Lakemeyer

Paolo Liberatore

Fangzhen Lin

Daniel Marcu

Steven Minton

Martha Pollack

Francesca Rossi

Diana Spears

Milind Tambe

Moshe Tennenholtz

Michael Wellman

Makoto Yokoo

Nevin Zhang

Toby Walsh

Dan Weld

Managing Editor

Steven Minton

Special Projects

Toby Walsh

Production Supervisor

Lillian Bluestein

About JAIR

JAIR 's editorial board is dedicated to the rapid dissemination of important research results to the global AI community. The journal's scope encompasses all areas of artificial intelligence, including automated reasoning, cognitive modeling, knowledge representation, learning, natural language, neural networks, perception, and robotics. For information regarding submissions, AI Access Foundation, or the JAIR editorial charter, please see jair.org

Microfilm, Back, or Replacement Copies

Back issues of JAIR (from volume 18 onward) are available from the Association for the Advancement of Artificial Intelligence. Send requests to

AAAI, 445 Burgess Drive, Menlo Park, California 94025. Mi croform copies are available from ProQuest Information and Learning, 300 North Zeeb

Road, Ann Arbor, MI 48106. Telephone (800) 521-3044 or (734) 761-4700.

Copying Articles for Personal Use

Authorization to photocopy items for internal or personal use, or the internal or personal use of specific clients, or for educational classroom use, is granted by AI Access Foundation. This consent does not extend to other kinds of copying, such as for general distribution, resale, advertising, or for creating new collective works. Please contact AAAI for such permission.

Address Change

Please notify AAAI eight weeks in advance of a change of address. Send old label with new address to AAAI, 445 Burgess Drive, Suite 100, Menlo Park,

CA 94025-3442.

Subscriptions

JAIR (ISSN 1076-975) is published three times a year by the Association for the Advancement of Artificial Intelligence (AAAI), 445 Burgess Drive,

Menlo Park, CA 94025-3442, telephone (650) 328-3123. Members of AAAI receive a discount on JAIR subscriptions. The JAIR subscription price is

$85.00 per volume or issue. Inquiries regarding membership in the AAAI should be sent to the AAAI at the above address.

Periodicals Postage paid at Menlo Park, CA and additional mailing offices.

Postmaster: Change Service Requested. Send address changes to AAAI,

445 Burgess Drive, Suite 100, Menlo Park, CA 94025-3442.

Copyright © 2009 by AI Access Foundation and the Association for the Advancement of Artificial Intelligence. All rights reserved. No part of this publication may be reproduced in whole or in part without prior written permission. Unless otherwise stated, the views expressed in published material are those of the authors and do not necessarily reflect the policies or opinions of JAIR, its editors and staff, AI Access Foundation, or the Association for the Advancement of Artificial Intelligence.

ISBN 978-1-57735-453-6