What is the Loebner Prize

advertisement
Arwa Mohsen Al-awajy
423201941
AI CAP 492
Loebner
Prize
Dr. Souham Meshoul
Loebner Prize?
The Loebner Prize for artificial intelligence ( AI ) is the first
formal instantiation of a Turing Test. The test is named after Alan
Turing the brilliant British mathematician.
Among his many accomplishments was basic research in
computing science. In 1950, in the article Computing Machinery
and Intelligence which appeared in the philosophy journal Mind,
Alan Turing asked the question "Can a Machine Think?" He
answered in the affirmative, but a central question was: "If a
computer could think, how could we tell?" Turing's suggestion
was, that if the responses from the computer were indistinguishable
from that of a human, the computer could be said to be thinking.
This field is generally known as natural language processing.
In 1990, Hugh Loebner agreed with The Cambridge Center for
Behavioral Studies to underwrite a contest designed to implement
the Turing Test. Dr. Loebner pledged a Grand Prize of $100,000
and a Gold Medal for the first computer whose responses were
indistinguishable from a human's. Such a computer can be said "to
think." Each year an annual prize of $2000 and a bronze medal is
awarded to the most human-like computer. The winner of the
annual contest is the best entry relative to other entries that year,
irrespective of how good it is in an absolute sense.
Latest winners of the Loebner
Prize?
2002 Kevin Copple
2003 Juergen Pirner
2004 Richard Wallace
2005 Rollo Carpenter
2006 Rollo Carpenter
The 2006 Contest was held Sunday,
Sept 17, 2006
at University College London
The winner was "Joan" by Rollo Carpenter
Little about The winner "Joan"?
The prize is awarded after judges hold a conversation with the AI,
asking questions to determine its "humanity" and the quality of its
responses.
Joan is a "26-year-old budding writer" who exists only on a set of
computer servers.
Joan and George's creator Rollo Carpenter said: "The big
difference overall between the two AIs is that Joan has learnt from
the general public and has grown a huge amount in the last year
and is keeping ahead of the competition."
Joan is one of the firm's so-called Jabberwacky bots, which
develop their conversational skills by speaking to the general
public online.
Jabberwacky is a chatbot system which learns continuously from
its conversations with web users.
Those conversations helped develop the majority of the 16,000
lines that distinguish her from a generic AI. In all, the bot has more
than five million lines of conversation available to it.
The technology which powers Joan resides on Windows server
machines. The core of the AI is on a Dual Xeon machine with lots
of memory, said Mr. Carpenter.
He said there was a very direct relationship between the computing
power available and the sophistication of the AI.
Particularly interesting in the Joan interface is the option of
providing emotional feedback and coaching via drop-down boxes -
indicating the mood or tenor of statements to help Joan learn about
facial expression and inflection.
This winning program, that created by Rollo Carpenter, learns by
analyzing its conversations with people as they "chat" with it
online. Regardless of the language, his program analyzes every
utterance it witnesses, using what Carpenter calls contextual
pattern-recognition techniques. Then, when a user asks the
program a question, a database is combed for the best response,
statistically speaking
In other words, when people talk to Jabberwacky bot online, their
responses are saved. During subsequent chats, Jabberwacky
searches its database, using "contextual pattern matching
techniques" to find an appropriate response. In speaking to you it
uses only learnt material. With no hard-coded rules, it relies
entirely on the principles of feedback.
Only learning artificial intelligence technologies will ever pass the
Turing Test.
Loebner Prize advances AI?
As a Hugh Loebner said these contests serve the AI field from the
following aspects:
1. Loebner primary purpose was to develop the Turing Test
itself.
The initial Loebner Prize contest was the first time that the
Turing Test had ever been formally tried. This in itself
justified the endeavor. It also introduced the Turing Test to a
wide public, and stimulated interest in it.
2- Loebner believes that this contest will advance AI and serve
as a tool to measure the state of the art. As time passes we
shall measure the advances in the field. For this reason
Loebner have made two stipulations regarding the contest:
(a) The contest must be held annually.
(b) The prize must be awarded if there is at least one
entry.
Reference:
http://news.bbc.co.uk
http://www.loebner.net
http://www.technologyreview.com
http://humashah.blogspot.com
Download