Seminar on SDS
Final class
5/4/2015
Topics discussed
•
•
•
•
•
ASR, NLU in dialogue
Dialogue management
NLG, information presentation
Evaluation
Error recovery
Specialty Topics for Dialogue Systems
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
turn-taking
mixed-initiative
referring in dialogue
grounding and repair
dialogue act modeling
dialogue act recognition
error recovery in dialogue
prosody and information structure
Argumentation & persuasion
incremental speech processing
multi‐modal dialogue
multi-party dialogue (3 or more
participants)
tutorial dialogue
multi‐task dialogue
• embodied conversational agents
• human-‐robot dialogue interaction
• dialogue tracking in other language-‐processing systems (machine translation,
summarization/extrac.on)
• non-‐cooperative dialogue systems
(negotiation, deception)
• affective dialogue systems
• dialogue with different user populations
(children, elderly, differently abled)
• dialogue “in the wild”
• long‐term Dialogue Companions
• user behavior, including entrainment in
dialogue
Seminar on SDS; Intro
3
Final reports are due 5/15 (eod)
• Submit your final papers
– You will be graded on the whole paper:
•
•
•
•
•
•
Clarity (overall clarity of your paper)
Implementation and soundness (method description)
Substance (how much work is accomplished)
Evaluation
Meaningful comparison (related work)
Impact of accompanying software (we will look at your
github source code and evaluate for potential
reusability)
Please include in your report
• Admin Section
– URL of your github.
– URL of your final report (if you agree for it to be
published on the course webpage)
– If you are planning to submit your work to a
workshop, please indicate which workshop (I
would be happy to help with your paper draft)
– For each group member, a paragraph description
of the project tasks accomplished
Please include in your report
• Framework evaluation (OpenDial/WitAI)
– What are the strengths and weaknesses of the framework you were using?
– On a scale from 1 (worst) – 10 (best)
• How easy was the framework to get started with?
• How easy was it to debug your code?
– What are the challenges that you discovered while using the framework?
– For Wit.ai – how much training data did you need to gather to make it usable?
– For OpenDial – how much effort did it take to build NLU/DM/NLG/external
components?
– What suggestions would you make for the authors of the framework to
improve it?
– What extensions would you suggest for the framework?
– Would you use this framework for another dialogue system?
Real Challenge
– Dialogue proposal competition (for
undergraduates)
– Organized by CMU
– Submit an idea for a dialogue system (May 14)
– If selected, you will be invited for a workshop
(August/September)
– Team up with researchers and implement your
ideas
– https://dialrc.org/realchallenge/