Discussion Class 8 Informedia 1 Discussion Classes Format: Question Ask a member of the class to answer Provide opportunity for others to comment When answering: Give your name. Make sure that the TA hears it. Stand up Speak clearly so that all the class can hear 2 Question 1: Multi-modal In discussing their work, the Informedia team often use the term "multi-modal". (a) What does this term mean? (b) How does it apply in information retrieval? (c) Give examples of modes used by Informedia. 3 Question 2: Speech recognition and retrieval performance What does the following graph tell us? 4 Question 3: Browsing (a) Informedia provides multiple levels of abstraction and summarization. Why? (b) Describe the function of each of the following: i visual icons ii one-line headlines iii film strip views iv video skims v transcript following of audio track 5 Question 4: User interface concepts Define and discuss the following concepts: (a) Collages (b) Semantic zooming (c) Results set (d) Named faces (e) Skimming 6 Question 5: Image understanding What role does image understanding perform in each of the following in Informedia? (a) scene break detection (icon selection, film-strip and skimming, segmentation) (b) image similarity matching (c) camera motion and object tracking (d) video-OCR (e) face detection and association 7 Question 6: Scalability Throughout the article there are mentions of scale. (a) What has the project done to evaluate scalability? (b) What are the weaknesses that might prove difficult on a larger scale? 8 Question 7: Overall Informedia had the following objectives: (a) retrieval performance in the presence of inaccuracy and ambiguity (b) approximate match in meaning and visualization (c) presentation and reuse of video content as a new data type with space and time constraints (d) interoperability in the presence of restricted use intellectual property and the absence of data and protocol standards. How well has each been achieved? 9