ConceptNet 5
Jason Gaines
1
•
•
•
•
•
•
What Is ConceptNet 5?
History
Structure
Demonstration
Questions
Further Information
Overview
2
• Semantic Network (Common-Sense Knowledge)
• Concepts and Relations
• Weights and Sources
What Is ConceptNet5
3
• Started by Marvin Minsky, Push Singh, and
Catherine Havasi
• Open Mind Common Sense (OMCS) - MIT
Media Lab Artificial Intelligence Project (1999)
• Website launched in 2000
• By 2002, 700,000 English sentences from 14,000
contributors
• Reorganized in 2007 ConceptNet 3
• Over 1,000,000 facts from 15,000 contributors
• 2013 ConceptNet 4 Takes I.Q. test
History
4
• Hypergraph
• Nodes
• Edges
Structure
5
• Generalization of a graph where an edge can
connect many nodes
Structure - Hypergraph
6
• Words
• Word Senses
• Short Phrases
Structure - Nodes
7
• Node to Node relationship
• Data sets provide the link
Structure - Edges
8
•
•
•
•
•
•
•
id
uri
rel
start
end
weight
sources
•
•
•
•
•
license
dataset
context
features
surfaceText
Structure – Edge Fields
9
• /[OBJECT TYPE]/[LANG]/[CONCEPT]
• Object Types /a/, /c/, /d/, /e/, /l/, /r/, /s/ ,/and and /or:
/c/en/toast
Structure - URI
10
•
•
•
•
•
•
•
•
•
•
•
•
RelatedTo
IsA
PartOf
MemberOf
HasA
UsedFor
CapableOf
AtLocation
Causes
HasSubevent
HasFirstSubevent
HasLastSubevent
•
•
•
•
•
•
•
•
•
•
•
HasPrerequisite
HasProperty
MotivatedByGoal
ObstructedBy
Desires
CreateBy
Synonym
Antonym
DerivedFrom
TranslationOf
DefinedAs
Structure - Relations
11
{
"endLemmas": "toast",
"context": "/ctx/all",
"end": "/c/en/toast",
"features": [
"/c/en/bread /r/RelatedTo -",
"/c/en/bread - /c/en/toast",
"- /r/RelatedTo /c/en/toast"
],
"license": "/l/CC/By-SA",
"start": "/c/en/bread",
"startLemmas": "bread",
"text": [
"toast",
"bread"
],
"uri": "/a/[/r/RelatedTo/,/c/en/bread/,/c/en/toast/]",
"weight": 8.650268,
"dataset": "/d/conceptnet/5/combined-sa",
"sources": [
"/or/[/and/[/s/activity/omcs/Verbosity/,/s/contributor/omcs/verbosity/]/,/s/site/verbosity/]"
],
"score": 46.555122,
"rel": "/r/RelatedTo",
"timestamp": "2013-09-12T16:51:30.594Z",
"nodes": [
"/r/RelatedTo",
"/c/en/toast",
"/c/en/bread"
],
"id": "/e/3da69c641f2e786bd5f07043c2ef51d9f146b431",
"surfaceText": "[[bread]] is related to [[toast]]"
}
Structure - Edge
12
• ConceptNet 4 (OMCS)
• Wikipedia (English)
• DBPedia
• ReVerb
• Wiktionary (English)
• WordNet
• “Game With A Purpose”
• Verbosity (GWAP)
• Nadya.jp (Japanese)
Structure – Data Sources
13
• Website - Web API
• ConceptNet Module - Python
• Dataset
• Flat JSON
• Solr JSON
• CSV
Using ConceptNet
14
• Representational State Transfer (REST) API
URL: http://conceptnet5.media.mit.edu
Request: “web” or “data/5.2”
Lookup: “lookup” with “limit”, “offset” and “filter”
Search: “search” with edge fields
Association: “assoc” with “limit” and “filter”
URI: “c/en/toast”
http://conceptnet5.media.mit.edu/data/5.2/assoc/c/en/cat?filter=/c
/en/dog&limit=1
Web API
15
http://conceptnet5.media.mit.edu/web/c/en/toast
http://conceptnet5.media.mit.edu/data/5.2/assoc/c/en/cat?filt
er=/c/en/dog&limit=1
http://conceptnet5.media.mit.edu/data/5.2/assoc/list/en/happ
y,sad@-1?limit=20
http://conceptnet5.media.mit.edu/data/5.2/assoc/list/en/happ
y,sad@-1?limit=20&filter=/c/en
http://conceptnet5.media.mit.edu/data/5.1/c/en/off_hook
Demonstration
16
• What Is ConceptNet5?
• History
• Structure
• Demonstration
Summary
17
Questions
18
•
•
•
•
•
http://csc.media.mit.edu/conceptnet
http://csc.media.mit.edu/docs/conceptnet/
http://github.com/commonsense/conceptnet5/wiki
https://github.com/commonsense/conceptnet5/wiki/_pages
http://en.wikipedia.org/wiki/Hypergraph
Additional Info
19