Arno Reuser

advertisement
Defence Intelligence and Security Service
Old world : information is power, guard it safely
New world : information is enlightment, share it freely
Sharing information
from a Dutch perspective
Arno H.P. Reuser
(mindef@xs4all.nl mindef2@xs4all.nl)
Defence Intelligence and Security Service
Defence Intelligence and Security Service
Historical perspective
13th century:
• English monks compile a central catalogue
15th century:
• Johannes Gutenberg 'invents' printing
• growth of book presses in the Low Countries
• censorship by authorities
16th century: bibliographies
•
•
•
•
National bibliographies
Of books to come / in print
Of books that never came
Index Librorum Prohibitorum (1515-1966)
16th century:
• Konrad Gessner (last Universal Scientist)
• 1545: Bibliotheca Universalis sive Cat…
3
Arno H.P. Reuser a@reuser.biz
Defence Intelligence and Security Service
Historical perspective 2
17th - 18th century
• Books > journals > reports > documentation
19th century:
• national libraries
20th century:
• commercial online services
• Internet
Today:
•
•
•
•
home pages
portals
blogs
RSS syndicated news feeds
Bodleian library, Oxford, U.K.
4
Arno H.P. Reuser a@reuser.biz
Defence Intelligence and Security Service
Have people forgotten about what's already there?
• Commercial vendors
Dialog, EINS, Factiva, Lexis-Nexis
• Databases :
EIU, NTIS, DTIC, Medline, Chemical Abstracts
• Public records
• Verticals:
BBC Monitoring, OSC, Oxford
Analytica, Periscope, Jane's
• National libraries and systems
Union catalogues, national bibliographies
• Indexes:
Patent indexes, citation indexes
An example of OSINT 'analysis'
5
Arno H.P. Reuser a@reuser.biz
Defence Intelligence and Security Service
Example analysis
OSINT as starting point of analysis:
How to find out if Iran is producing chemical weapons: use results from one
source as input for the next source:
1) Which
types/kinds/names of pesticides are there?
(source: Beilstein facts, Derwent chemistry resource, Gardner's)
2) How
much of these materials were exported to Iran?
(source: Piers Import & Export)
3) How
much farming land does Iran have?
(source: CIA World Fact Book, LOC country profiles, EIU, etc.)
4) On
average, how much pesticide is needed per hectare
arable land.
(source: 'pesticide usage statistics' http://pusstats.csl.gov.uk)
5) Answer:
2-(4*3)
6
Arno H.P. Reuser a@reuser.biz
Defence Intelligence and Security Service
Terror in The Netherlands
Politically motivated murders:
• Prince William of Orange
(10 july 1584)
• Pim Fortuyn
(6 may 2002)
(politician)
• Theo van Gogh (filmdirector)
(2 november 2004)
Other ‘incidents’:
• “Hofstadgroep”
• Abu Khaled (spiritual leader)
• Samir Azzouz (schiphol, nuclear reactor, Ministry of Defence)
• Mohammed Bouyeri (murder Theo van Gogh), life sentence
7
Arno H.P. Reuser a@reuser.biz
Defence Intelligence and Security Service
Intell services in The Netherlands
NCTb
Nationaal Coordinator Terrorisme bestrijding
National Coordinator for Counterterrorism
KLPD
Korps Landelijke Politiediensten
National Police Services Agency
AIVD
Algemene Inlichtingen en Veiligheidsdienst
General Intelligence and Security Service
MIVD
Militaire Inlichtingen en Veiligheidsdienst
Defense Intelligence and Security Service
8
Arno H.P. Reuser a@reuser.biz
Defence Intelligence and Security Service
Information sharing examples
Defense intelligence & Security Service (DISS)
•
•
•
•
•
•
Book about the activities
Bimonthly journal "Ingelicht" (= informed)
Brochures, leaflets
Law on intel
Two annual reports: one open source, one classified
Works in teams instead of departments
With the General Intelligence & Security
Service (GISS)
• Formal agreement on cooperation
• CT infobox
• OSINT OSINT
With NCTb
• Formal agreement on cooperation
9
Arno H.P. Reuser a@reuser.biz
Defence Intelligence and Security Service
With the Benelux
• Memorandum of Understanding
• Cooperate and share on OSINT, IMINT, Training
With Europe
• Tampere Summit, October 1999
formal decision to increase judicial cooperation between
Member States in order to fight crime, including terrorism
• Plan of Action (21 september 2001)
defines terrorist offences,
approximates the level of santions between Member States.
• Declaration of Solidarity 25 march 2004.
a terrorist attack against one state is considered an attack
against all.
the nation under attack is entitles to all manner of military
and other assistance.
10
Arno H.P. Reuser a@reuser.biz
Defence Intelligence and Security Service
Appointment of 'Mister Terrorism'
• Gijs de Vries, 25 march 2004
• to coordinate EU action on terrorism
European arrest warrant
• agreed june 2002, in to force 1 jan 2004 to replace
present extradition procedures for serious crimes
European Intelligence Service
•
•
•
•
Ideas to boost intelligence sharing
Austria Belgium asking for a European CIA
France and UK reluctant to share with 25 Member States
Fr suggests deeper intel sharing between 5 larger
Member States (UK, FR, IT, Ge, Sp)
11
Arno H.P. Reuser a@reuser.biz
Defence Intelligence and Security Service
An Open Source Agency?
Who should be leading:
Current intelligence services?
• Fusion
• Partnership
• New intel service for OSINT only
Comercial online services?
"…everything is free, everything is on
the Internet, and everything is full-text"
"…If it is listed on Google, then some
has checked it out already"
(Information World Review, oct 2005)
• Dialog, Lexis-Nexis, Factiva etc.
Do-it-yourself?
• Just give all analysts access to the Internet and Google, no need for an OSA,
problem solved.
• People want their own information services on the desktop.
12
Arno H.P. Reuser a@reuser.biz
Defence Intelligence and Security Service
interNOT
1 - Internet is NOT: international
13
Arno H.P. Reuser a@reuser.biz
Defence Intelligence and Security Service
Email is much
more important
than W3
1 - Internet
is NOT: international
P2P file sharing
2 - Internet
is NOT: gigantic large
instant messaging
How much information 2003?
Peter Lyman, Hal R. Varian
University of California at Berkeley, 27 Octobre 2003
http://www.sims.berkeley.edu/research/projects/how-much-info-2003
email
deep web
surface Web
Internet
InterNET is NOT
TV
radio
Books are off 
telephone
optical
magnetic
film
print
0
print
500.000
film
magnetic
1.000.000 1.500.000 2.000.000 2.500.000 3.000.000 3.500.000 4.000.000 4.500.000 5.000.000
optical
telephone
radio
TV
lower
327
74.202
3.416.230
51
3.488
39.841
upper
1.634
420.254
4.999.230
103
3.488
68.955
Arno H.P. Reuser a@reuser.biz
Print :
film :
magnetic :
optical :
Internet
surface Web
deep web
email
532.897
167
91.850
440.606
instant
P2P file
messaging
sharing
274
0
books, newspapers, office docs., journals, newsletters
photographs, cinema, TV films, TV series, X-rays, video
videotape, audiotape,digital tape, miniDV, floppy disc, Zip
audio CD, CDROM,DVD
14
Defence Intelligence and Security Service
1 - Internet is NOT: international
2 - Internet is NOT: gigantic large
3 - Internet is NOT: equal to vendors
Does size matter?
Google
Yahoo
Lexis-Nexis
Factiva
Dialog
-
8 bn
4 bn
4.3 bn
275 mn / 3mn monthly grow
?
Not to mention things like: search language, structured searching, support
15
Arno H.P. Reuser a@reuser.biz
Defence Intelligence and Security Service
1 - Internet is NOT: international
2 - Internet is NOT: gigantic large
3 - Internet is NOT: equal to vendors
4 - Internet is NOT: easy to use
A typical Google query:
intitle:(india|new delhi) intitle:pakistan filetype:pdf -inurl:.com -sport
16
Arno H.P. Reuser a@reuser.biz
Defence Intelligence and Security Service
1 - Internet is NOT: international Http://missingpieces.dogpile.com
2 - Internet is NOT: gigantic large
3 - Internet is NOT: equal to vendors
4 - Internet is NOT: easy to use
5 - Internet is NOT: just Google
17
Arno H.P. Reuser a@reuser.biz
Defence Intelligence and Security Service
Manipulation
1 - Internet is NOT: international
2 - Internet is NOT: gigantic large
3 - Internet is NOT: equal to vendors
4 - Internet is NOT: easy to use
5 - Internet is NOT: just Google
6 - Internet is NOT: free of manipulation
1 - Internet is NOT: international
2 - Internet is NOT: gigantic large
3 - Internet is NOT: equal to vendors
4 - Internet is NOT: easy to use
5 - Internet is NOT: just Google
6 - Internet is NOT: free of manipulation
18
Arno H.P. Reuser a@reuser.biz
Defence Intelligence and Security Service
An independent Open Source Agency
Tasking an independent Open Source Agency:
• Training
Education of OSINT experts
• Tools
Development of dedicated easy to use tools for info exploration/exploitation
• Discussion forum
Classified forum for info exchange, info sharing, question answering, networking.
• Research / coordinating
Into indexing information, application of meta data, taxonomies, retrieval engines,
concept searching, clustering technologies.
• Resource discovery
Regular publicing reviews on (new) sources
• Contracts.
Sources intermediairy
19
Arno H.P. Reuser a@reuser.biz
Defence Intelligence and Security Service
OSINT experts
Searching in Dialog
?
?
?
?
?
?
?
?
b 390,399
s pesticides/na
map sy t s1
save temp
b 571
exs
sort s1/all/cn,lb,co
report s2/all/cn,lb,co
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
20
Arno H.P. Reuser a@reuser.biz
Defence Intelligence and Security Service
OSINT experts
DIALOG(R)File 571 :Piers Exports(US Ports)
(c) 2005 Commonwealth Bus. Media All rts.
Country of
Non-U.S.
Weight
Port
(Pounds) U.S.-based Company
---------- -------- -----------------------------
Date
Shipped
-------
ARGENT
ARGENT
ARGENT
ARGENT
ARGENT
ARGENT
ARGENT
ARGENT
ARGENT
ARGENT
ARGENT
ARGENT
ARGENT
ARGENT
ARGENT
ARGENT
031214
041226
040527
040527
040718
050407
041126
041111
050506
040509
050216
031214
041211
040526
050409
050109
Arno H.P. Reuser a@reuser.biz
5,388
7,771
8,049
8,049
9,720
11,661
15,878
17,641
17,642
17,648
20,873
31,178
31,755
31,812
33,690
34,593
BAYER
NA
E I DUPONT DE NEMOURS
E I DUPONT DE NEMOURS
BAYER
NA
NA
NA
NA
BAYER
NA
BAYER
NA
KEY INTL SHPG
KEY INTL SHPG
KEY INTL SHPG
reserv.
21
Defence Intelligence and Security Service
Indexing information
22
Arno H.P. Reuser a@reuser.biz
Defence Intelligence and Security Service
Indexing information
People have different viewpoints on subjects making it
hard to find a universal arrangement principle or
keywords by which to order data or books or digital
information.
Books on rabbits. What is the correct heading/keyword?
A farmer
will look under
A girl
will look under
A butcher
will look under
A researcher
will look under
A fashion designer will look under
V
P
M
L
F
for Vermin
for Pets
for Meat products
for Laboratory animal
for Fur
23
Arno H.P. Reuser a@reuser.biz
Defence Intelligence and Security Service
Tools
Volume in drive D is Data
Volume Serial Number is C0C2-4AE6
Directory of D:\osint\OsintDat\persbureaus\foreign broadcast information
service\compleet\_recent\2006\01\11
12-01-2006
12-01-2006
11-01-2006
11-01-2006
11-01-2006
11-01-2006
11-01-2006
11-01-2006
11-01-2006
11-01-2006
11-01-2006
11-01-2006
11-01-2006
11-01-2006
11-01-2006
11-01-2006
11-01-2006
18:12
18:12
12:06
09:43
12:06
13:53
13:53
13:53
12:06
09:43
09:43
09:43
13:53
13:53
13:53
12:06
13:53
<DIR>
<DIR>
5.835
4.823
13.365
10.675
9.984
6.598
5.127
4.140
3.959
4.053
7.091
4.423
4.621
5.266
4.090
.
..
AFP20060111011001-v1.html
AFP20060111516001-v1.html
AFP20060111516002-v1.html
AFP20060111516003-v1.html
AFP20060111521001-v1.html
AFP20060111525001-v1.html
AFP20060111528002-v1.html
AFP20060111601001-v1.html
AFP20060111601002-v1.html
AFP20060111601003-v1.html
AFP20060111606001-v1.html
AFP20060111606002-v1.html
AFP20060111606003-v1.html
AFP20060111609001-v1.html
AFP20060111610001-v1.html
24
Arno H.P. Reuser a@reuser.biz
Defence Intelligence and Security Service
25
Arno H.P. Reuser a@reuser.biz
Defence Intelligence and Security Service
26
Arno H.P. Reuser a@reuser.biz
Defence Intelligence and Security Service
Meta data
<!-- DC metatags produced by Arno HP Reuser (reuser@xs4all.nl) -->
<META NAME = "DC.Coverage.Region" CONTENT = "Africa" >
<META NAME = "DC.Coverage.SubRegion" CONTENT = "West Africa" >
<META NAME = "DC.Coverage.Country" CONTENT = "Benin" >
<META NAME = "DC.Subject" CONTENT = "DOMESTIC POLITICAL" >
<META NAME = "DC.Subject" CONTENT = "LEADER" >
<META NAME = "DC.Title" CONTENT = "Benin: Resignation of Defense Minister Reported" >
<META NAME = "DC.Source" CONTENT = "Cotonou Le Matinal (Internet version-WWW)" >
<META NAME = "DC.Description" CONTENT = "Beninese defence minister said quits over row
with president Text of report by Abdouramane Toure entitled "For major contradictions: Osho
resigns from the government" published by Beninese newspaper Le Matinal website on 11 January
Nothing is going on well between President Mathieu >
<META NAME = "DC.Publisher" CONTENT = "FBIS PIOS" >
<META NAME = "DC.Format" CONTENT = "text/html" >
<META NAME = "DC.Date" SCHEME = "WTN8601" CONTENT = "2006-01-11T07:54" >
<META NAME = "XDC.OrgFileName" CONTENT = "AFP20060111011001_000123_a.html" >
<META NAME = "DC.Date.Modified" SCHEME = "WTN8601" CONTENT = "2006-0111T12:06:35" >
<! -- ***************** end of DC Meta Data block ***************** -->
<TITLE>Benin: Resignation of Defense Minister Reported</TITLE>
Arno H.P. Reuser a@reuser.biz
27
Defence Intelligence and Security Service
Meta data
Problem (or challenge?)
• Each information service provider uses its own scheme
• Need different query for each provider
query
query
One query for
query
all
query
Dublin Core
Meta data
meta data
Dublin Core
Meta data
meta data
Dublin Core
Meta data
meta data
Dublin Core
Meta data
meta data
Information
service
Information
service
Information
service
Information
service
28
Arno H.P. Reuser a@reuser.biz
Defence Intelligence and Security Service
Done!
Remarks? Comments? Questions? Additions?
29
Arno H.P. Reuser a@reuser.biz
Defence Intelligence and Security Service
x
30
Arno H.P. Reuser a@reuser.biz
Defence Intelligence and Security Service
counter
Dutch Data Protection Authority
• "…supervises the fair and lawful use and security of your personal data to ensure
your privacy today and in the future"
Personal Data Protection Act
• "Wet bescherming persoonsgegevens"
International campaign againt mass surveillance (ICAMS)
Political parties
• D'66 (left-wing democrats)
• "High quality intelligence are the most effective method against terrorism"
• "When in doubt, rather safe than sorry"
31
Arno H.P. Reuser a@reuser.biz
Defence Intelligence and Security Service
Eurojust
• established in 2002
• stimulates and improves the co-ordination of investigations
and prosecutions
• improves co-operation by facilitating the execution of
international mutual legal assistance and the
implementation of extradition requests.
Europol
• European Union law enforcement organisation
• handles criminal intelligence;
• to assist the law enforcement authorities of Member States
in their fight against serious forms of organised crime
32
Arno H.P. Reuser a@reuser.biz
Download