Defence Intelligence and Security Service Old world : information is power, guard it safely New world : information is enlightment, share it freely Sharing information from a Dutch perspective Arno H.P. Reuser (mindef@xs4all.nl mindef2@xs4all.nl) Defence Intelligence and Security Service Defence Intelligence and Security Service Historical perspective 13th century: • English monks compile a central catalogue 15th century: • Johannes Gutenberg 'invents' printing • growth of book presses in the Low Countries • censorship by authorities 16th century: bibliographies • • • • National bibliographies Of books to come / in print Of books that never came Index Librorum Prohibitorum (1515-1966) 16th century: • Konrad Gessner (last Universal Scientist) • 1545: Bibliotheca Universalis sive Cat… 3 Arno H.P. Reuser a@reuser.biz Defence Intelligence and Security Service Historical perspective 2 17th - 18th century • Books > journals > reports > documentation 19th century: • national libraries 20th century: • commercial online services • Internet Today: • • • • home pages portals blogs RSS syndicated news feeds Bodleian library, Oxford, U.K. 4 Arno H.P. Reuser a@reuser.biz Defence Intelligence and Security Service Have people forgotten about what's already there? • Commercial vendors Dialog, EINS, Factiva, Lexis-Nexis • Databases : EIU, NTIS, DTIC, Medline, Chemical Abstracts • Public records • Verticals: BBC Monitoring, OSC, Oxford Analytica, Periscope, Jane's • National libraries and systems Union catalogues, national bibliographies • Indexes: Patent indexes, citation indexes An example of OSINT 'analysis' 5 Arno H.P. Reuser a@reuser.biz Defence Intelligence and Security Service Example analysis OSINT as starting point of analysis: How to find out if Iran is producing chemical weapons: use results from one source as input for the next source: 1) Which types/kinds/names of pesticides are there? (source: Beilstein facts, Derwent chemistry resource, Gardner's) 2) How much of these materials were exported to Iran? (source: Piers Import & Export) 3) How much farming land does Iran have? (source: CIA World Fact Book, LOC country profiles, EIU, etc.) 4) On average, how much pesticide is needed per hectare arable land. (source: 'pesticide usage statistics' http://pusstats.csl.gov.uk) 5) Answer: 2-(4*3) 6 Arno H.P. Reuser a@reuser.biz Defence Intelligence and Security Service Terror in The Netherlands Politically motivated murders: • Prince William of Orange (10 july 1584) • Pim Fortuyn (6 may 2002) (politician) • Theo van Gogh (filmdirector) (2 november 2004) Other ‘incidents’: • “Hofstadgroep” • Abu Khaled (spiritual leader) • Samir Azzouz (schiphol, nuclear reactor, Ministry of Defence) • Mohammed Bouyeri (murder Theo van Gogh), life sentence 7 Arno H.P. Reuser a@reuser.biz Defence Intelligence and Security Service Intell services in The Netherlands NCTb Nationaal Coordinator Terrorisme bestrijding National Coordinator for Counterterrorism KLPD Korps Landelijke Politiediensten National Police Services Agency AIVD Algemene Inlichtingen en Veiligheidsdienst General Intelligence and Security Service MIVD Militaire Inlichtingen en Veiligheidsdienst Defense Intelligence and Security Service 8 Arno H.P. Reuser a@reuser.biz Defence Intelligence and Security Service Information sharing examples Defense intelligence & Security Service (DISS) • • • • • • Book about the activities Bimonthly journal "Ingelicht" (= informed) Brochures, leaflets Law on intel Two annual reports: one open source, one classified Works in teams instead of departments With the General Intelligence & Security Service (GISS) • Formal agreement on cooperation • CT infobox • OSINT OSINT With NCTb • Formal agreement on cooperation 9 Arno H.P. Reuser a@reuser.biz Defence Intelligence and Security Service With the Benelux • Memorandum of Understanding • Cooperate and share on OSINT, IMINT, Training With Europe • Tampere Summit, October 1999 formal decision to increase judicial cooperation between Member States in order to fight crime, including terrorism • Plan of Action (21 september 2001) defines terrorist offences, approximates the level of santions between Member States. • Declaration of Solidarity 25 march 2004. a terrorist attack against one state is considered an attack against all. the nation under attack is entitles to all manner of military and other assistance. 10 Arno H.P. Reuser a@reuser.biz Defence Intelligence and Security Service Appointment of 'Mister Terrorism' • Gijs de Vries, 25 march 2004 • to coordinate EU action on terrorism European arrest warrant • agreed june 2002, in to force 1 jan 2004 to replace present extradition procedures for serious crimes European Intelligence Service • • • • Ideas to boost intelligence sharing Austria Belgium asking for a European CIA France and UK reluctant to share with 25 Member States Fr suggests deeper intel sharing between 5 larger Member States (UK, FR, IT, Ge, Sp) 11 Arno H.P. Reuser a@reuser.biz Defence Intelligence and Security Service An Open Source Agency? Who should be leading: Current intelligence services? • Fusion • Partnership • New intel service for OSINT only Comercial online services? "…everything is free, everything is on the Internet, and everything is full-text" "…If it is listed on Google, then some has checked it out already" (Information World Review, oct 2005) • Dialog, Lexis-Nexis, Factiva etc. Do-it-yourself? • Just give all analysts access to the Internet and Google, no need for an OSA, problem solved. • People want their own information services on the desktop. 12 Arno H.P. Reuser a@reuser.biz Defence Intelligence and Security Service interNOT 1 - Internet is NOT: international 13 Arno H.P. Reuser a@reuser.biz Defence Intelligence and Security Service Email is much more important than W3 1 - Internet is NOT: international P2P file sharing 2 - Internet is NOT: gigantic large instant messaging How much information 2003? Peter Lyman, Hal R. Varian University of California at Berkeley, 27 Octobre 2003 http://www.sims.berkeley.edu/research/projects/how-much-info-2003 email deep web surface Web Internet InterNET is NOT TV radio Books are off telephone optical magnetic film print 0 print 500.000 film magnetic 1.000.000 1.500.000 2.000.000 2.500.000 3.000.000 3.500.000 4.000.000 4.500.000 5.000.000 optical telephone radio TV lower 327 74.202 3.416.230 51 3.488 39.841 upper 1.634 420.254 4.999.230 103 3.488 68.955 Arno H.P. Reuser a@reuser.biz Print : film : magnetic : optical : Internet surface Web deep web email 532.897 167 91.850 440.606 instant P2P file messaging sharing 274 0 books, newspapers, office docs., journals, newsletters photographs, cinema, TV films, TV series, X-rays, video videotape, audiotape,digital tape, miniDV, floppy disc, Zip audio CD, CDROM,DVD 14 Defence Intelligence and Security Service 1 - Internet is NOT: international 2 - Internet is NOT: gigantic large 3 - Internet is NOT: equal to vendors Does size matter? Google Yahoo Lexis-Nexis Factiva Dialog - 8 bn 4 bn 4.3 bn 275 mn / 3mn monthly grow ? Not to mention things like: search language, structured searching, support 15 Arno H.P. Reuser a@reuser.biz Defence Intelligence and Security Service 1 - Internet is NOT: international 2 - Internet is NOT: gigantic large 3 - Internet is NOT: equal to vendors 4 - Internet is NOT: easy to use A typical Google query: intitle:(india|new delhi) intitle:pakistan filetype:pdf -inurl:.com -sport 16 Arno H.P. Reuser a@reuser.biz Defence Intelligence and Security Service 1 - Internet is NOT: international Http://missingpieces.dogpile.com 2 - Internet is NOT: gigantic large 3 - Internet is NOT: equal to vendors 4 - Internet is NOT: easy to use 5 - Internet is NOT: just Google 17 Arno H.P. Reuser a@reuser.biz Defence Intelligence and Security Service Manipulation 1 - Internet is NOT: international 2 - Internet is NOT: gigantic large 3 - Internet is NOT: equal to vendors 4 - Internet is NOT: easy to use 5 - Internet is NOT: just Google 6 - Internet is NOT: free of manipulation 1 - Internet is NOT: international 2 - Internet is NOT: gigantic large 3 - Internet is NOT: equal to vendors 4 - Internet is NOT: easy to use 5 - Internet is NOT: just Google 6 - Internet is NOT: free of manipulation 18 Arno H.P. Reuser a@reuser.biz Defence Intelligence and Security Service An independent Open Source Agency Tasking an independent Open Source Agency: • Training Education of OSINT experts • Tools Development of dedicated easy to use tools for info exploration/exploitation • Discussion forum Classified forum for info exchange, info sharing, question answering, networking. • Research / coordinating Into indexing information, application of meta data, taxonomies, retrieval engines, concept searching, clustering technologies. • Resource discovery Regular publicing reviews on (new) sources • Contracts. Sources intermediairy 19 Arno H.P. Reuser a@reuser.biz Defence Intelligence and Security Service OSINT experts Searching in Dialog ? ? ? ? ? ? ? ? b 390,399 s pesticides/na map sy t s1 save temp b 571 exs sort s1/all/cn,lb,co report s2/all/cn,lb,co (1) (2) (3) (4) (5) (6) (7) (8) 20 Arno H.P. Reuser a@reuser.biz Defence Intelligence and Security Service OSINT experts DIALOG(R)File 571 :Piers Exports(US Ports) (c) 2005 Commonwealth Bus. Media All rts. Country of Non-U.S. Weight Port (Pounds) U.S.-based Company ---------- -------- ----------------------------- Date Shipped ------- ARGENT ARGENT ARGENT ARGENT ARGENT ARGENT ARGENT ARGENT ARGENT ARGENT ARGENT ARGENT ARGENT ARGENT ARGENT ARGENT 031214 041226 040527 040527 040718 050407 041126 041111 050506 040509 050216 031214 041211 040526 050409 050109 Arno H.P. Reuser a@reuser.biz 5,388 7,771 8,049 8,049 9,720 11,661 15,878 17,641 17,642 17,648 20,873 31,178 31,755 31,812 33,690 34,593 BAYER NA E I DUPONT DE NEMOURS E I DUPONT DE NEMOURS BAYER NA NA NA NA BAYER NA BAYER NA KEY INTL SHPG KEY INTL SHPG KEY INTL SHPG reserv. 21 Defence Intelligence and Security Service Indexing information 22 Arno H.P. Reuser a@reuser.biz Defence Intelligence and Security Service Indexing information People have different viewpoints on subjects making it hard to find a universal arrangement principle or keywords by which to order data or books or digital information. Books on rabbits. What is the correct heading/keyword? A farmer will look under A girl will look under A butcher will look under A researcher will look under A fashion designer will look under V P M L F for Vermin for Pets for Meat products for Laboratory animal for Fur 23 Arno H.P. Reuser a@reuser.biz Defence Intelligence and Security Service Tools Volume in drive D is Data Volume Serial Number is C0C2-4AE6 Directory of D:\osint\OsintDat\persbureaus\foreign broadcast information service\compleet\_recent\2006\01\11 12-01-2006 12-01-2006 11-01-2006 11-01-2006 11-01-2006 11-01-2006 11-01-2006 11-01-2006 11-01-2006 11-01-2006 11-01-2006 11-01-2006 11-01-2006 11-01-2006 11-01-2006 11-01-2006 11-01-2006 18:12 18:12 12:06 09:43 12:06 13:53 13:53 13:53 12:06 09:43 09:43 09:43 13:53 13:53 13:53 12:06 13:53 <DIR> <DIR> 5.835 4.823 13.365 10.675 9.984 6.598 5.127 4.140 3.959 4.053 7.091 4.423 4.621 5.266 4.090 . .. AFP20060111011001-v1.html AFP20060111516001-v1.html AFP20060111516002-v1.html AFP20060111516003-v1.html AFP20060111521001-v1.html AFP20060111525001-v1.html AFP20060111528002-v1.html AFP20060111601001-v1.html AFP20060111601002-v1.html AFP20060111601003-v1.html AFP20060111606001-v1.html AFP20060111606002-v1.html AFP20060111606003-v1.html AFP20060111609001-v1.html AFP20060111610001-v1.html 24 Arno H.P. Reuser a@reuser.biz Defence Intelligence and Security Service 25 Arno H.P. Reuser a@reuser.biz Defence Intelligence and Security Service 26 Arno H.P. Reuser a@reuser.biz Defence Intelligence and Security Service Meta data <!-- DC metatags produced by Arno HP Reuser (reuser@xs4all.nl) --> <META NAME = "DC.Coverage.Region" CONTENT = "Africa" > <META NAME = "DC.Coverage.SubRegion" CONTENT = "West Africa" > <META NAME = "DC.Coverage.Country" CONTENT = "Benin" > <META NAME = "DC.Subject" CONTENT = "DOMESTIC POLITICAL" > <META NAME = "DC.Subject" CONTENT = "LEADER" > <META NAME = "DC.Title" CONTENT = "Benin: Resignation of Defense Minister Reported" > <META NAME = "DC.Source" CONTENT = "Cotonou Le Matinal (Internet version-WWW)" > <META NAME = "DC.Description" CONTENT = "Beninese defence minister said quits over row with president Text of report by Abdouramane Toure entitled "For major contradictions: Osho resigns from the government" published by Beninese newspaper Le Matinal website on 11 January Nothing is going on well between President Mathieu > <META NAME = "DC.Publisher" CONTENT = "FBIS PIOS" > <META NAME = "DC.Format" CONTENT = "text/html" > <META NAME = "DC.Date" SCHEME = "WTN8601" CONTENT = "2006-01-11T07:54" > <META NAME = "XDC.OrgFileName" CONTENT = "AFP20060111011001_000123_a.html" > <META NAME = "DC.Date.Modified" SCHEME = "WTN8601" CONTENT = "2006-0111T12:06:35" > <! -- ***************** end of DC Meta Data block ***************** --> <TITLE>Benin: Resignation of Defense Minister Reported</TITLE> Arno H.P. Reuser a@reuser.biz 27 Defence Intelligence and Security Service Meta data Problem (or challenge?) • Each information service provider uses its own scheme • Need different query for each provider query query One query for query all query Dublin Core Meta data meta data Dublin Core Meta data meta data Dublin Core Meta data meta data Dublin Core Meta data meta data Information service Information service Information service Information service 28 Arno H.P. Reuser a@reuser.biz Defence Intelligence and Security Service Done! Remarks? Comments? Questions? Additions? 29 Arno H.P. Reuser a@reuser.biz Defence Intelligence and Security Service x 30 Arno H.P. Reuser a@reuser.biz Defence Intelligence and Security Service counter Dutch Data Protection Authority • "…supervises the fair and lawful use and security of your personal data to ensure your privacy today and in the future" Personal Data Protection Act • "Wet bescherming persoonsgegevens" International campaign againt mass surveillance (ICAMS) Political parties • D'66 (left-wing democrats) • "High quality intelligence are the most effective method against terrorism" • "When in doubt, rather safe than sorry" 31 Arno H.P. Reuser a@reuser.biz Defence Intelligence and Security Service Eurojust • established in 2002 • stimulates and improves the co-ordination of investigations and prosecutions • improves co-operation by facilitating the execution of international mutual legal assistance and the implementation of extradition requests. Europol • European Union law enforcement organisation • handles criminal intelligence; • to assist the law enforcement authorities of Member States in their fight against serious forms of organised crime 32 Arno H.P. Reuser a@reuser.biz