OPEN SOURCE INTELLIGENCE SOLUTION
FOR DELHI POLICE
EXPRESSION OF INTEREST
Expression of Interest
Open Source Intelligence Solution for Delhi Police
Table of Contents
1
2
Background ......................................................................................................................... 3
1.1
Purpose of this Expression of Interest (EOI) ................................................................. 3
1.2
Details of Open Source Intelligence (OSINT) Solution .................................................. 3
Scope of Work and Functional Requirements ..................................................................... 4
2.1
2.1.1
Development Model ................................................................................................ 4
2.1.2
IT Infrastructure Implementation for the project ...................................................... 5
2.1.3
Change Management and Capacity Building .......................................................... 5
2.1.4
Systemperformance ................................................................................................ 5
2.2
3
4
Indicative Scope of Work ............................................................................................... 4
Key Functional Requirements of the OSINT Solution .................................................... 5
2.2.1
Data Extraction ....................................................................................................... 5
2.2.2
Data Integration ...................................................................................................... 6
2.2.3
Data enrichment...................................................................................................... 6
2.2.4
Information Classification ........................................................................................ 6
2.2.5
Analysis and visualization of results ........................................................................ 6
Instruction to Bidders ........................................................................................................... 6
3.1
Availability of the EOI documents .................................................................................. 6
3.2
EOI Response Requirements ........................................................................................ 7
3.3
Disclaimer ...................................................................................................................... 7
3.4
Costs to be borne by Respondents ............................................................................... 7
3.5
No Legal Relationship ................................................................................................... 8
3.6
Recipient Obligation to Inform Itself ............................................................................... 8
3.7
Rights of Ownership ...................................................................................................... 8
3.8
Request for Information ................................................................................................. 8
Annexure ............................................................................................................................. 9
4.1
Annexure - I: Covering Letter ........................................................................................ 9
4.2
Annexure – II: Format-Details of the Organization....................................................... 11
4.3
Annexure – III: Format-Financial Information .............................................................. 12
4.4
Annexure – IV: Format-Implementation Experience (Only Completed Assignments).. 13
4.5
Annexure – V: Non-Disclosure Agreement (On the Letterhead of the Company) ....... 14
4.6
Annexure - VI: Compliance Sheet for the EOI Response ............................................ 15
4.7
Annexure - VII: Compliance sheet for Capabilities of the OSINT Software Solution ... 16
Page 2 of 35
Expression of Interest
1
1.1
Open Source Intelligence Solution for Delhi Police
Background
Purpose of this Expression of Interest (EOI)
Delhi Police invites Expression of Interest (EOI) from interested agencies (SI/
Vendors) for implementation of “Open Source Intelligence (OSINT)” solution to
strengthen crime intelligence capabilities of Delhi Police. Objective of this EOI is to
solicit responses from interested Vendors regarding the Solutions (Bespoke or
Commercial off the Shelf (COTS)), technologies and specifications available for “Open
Source Intelligence” system. This EOI provides information about the scope of
services required as well as the functional requirements for the system.
1.2
Details of Open Source Intelligence (OSINT) Solution
Internet can be a vital source of information for law enforcement agencies to help them
in identifying criminals and criminal activities. Internet is probably the largest source of
data today, with potential to provide valuable, real-time intelligence from social
networking sites, information agencies, government sources, commercial sources and
variety of other organizations. Open Source Intelligence is a strategic initiative of Delhi
Police to provide aid in the investigation process by providing them actionable
intelligence through analysis of the content available on internet in public domains.
Criminals, terrorists and anti social elements are using Social Media Websites and
other public platforms for conversations and to plan their activities. Presently, Delhi
Police does not have any means to extract the content available on the web and
convert it into meaningful data to identify criminals or trace their conversations. Thus
an Open Source Intelligence Solution is to be implemented with following key
objectives:
a) Provide actionable intelligence to the police by collecting and analyzing content
available on web in public domains.
b) Provide comprehensive information about suspects and their online activities from
scattered public open source data.
c) Provide aid to police in criminal profiling from the data available on web.
d) Analyze the data available on Social Media, blogs and other public forums to do
Sentiment analysis. Sentiment analysis will help in proactively identification of any
anti social or criminal motives of a person or group of people.
e) Integration of extracted unstructured data from web with existing Criminal
Repository of Delhi Police to perform analytics operations on the integrated
content. This will expedite the criminal investigation process and improve response
time for solving a case.
Page 3 of 35
Expression of Interest
2
2.1
Open Source Intelligence Solution for Delhi Police
Scope of Work and Functional Requirements
Indicative Scope of Work
Purpose of this EOI is to identify prospective Vendors/Solution Providers for
implementation of COTS or bespoke “Open Source Intelligence” Solution and to come
up with a comprehensive and implementable set of specifications for the proposed
project. All aspects which would be critical for the success of the said project for
example procurement of licenses, customizations, configurations, installation
implementation and maintenance of Open Source Intelligence Software and Hardware
would have to be addressed by the participants. Further aspects like training and
change management activities required to enable a specific group of users to use the
new system effectively, would also have to be indicated. Limitations if any of the
proposed technologies should also be clearly spelled out. The EOI should at least
provide the following details:
2.1.1 Development Model
The EOI should indicate an appropriate development model ensuring adherence and
timely delivery of envisaged solution components. Development model should cover
but not limited to following key activities 2.1.1.1 Design
i.
ii.
iii.
iv.
Preparation of System Requirement Specification (SRS) document containing
detailed requirement analysis including functional requirements, Interface
Specifications, application security requirements.
High Level Software Design document including Solution Architecture design,
Logical and Physical Database design etc.
Low Level Software Design document including Programming Logic,
Workflows etc.
Procurement of Hardware and Network equipments based on the proposed
Software, Performance, Load and Security Requirements.
2.1.1.2 Development & Testing
i.
ii.
iii.
Development of Application Software if it’s a bespoke solution or
customization according to requirements in case of COTS product.
Test Plans and Test cases (including Unit Test Plan, System/Integration Test
Plan, User Acceptance Test Plan, Security Test Plan, and Load Test Plan).
Testing & Resolution of defects/bugs found in User Acceptance Testing
(UAT). Provide all necessary documentation including – Test Cases and Test
Plan Defect Logs and information about setting up of an UAT environment.
2.1.1.3 Implementation of Open Source Intelligence Software
i.
ii.
Deployment of software application in production environment.
Documentations related to software like Training Manuals and System
Administration Manuals, User manuals, Installation Manuals, Operational
Page 4 of 35
Expression of Interest
Open Source Intelligence Solution for Delhi Police
Manuals, Maintenance Manuals, etc.
2.1.2 IT Infrastructure Implementation for the project
i.
ii.
iii.
Validation of Infrastructure Requirements
Lab Setup for Test/ Development Environment
Procurement and installation of Application and Database Servers and
installation of supporting application software as per system requirements
2.1.3 Change Management and Capacity Building
i.
Information about required change management framework and the procedure
of executing the same in a given timeframe.
Details about Capacity Building and Training Processes. This training should be
comprehensive in nature and should cover all aspects of the functionalities
proposed for implementation.
ii.
2.1.4 System Performance
An achievable Service Level Agreement in consonance with the proposed solution
should be indicated.
2.2
Key Functional Requirements of the OSINT Solution
2.2.1 Data Extraction
Software should be able to extract and index all of the content available from a wide
range of sources on web like Social Media, Public forums, Blogs, Government and
Commercial websites. It should be able to detach the irrelevant content from the
relevant one, enrich the data with attribution and prepare it for downstream use. Data
Extraction module should have at least the following functionalities –
2.2.1.1 Functional requirements for Web Crawler
i.
ii.
iii.
Ability to perform complex navigation through menu structures, supply input
for any web form, navigate through multiple pages of output and support for
multi screen web page data extraction
Cleanse pages of uninteresting content (such as navigation bars, title, banners
etc.)
Ability to provide metadata and data facets based on the context of extracted
data for downstream data analysis.
2.2.1.2 Extensible Data extraction support
Solution should support extraction of data in any format from any website in public
domain, including text, office documents, PDF, flat files, images, audio, video files
and even files accessible via FTP and other non HTTP protocols.
Page 5 of 35
Expression of Interest
Open Source Intelligence Solution for Delhi Police
2.2.1.3 Multiple Language Support
Solution should support single and multi byte character encodings and provide
support for a diversified set of languages including bidirectional languages like
Arabic and Hebrew.
2.2.2 Data Integration
Extracted data should be in a standardized format so that it can be easily integrated
with the existing databases. Data integration should support multiple integration
standards available like XML, HTML, JSON, JMS and CSV etc.
2.2.3 Data enrichment
System should be able to enrich the dataset as it is crawled to enable near real time
access and improve responsiveness. This feature is especially required for the field
investigative officers.
2.2.4 Information Classification
i.
ii.
System should be able to represent semantic content on the web or the
enterprise resource that appears to be related to the search item.
Context and Object Identification - Facility to discover related context on the
web and allow for object based indexing as an aid to automatically identify
people, place, organizations etc.
2.2.5 Analysis and visualization of results
Solution should have following analytical and visualization capabilities –
i.
ii.
iii.
iv.
v.
3
3.1
It should be able to perform search and analysis on the captured content and
metadata.
It should enable end users to visualize the data by date and time and allow the
users to refine the query based on the result of these visualizations.
Solution should provide the ability to identify the pages based on geography
and to visualize changes in geographical activity over time.
Analyze internet traffic originating from or terminating at a Subject of Interest
on a watch list
Sentiment Analysis – System should be able to analyze the content from
Social Media like Facebook, Twitter etc; public forums; blogs etc; to do
sentiment analysis of a person or group of people.
Instruction to Participants / Bidders:
Availability of the EOI documents
EOI can be downloaded from Delhi Police Website. Interested agencies are expected
to examine all instructions, forms, terms, project requirements and other details in the
EOI documents.
Page 6 of 35
Expression of Interest
3.2
Open Source Intelligence Solution for Delhi Police
EOI Response Requirements
Interested agencies may furnish their Expression of Interest by giving all the necessary
information and supporting documents in English language as specified in the
Response Formats given in Section 4 ( Annexure) of this EOI. In addition to that,
for each of the OSINT solution implemented and provided as project references by the
Bidders, the supporting documents relating to each of the OSINT solutions must be
furnished separately.
The Expression of Interest in a sealed cover along with an application duly signed by
an authorized signatory must reach the following address on or before 15/07/2013 by
1100 Hours which will be opened on the same day 1145 hours.
1 hard copy and 2 soft copies are required to be submitted in sealed covers labeled
“Open Source Intelligence Solution for Delhi Police: Expression of Interest” at
the following address:
[Office of the Dy. Commissioner of Police, Prov. & Logistics, 5, Rajpur Road, Delhi110054 or the same can be put personally in the EOI Box kept in the Receiption Office
of the DCP/Prov. & Logistics, 5 Rajpur Road, Delhi-110054]
For queries and clarifications regarding the EOI, please contact:
Name/ Designation of the Contact Person: Sh. R.K. Jha, Dy. Commissioner of Police,
Prov. & Logistics, Delhi.
Email ID: acpcsa@yahoo.com
Phone Number: 23915585
Fax Number: 23993344, 23974427
Last date for submission of queries and clarifications is 27/06/2013 upto 1700 Hours.
A consultation meeting will also be held on 28/06/2013 at 1100 Hours in the office of
Joint CP/EOW, P.S. Mandir Marg Complex, New Delhi.
All the interested
Companies/firms may participate in the consultation meeting for clarifications and
related project information.
Please note that all the information desired as per the checklist needs to be provided.
3.3
Disclaimer
Subject to any law to the contrary, and to the maximum extent permitted by law, Delhi
Police and its officers, employees, contractors, agents, and advisers disclaim all
liability from any loss or damage (whether foreseeable or not) suffered by any person
acting on or refraining from acting because of any information including forecasts,
statements, estimates, or projections contained in this Request for EOI document or
conduct ancillary to it whether or not the loss or damage arises in connection with any
negligence, omission, default, lack of care or misrepresentation on the part of Delhi
Police or any of its officers, employees, contractors, agents, or advisers.
3.4
Costs to be borne by Respondents
All costs and expenses incurred by Respondents in any way associated with the
Page 7 of 35
Expression of Interest
Open Source Intelligence Solution for Delhi Police
development, preparation, and submission of responses, including but not limited to
the attendance at meetings, discussions, presentations, demonstrations, etc. and
providing any additional information required by Delhi Police, will be borne entirely and
exclusively by the Respondent.
3.5
No Legal Relationship
The selection in the EOI or participation in the EOI process doesn’t qualify for any
contractual obligation from Delhi Police.
3.6
Recipient Obligation to Inform Itself
The Recipient must conduct its own investigation and analysis regarding any
information contained in the Request for EOI document and the meaning and impact
of that information.
3.7
Rights of Ownership
All submissions, including any accompanying documents, will become the property of
Delhi Police. Recipients shall be deemed to grant all rights to Delhi Police to reproduce
whole or any portion of their submission for the purpose of evaluation, to disclose the
contents of the submission to other Recipients who have registered a submission and
to disclose and/or use the contents of the submission as the basis for any resulting
EOI process, notwithstanding any copyright or other intellectual property right that may
subsist in the submission or accompanying documents.
3.8
Request for Information
Delhi Police will not answer any communication initiated by Respondents later than
the business days prior to the due date for submission of EOIs. Respondents should
provide details of their Fax, email and full address(s) to ensure that replies to EOI
could be conveyed promptly.
If Delhi Police, in its absolute discretion, deems that the originator of the question will
gain an advantage by a response to a question, then Delhi Police reserves the right to
communicate such response to all Respondents.
Delhi Police may, in its absolute discretion, engage in discussion with any Respondent
(or simultaneously with more than one Respondent) after the EOI closes to improve or
clarify any response.
Delhi Police reserves the right to withdraw or cancel this EOI document at any time
without assigning any reasons thereof.
While this EOI has been prepared in good faith, neither the Delhi Police nor their
employees or advisors/consultants make any representation or warranty, express or
Page 8 of 35
Expression of Interest
Open Source Intelligence Solution for Delhi Police
implied, or accept any responsibility or liability, whatsoever, in respect of any
statements or omissions herein, or the accuracy, completeness or reliability of
information contained herein, and shall incur no liability under any law, statute, rules
or regulations as to the accuracy, reliability or completeness of this EOI, even if any
loss or damage is caused to the Bidder by any act or omission on their part.
4
4.1
Annexure
Annexure - I: Covering Letter
Company Letter Head
Date
Dy. Commissioner of Police,
Prov. & Logistics, Delhi
Reference: Expression of Interest for “Open Source Intelligence Solution for Delhi
Police”
Dear Sir,
This is to notify you that our company intends to submit a proposal in response to the
EOI request for Project “Open Source Intelligence Solution for Delhi Police”.
Primary and Secondary contacts for our company are
Primary Contact
Secondary Contact
Name:
Title:
Company Name:
Address:
Phone
Mobile:
Fax:
E-Mail
We confirm that the information contained in this response or any part thereof,
including its exhibits, and other documents and instruments delivered or to be
delivered are true, accurate, verifiable and complete. The response includes all
information necessary to ensure that the statements therein do not in whole or in part
mislead Delhi Police in its short listing process.
Page 9 of 35
Expression of Interest
Open Source Intelligence Solution for Delhi Police
We fully understand and agree to comply that verification, if any of the information
provided here is found to be misleading the short listing process or unduly favors our
company in the short listing process, we are liable to be dismissed from the selection
process.
We undertake that we’ll deploy only persons of Indian Origin and Citizens of India in
the execution of this project in the event our company gets selected for the execution
of this project.
It is hereby confirmed that I/ We are entitled to act on behalf of our
corporation/company/firm/organization and empowered to sign this document as well
as such other documents, which may be required in this connection.
Dated this ________ Day of _________2013
(Signature)
(In capacity of)
Duly authorized to sign the EOI response for and on behalf of
Sincerely,
(System Integrators Name)
Name:
Title:
Signature:
Date:
(Name and Address of Company)
(Seal/ Stamp of System Integrator)
Certificate as to Authorized Signatories
I, certify that I am _____________________________of the________________--, and
that____________________________ who signed the above response is authorized
to bind corporation by authority of its governing body.
(Company Seal)
Date:
Page 10 of 35
Expression of Interest
4.2
Open Source Intelligence Solution for Delhi Police
Annexure – II: Format - Details of the Organization
Details of the Organization
Name
Nature of the legal status in India
Nature of business in India
Date of Incorporation
Date of Commencement of Business
Address of the Headquarters
Address of the Registered Office in India
Details of the Contact Person (incl Address,
Phone, Fax and e-Mail)
Other Relevant Information
Note: Please DO NOT attach any related documents.
Page 11 of 35
Expression of Interest
4.3
Open Source Intelligence Solution for Delhi Police
Annexure – III: Format-Financial Information
Financial Information
FY 2009-10
Total Turnover
crores)
(in
INR
Turnover form IT related
services (in INR crores)
Profit After Tax (in INR
crores)
Net worth (in INR crores)
Other Relevant Information
Note: Please DO NOT attach any related documents.
Page 12 of 35
FY 2010-11
FY 2011-12
Expression of Interest
4.4
Open Source Intelligence Solution for Delhi Police
Annexure – IV: Format-Implementation Experience if any (Only Completed
Assignments)
Assignment name:
Approx. value of the contract:
Country:
Duration of assignment (months):
Location within Country:
Name of Client:
Total No of staff-months of the assignment:
Address:
Approx. value of the services provided
under the contract (in Current INR):
Start Date (Month/Year):
Completion Date (Month/Year):
No. of Months of Professional Staff Provided
by Associated Consultants:
Project Completion Certificates:
Licensing/User Base/Geographical Spread:
Acceptances
Officers
Name of senior professional staff of your
firm
from
Concerned
Project Manager:
Narrative Description of Project:
Description of Actual Services Provided by SI/Vendor:
Note: Please DO NOT attach any documents.
Page 13 of 35
Expression of Interest
4.5
Open Source Intelligence Solution for Delhi Police
Annexure – V: Non-Disclosure Agreement (On the Letterhead of the Company)
Non- Disclosure Agreement
It is certified that the company or any representative of the company or agents
authorized by the company will not disclose any information gained by them or their
representatives or agents, while interacting with the personnel of the Delhi Police or
any documents received by them or any study carried out by them, directly or indirectly
to any company or institution or press.
Company Seal
Place __________________
Date___________________
(Authorized Signatory of Company)
Page 14 of 35
Expression of Interest
4.6
Open Source Intelligence Solution for Delhi Police
Annexure - VI: Compliance Sheet for the EOI Response
S.No.
Compliance Criteria
Document Required
1.
Covering letter
As per clause 4.1 Annexure I
2.
Details of Organization
As per clause 4.2 Annexure II
3.
Financial Information
As per clause 4.3 Annexure III
4.
Work experience
As per clause 4.4 Annexure IV
5.
Non- Disclosure Agreement
As per clause 4.5 Annexure V
6.
Details of
Solution
the
proposed
OSINT
Page 15 of 35
As per the requirement mentioned in
clause 1 & 2.
Expression of Interest
4.7
Open Source Intelligence Solution for Delhi Police
Annexure - VII: Compliance sheet for Capabilities of the proposed OSINT Software
Solution
S.No
Functionality Offered by the proposed
COTS
application
/
Functionality
proposed for Be-Spoke application
Compliance of the OSINT
Solution
as
per
the
requirement of Delhi Police
1
2
3
4
Note: - Vendors/SI can list down any additional functionality available with the product/
solution being offered/ proposed , which has not been asked by Delhi police and indicate
the same clearly.
*****
Page 16 of 35
Expression of Interest
Open Source Intelligence Solution for Delhi Police
RESULT OF EOI CONSULTATION MEETING FOR OPEN SOURCE INTELLIGENCE SOLUTION (OSINT)
HELD ON 28/06/2013 AT 1100 HRS. IN THE OFFICE OF JOINT CP/EOW AT P.S. MANDIR MARG COMPLEX,
NEW DELHI FOR USE IN DELHI POLICE
The EOI consultation meeting held on 28/06/2013 at 1100 Hours under the Chairmanship of Joint
C.P./EOW, Delhi in Conference Hall, 3rd Floor, EOW office, Mandir Marg Complex, New Delhi regarding Open
Source intelligence Solution for use of Delhi Police.
The representatives of the following firms attended the meeting:-
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.
13.
14.
15.
16.
M/s Verint Systems Ltd., Gurgaon
M/s Precision Operation Systems Pvt. Ltd, Thane
M/s Keltron Ltd., Kerla
M/s Reliance Security Solutions Ltd., Gurgaon
M/s HP India sales Pvt. Ltd, Gurgaon
M/s IBM India Pvt. Ltd, Connaught Place, New Delhi
M/s eCentric Solution Pvt. Ltd., New Delhi
M/s HCL Technologies, Noida
M/s OIPL, Gurgaon
M/s AGC Networks ltd., Gurgaon
M/s Instasol ltd, New Delhi
M/s Wipro ltd, Gurgaon
M/s NIIT Technologies ltd, Noida
M/s Oracle, Gurgaon
M/s Orkash Services Pvt. Ltd, Gurgaon
M/s IGate Global Ltd, Noida
17. M/s SAS India Pvt. Ltd., GK-2
18. M/s Tata Consultancy Services ltd, New Delhi
The queries raised by the representatives of all the firms were discussed by the Committee in detail and
responded in following manner –
Queries raised by participant firms:
S.No
Document
Reference(s) (Section
& Page Number(s))
Company
Details:
Deep
Public
Sector,
Ist Floor, Birla Towers, 25,
Mobile:+91-9910028507
Fax:
deep.nigam@in.ibm.com
Queries from Vendor
IBM
IBM
Barakhamba
Road,
Response from Delhi Police
India
India
Connaught
Pvt
Pvt
Place, New
Delhi
Limited
Nigam
Limited,
-110001
91-11-41511871
Page 17 of 35
Expression of Interest
Open Source Intelligence Solution for Delhi Police
Page 5, Section 2.2.1.2
Extensible
Data
extraction support
Data need to be extract
from images, audio,
video is asked. Does
that mean metadata or
comments
associated
with these files will have
to be extracted for
analysis?
Yes it means extraction of metadata and
comments associated with images, audio and
video. However, bidder should not limit
themselves to what is asked in the EOI. They are
encouraged to propose better alternatives for
extraction of information from these media types.
2
Page 6, Section 2.2.2
Data Integration
As
integration
with
existing database is
asked in this section. We
would like to know :
1. what are the existing
databases available at
Delhi
Police.
2. Do you also want
integration of extracted
unstructured data with
Hadoop
for
storage
purpose?
1. List of Existing databases is provided in the
EOI presentation uploaded on the website
2. As of now no specific solution has been
finalized for storing unstructured data, you are
encouraged to suggest any solution, which can
meet the requirements of the project.
3
Page 6, Section 2.2.5
Analysis
and
visualization of results
1
4
S.No
Page 3, Section 1.2 c)
Document
Reference(s) (Section
& Page Number(s))
What
kind
of
visualization of changes
in geographical activity
over time is required.
Please specify
This functionality refers to ability to track a
criminal or suspect's movement through his
presence on the internet, as he moves from one
place to another.
Only the information will
be provided which will
help Delhi Police in
doing criminal profiling
Only Public information is expected to be
collected
Queries from Vendor
Response from Delhi Police
Company
Details:
Vivek
Saxena,
Director
Verint
Communication
&
2nd
Floor,
Tower
A,
Building
no
8,
Phone:
+91.124.4159500
Cell
:
Fax
:
Email : vivek.saxena@verint.com
VERINT
Government
Cyber
DLF
Cyber
City
SYSTEMS
LTD
Sales
–
India
Intelligence
Solutions
Phase
II,
Gurgaon
122002
Ext
588
+91.997.1113870
+91.124.4159510
1
1.2
e),
Pg
3
Integration to Criminal
Repository
What is the existing
DBMS of the criminal
repository. Does type of
OPEN API's for OSINT
Integration.
Criminal
Repository
is
the
proposed
datawarehouse of Delhi Police, which will
integrate data from multiple data sources.
2
2.2.1.1
(i),
Pg
5
Multiscreen Web Page
Data Extraction
Please provide details
on the Multi Screen Data
extraction. What does it
mean?
Sometimes, when search is performed, we get
results in multiple pages. Ability to perform
search on such multiple pages is what multi
screen data extraction refers to.
Page 18 of 35
Expression of Interest
3
4
S.No
2.2.1.1
(iii),
Pg
5
Metadata & Data Facets
To our understanding
the Metadata refers to
the
unstructured
collected data. Kindly
confirm
on
understanding
Metadata here refers to one or the following
aspects
of
extracted
data
like:
Means of creation of the data, Purpose of the
data, Time and date of creation, Creator or
author of data, Location on a computer network
where the data was created, Standards used for
data elements
2.2.5,
Pg
6
Ability to Identify Pages
on Geography
The
geographical
identification needs to be
done to what level?
Would language used
within the Webpage be
the identification criteria?
This functionality refers to ability to track a
criminal or suspect's movement through his
presence on internet, as he moves from one
place
to
another.
As of now exact geographical needs haven't
been decided. Your proposal should deal with
the best possible solutions available for this.
Queries from Vendor
Response from Delhi Police
Document
Reference(s) (Section
& Page Number(s))
Company
Ankur
3rd
Ambience
Gurgaon
Mobile - 9310902070
1
Open Source Intelligence Solution for Delhi Police
Details:
IL&FS
Technologies
Floor,
Page 5, Section 2.2.1.2
Extensible
Data
extraction support
2
Page 6, Section 2.2.2
Data Integration
3
Page 6, Section 2.2.5
Analysis
and
visualization of results
Corporate
-
Data need to be extract
from images, audio,
video is asked. Does
that mean metadata or
comments
associated
with these files will have
to be extracted for
analysis?
As
integration
with
existing database is
asked in this section. We
would like to know :
1. what are the existing
databases available at
Delhi
Police.
2. Do you also want
integration of extracted
unstructured data with
Hadoop
for
storage
purpose?
What
kind
of
visualization of changes
in geographical activity
over time is required.
Please specify
Ltd
Gupta
Tower
Mall
122002
Yes it means extraction of metadata and
comments associated with images, audio and
video. However, bidder should not limit
themselves to what is asked in the EOI, you are
encouraged to propose better alternatives for
extraction of information from these media types.
1. List of Existing databases is provided in the
EOI presentation uploaded on the website
2. As of now no specific solution has been
finalized for storing unstructured data, you are
encouraged to suggest any solution, which can
meet the requirements of the project.
This functionality refers to ability to track a
criminal or suspect's movement through his
presence on the internet, as he moves from one
place to another.
Page 19 of 35
Expression of Interest
4
Page 3, Section 1.2 c)
Open Source Intelligence Solution for Delhi Police
Only the information will
be provided which will
help Delhi Police in
doing criminal profiling
Only Public information is expected to be
collected
Purpose of this EOI is to solicit solutions for EI2S from the prospective bidders, so they were encouraged to
provide suggestions/recommendations so that requirements of the project can be refined in a more practical and
feasible manner. Below is a comprehensive list of suggestions provided by a few of the vendors, who participated
in the meeting.
Suggestions/Recommendations from the participant firms:
S.No
Document
Reference(s)
(Section & Page
Number(s))
Company
Siddharth
Account
siddharth.gupta@hp.com
M
Hewlett-Packard
1
General
2
General
3
General
4
General
5
General
6
General
7
General
8
General
Suggestions/ Recommendations from
Vendor
Name:
HP
Software
Gupta
Autonomy
97310
40931
Executive,
+91
Response from Committee
Ability to automatically cluster/group results
based on the keyword searched. For e.g.,
searching bomb blast would group results
say like RDX, Blast in Particular place and
so on
Ability to perform Conceptual matching,
Pattern Discovery (portrays how information
changes over time for e.g. how a bomb blast
case is progressing over time)
Ability to perform Parametric search on
Phone Numbers, IMEI & so on where by the
results can be easily narrowed down
Ability to support highlighted keyword,
provide various forms of summarization of
the document say conceptually, contextual ,
quick summaries
Support for Synonym search for e.g.,
searching for terrorist should also show
results of extremist, maoist, outlaw.
Configuring synonyms should be handled by
Business users and should not involve IT
team.
Ability to provide spell check based on the
document ingested and should NOT depend
on any external dictionary/ source for spell
check
Ability to auto-detect the keyed in language
and show results in the that language. For
e.g., if keyed in language is Hindi system
should auto-detect and show relevant Hindi
content results
Senior Officer should have ability to get
automatic updates via email on a particular
report/story based on their interest areas
Page 20 of 35
Exact Functional and Non
functional requirements will be
detailed in the RFP, bidders are
requested to describe the best
solutions they can offer at this
stage
Expression of Interest
9
General
10
General
11
General
S.No
Document
Reference(s)
(Section & Page
Number(s))
Company
Details:
Aashita
Business
4th,
Building,
Parliament
New
Tel:
Fax:
Email: aashita.dagar@tcs.com
1
2.2.1,
Pg
5
Extract and index
all of the content
available…
Open Source Intelligence Solution for Delhi Police
Should be a highly scalable system, with
sub-second response
Analyse the data available on Social Media,
blogs and other public forums to perform
Sentiment analysis. Sentiment Analysis for
this sort of purpose is not practical as the
communication used for criminals will be
usually a coded language. Sentiment
analysis usually identifies positive or
negative vibes in the communication.
Instead of sentiment analysis conceptual
capabilities is required. For example, if
police can identify the twitter hash tag of a
suspected criminal, they can do a search
across all the posts which they have
tweeted/ retweeted to see new emerging
concepts using a clustering mechanism.
Using clustering mechanism grouping of
similar concepts (be it in natural language or
in coded language say operation RED) is
feasible & take any appropriate action for
any bigger cluster (more concepts, more
similar communications). Hence it is better
rephrase the “Sentiment Analysis” in this
EOI to say “Criminal Intent Detection” using
Clustering of communication.
Crawling Social Media should be using the
Social
Media
API’s
e.g.,
https://api.twitter.com
for
twitter,
https://graph.facebook.com/ for Facebook.
Suggestions/ Recommendations from
Vendor
Tata
Consultancy
Development
5th
Floor,
Delhi-
Delhi Police should try to identify the type of
sources that seem interesting from analytics
/ security point of view. Otherwise, data
available on Internet is literally unlimited.
The unlimited scope is too vast while
crawling and would pose a huge storage
issue and analysis would pose a
computational
constraint.
Hence the Crawling should be enabled on
Selected Sites which are of interest and are
selected
through
human
assistance.
We are finding that NEWS sites have been
missed Delhi Police may like to add them
selectively also.
Page 21 of 35
Response from Committee
Services
Limited
Dagar
Manager
PTI
Street,
110001
+91-9250007974
+91-11-23311735
Exact scope of the project,
Functional and Non Functional
requirements will be detailed in
the RFP, bidders are requested
to describe the best solutions
they can offer at this stage
Expression of Interest
Open Source Intelligence Solution for Delhi Police
2.2.1,
Pg
5
..Web like social
media,
public
forums, blogs…
The sources are of different kinds and need
to
be
dealt
differently. Also the social media sites have
a lot of noisy content and a lot of human
assistance and intervention will be needed.
Twitter Data is available thru 3rd party
Twitter content providers and the same is
also only selective data is available Hence
again only selective content can be
searched. Facebook data is not available
commercially but is only available to the
government bodies on legal representation.
Restricted Blogs and Websites can only be
accessed through User name passwords or
digital
signatures.
Commercial sites may block crawlers.
Many of these sites will have security
restrictions in accessing their content. Delhi
Police needs to separately resolve these
security
restrictions.
Also one can analyse targeted information in
real time it has problem of handling new
unanticipated information. If Delhi Police is
viewing this as an analyst’s work Bench –
then the analyst sees data, edits, saves,
forwards – and the system learns from long
term usage. Hence this all has to be human
assisted.
“Able to detach the irrelevant content from
relevant
content
“
The definition of Relevant and Irrelevant
data will have to be human assisted.
Exact Functional and Non
Functional requirements will be
detailed in the RFP, bidders are
requested to describe the best
solutions they can offer at this
stage
2.2.1.2,
Pg
5
..audio, video files
In such cases only the search will be done
through the Meta data available with the
Images, Audio files and video files.
Is Delhi police even looking at the contents
of the video and audio files to be analysed if
so that would require human intervention.
Exact Functional and Non
functional requirements will be
detailed in the RFP, bidders are
requested to describe the best
solutions they can offer at this
stage
4
2.2.1.3,
Pg
6
..Diversified set of
languages..
It is critical to define the scope in terms of
the number of the least languages that will
be
interesting
to
Delhi
Police.
Technologies may not have developed to
analyse
all
languages with same efficiency.
5
2.2.5 (v), Pg
Sentimental
Analysis
Technology is still evolving in this domain
and
the
final
outcome of this analysis may be limited and
the
same
will
have
to be humanly validated.
Exact Functional and Non
functional requirements will be
detailed in the RFP, bidders are
requested to describe the best
solutions they can offer at this
stage
Exact Functional and Non
functional requirements will be
detailed in the RFP, bidders are
requested to describe the best
solutions they can offer at this
stage
2
3
6
2.2.3,
Pg
“
Enrich
dataset”
6
6
the
Delhi Police would need to define the kind of
enrichment desired as the type of
enrichment is highly application specific.
Responsiveness again will need to be
defined as the same would highly depend
upon the complexity of the query and the
various co-relations needed
Page 22 of 35
Exact Functional and Non
functional requirements will be
detailed in the RFP, bidders are
requested to describe the best
solutions they can offer at this
stage
Expression of Interest
7
8
9
10
General
4.4 Annexure – IV,
Pg 13
4.4 Annexure – IV,
Pg 13
4.4 Annexure – IV,
Pg 13
Open Source Intelligence Solution for Delhi Police
Such a platform has to be ever evolving ,
and has to be fine tuned for the user as well
as new sources keep getting added, hence
away on Constant Change requests will be
needed hence a mechanism is needed for
the same.
The OSINT project will be a development
project
with
integration with many sources of data to
provide a output for DP. The SI should be
judged on its capability of its technology
including innovation, R & D and its SI
capabilities for implementing projects ,
scaling up as system. Hence we request the
SI to be judged on its experience on :
1. Integration with different interfaces
2. Capability of providing standardized
platform
for
data
interoperability
3. Transformation experience from legacy
systems.
4. Transitioning from multiple platforms on to
a
single
system.
5. Able to manage risk and complexities
while scaling up and rolling out service
operations
Hence we recommend that implementation
experience of the system integrator should
be for large transformational mission mode
projects which are implemented.
The System Integration projects are long
duration
project
spanning 7-10 years with an implementation
phase
and
operations phase, hence the SI should be
allowed to give project citations where
implementation phase is done and O&M
phase is in progress.
The turnkey project experiences do not have
individual number of staff months for
projects or number of months of professional
staff, hence requesting that in some
assignments the SI may not be able to
provide these details.
Exact Functional and Non
functional requirements will be
detailed in the RFP, bidders are
requested to describe the best
solutions they can offer at this
stage
Bidder selection criteria will be
detailed in the RFP, bidders are
requested to describe the best
solutions they can offer at this
stage
Bidding terms and Conditions
will be detailed in the RFP,
bidders are requested to
describe the best solutions they
can offer at this stage
Bidding terms and Conditions
will be detailed in the RFP,
bidders are requested to
describe the best solutions they
can offer at this stage
The Committee further informed the bidders that answers of their queries will be uploaded on the website.
The bidders are instructed to submit the EOI Responses by 15/07/2013 upto 1100 Hours.
*****
Page 23 of 35
Expression of Interest
Open Source Intelligence Solution for Delhi Police
Presentation Slides
Page 24 of 35
Expression of Interest
Open Source Intelligence Solution for Delhi Police
Page 25 of 35
Expression of Interest
Open Source Intelligence Solution for Delhi Police
Page 26 of 35
Expression of Interest
Open Source Intelligence Solution for Delhi Police
Page 27 of 35
Expression of Interest
Open Source Intelligence Solution for Delhi Police
Page 28 of 35
Expression of Interest
Open Source Intelligence Solution for Delhi Police
Page 29 of 35
Expression of Interest
Open Source Intelligence Solution for Delhi Police
Page 30 of 35
Expression of Interest
Open Source Intelligence Solution for Delhi Police
Page 31 of 35
Expression of Interest
Open Source Intelligence Solution for Delhi Police
Page 32 of 35
Expression of Interest
Open Source Intelligence Solution for Delhi Police
Page 33 of 35
Expression of Interest
Open Source Intelligence Solution for Delhi Police
Page 34 of 35
Expression of Interest
Open Source Intelligence Solution for Delhi Police
Page 35 of 35