Madrigal Global Query Web Interface – A Search Engine for Upper-Atmosphere Research Scientists
Ezinne Uzo-Okoro
Mentors: John Holt & William Rideout
Montgomery College, MD 20850
MIT Haystack Observatory, MA 01886
Introduction
System Overview
The Madrigal Database has proven to be a very successful online
system for accessing data from Incoherent Scatter Radars and other
upper-atmosphere research instruments. The present Madrigal web
interface, Database Inventory Form, allows users to analyze data one
experiment at a time, where a typical experiment lasts a few hours to
a few days. But if a user wants to search data from more than one
experiment using this Database Inventory Form, they must either
load the data themselves into their analysis tools, or modify a TCL
(Tool Command Language) script according to the criteria they want
to search for.
The Madrigal Database Global Search is
based on characteristics of the experiment, such
as, instrument, date, or experiment name, and in
addition, can depend on the actual data, such as,
whether the ion temperature was above a certain
level. Since the Madrigal data is scanned on a fileby-file basis rather than as a relational database,
real-time results will not be possible. Hence, the
results will be emailed to the user when complete.
If the report is too large to be emailed
conveniently, a URL for the report is emailed
instead of the report itself.
The Madrigal Global Query Web Interface is a web-based,
searchable, and extensible database application designed to enable
users to utilize the large body of data contained in the Madrigal
Database in an effective manner. Using this Global Query Search,
scientists can easily enter queries specifying the experiment or
parameters that are relevant to their needs.
The following are snapshots of the Madrigal
Global Query Interface web page showing how a
user requests data, and what is received via email.
Page reloads after instrument(s) have been selected
Web page loaded initially
Interacting with Madrigal
Scientific databases, like the Madrigal database, are accessed by
users from a wide range of disciplines, mostly unfamiliar with
databases and their associated query languages. These users need to
search for specific pieces of data quickly and more efficiently. They
need to browse through related information to see if it is of value to
them. Madrigal Database Global Search is an online application that
codifies the requests of its users for efficiency and flexibility of
complex queries.
This approach to global searching has several advantages:
•It provides enough flexibility for a wide range of researchers
•Its simplicity helps users avoid ill-defined queries (to a certain
degree)
Redirected back to search page with saved user info
Gets user’s email address before generating report
Summary
Evaluation
•Madrigal Global Query Web Interface provides a unique resource to scientists and experts
in the upper-atmosphere research community to enable them to utilize the database,
without knowing terminology or how to use particular applications outside of their domain
of expertise.
The ultimate test for Madrigal Global Query Web Interface will be:
a. Whether research scientists of all levels can perform global
searches of the Madrigal Database without knowledge of any
programming language, and
b. Whether the resulting application will meet the need for ease of
use and understanding, and the need for flexibility to allow complex
queries.
Parameter list page showing available parameters
•It is a web-based search engine that accepts sets of instruments, precise kinds of data and
dates, and parameter filters as input and finds files that matchthat criteria.
Email received by user
•Madrigal Global Search is also extensible – users may request to upload new instruments,
kinds of data, or parameters pertaining to a specific experiment.
•It balances two conflicting needs – the need for ease of use and understanding, and the
need for flexibility to allow complex queries
One secondary concern is:
c. Whether the performance of the search engine will be adequate to
ensure user satisfaction
Future Work
Unfortunately, most of these questions remain unanswered at this
time, since Madrigal Global Search has yet to be fully deployed, and
so far, members of the Open-Madrigal Developers are its only users.
However, all reactions have been positive.
o Develop a relational database
o Install this application on other madrigal sites
o Add visualization to be used to analyze the data
Report saved at temporary URL to save user inbox space
NSF