The WFC3
Quicklook Project
17 January 2013
1
What is Quicklook?
The WFC3 Quicklook project is a complete
archive of all ~90k in-flight WFC3 images.
It's includes a file system of FITS files and
JPEG preview images all mapped to a
database.
QL is maintained by a pure-Python code base.
2
What Does QL Give WFC3?
Daily human inspection of all new WFC3
data.
Immediate access to the entire WFC3 in-flight
dataset.
An interface to build highly customized
datasets.
Tools and data for exciting new projects.
3
How do we use Quicklook?
Large datasets:
• Build the persistence correction products
•
•
•
(Knox Long)
Monitor the WFC3 “blobs” (Nor Pirzkal)
IR flat fields (Nor Pirzkal)
UVIS backgrounds (Sylvia Baggett, Jay
Anderson)
4
How do we use Quicklook?
Immediate Accessibility:
Every WFC3 image is inspected by a
human.
•
Automation:
The QL project is always getting the latest
data.
•
5
The File System
Every FITS extension including engineering
and drizzled products. GO data is protected
by group permissions.
Updated daily with new observations.
Contains a JPEG preview of each flt FITS
image.
>15TB of data on STScI central storage.
6
The Database
The database information is stored in a
SQLite relational database on STScI central
store.
Contains all the header keywords for all
extensions of the FLT files.
Contains information on creation date, file
location, etc.
7
The Code Base
~4k lines of pure-Python code.
File system operations, database operations,
plotting, downloading.
Maintained with software tools: SVN version
control, Trac project management, nosetest,
pylint, SQLAlchemy, Sphinx documentation.
8
QL Development
QL has evolved to meet the needs of the team.
Version 0: scripts + 6 page word document
Version 1: Automated basic daily inspection
tasks
Version 2: Focused on file system
completeness and database indexing
9
Future Work
Move the QL project to a Linux Red Hat
virtual machine.
Automate many of the WFC3 monitoring
tasks by using QL and using the lessons
learned from building QL.
10
Contributors
Supported and developed by Abhijith Rajan,
Alex Viana, Matt Bourque, Michael
Dulude, and Heather Gunning.
Based on SyBase interface Python modules
by Bryan York and Sami Nemi.
The entire WFC3 team provides essential
feedback for the QL project.
11
Thank You!
Questions?
12