An Introduction to Good Run Lists
James Walder
Lancaster University
What are Good Run Lists?
•
For physics measurements, must be confident that the data we use satisfies
our quality constraints.
•
Number of ways to not have ‘good’ data:
•
•
•
•
•
•
•
LHC not in stable-beam mode.
Magnets Off or ramping
Sub-detectors switched off
Too many noisy cells.
There needs to be a way to telling Athena which luminosity blocks to
exclude:
•
The Good Run List (GRL)
Luminosity blocks are ~2mins in length (for the first data)
In it’s simplest form, the GRL is an xml file which specifies sets of ‘good’
luminosity blocks, over which your data should run.
•
Can also contain blacklists, to explicitly exclude some sections (may be useful
in using exclusive sets of data).
•
By creating the xml file and adding it to Athena’s job options,
Luminosity information can be kept intact and correctly calculated.
2
James Walder
ck (~1min).
+)
•
Data Quality Flags
Traffic light system used as indicator of quality of flag:
d by barrel !!and
end-caps)
DQ traffic light system explained:
•! Black
e (e, mu, tau,
jet,(-1):
MET, disabled
…)
•! Grey (0):
undefined
•! Red: (1)
•! Yellow (2):
•! Green (3):
bad
flawed
good
Subdetector is disabled
Very short runs, or problems
DQ monitoring. Decided upon later.
Not good for physics
Use with caution. Decided upon later.
Good for physics use.
!! During first-pass reconstruction
COOL into meta-data store.
•! Available in (d)ESD, (d)AOD, DnPD
#! W/o DQ assessment from expre
#! W/ DQA from express stream:
./0(1*$#&
!!
After first-pass reconstruction, D
•! Values in derived files may be out
!"#$%"$#&
•! While DQ flags should be stable in
'(#&
•! Do not use DQ information in
gs (incl. quantitative info) to indicate on- and offline)*(+$#&
!! Order: black < grey < red < yellow < green
HLT " debug stream
flags exist:
• Over 100+ (failed
1 (re-)reconstruction
files and/or event losses)
•! [Updates only reflected in metada
,--#&
later]
Max Baak, CERN
• Sub-detectors (pixel, SCT)
Trigger (L1 dead time)
•
Wiki R. Hawkings):
• Combined performance ( eg. electrons, jets, ...)
h/trac/atlasoff/browser/DetectorDescription/DetDescrCond/
doc/mainpage.h
• global flags.
7
3
James Walder
Data Quality Flags (cont.)
•
Storage
A DQ hierarchy is in the process of being constructed,
!! The primary storage m
•! Once systems and gro
!! DQ flags hierarchy consists of three levels:
!"#$%"&'()'*%+,''
!"#$%&'()*$
"+,+-,'&$./.,+0.1$
-./012%"&'()'*%+,''
!23$%&'().1$
34."5%"&'()'*%+,6''
!34/.5-.$%&'().6!! During first-pass recon
-4788+9.1$
COOL into meta-data
+$
!"
*"
!"
!"
•! Available in (d)ESD, (d
#! W/o DQ assessment
#! W/ DQA from expre
#"
!! Yellow and grey flags
indicate that work (eg.
calibration) is still
ongoing. Eventually no
yellow or grey flags.
$%&"
!! After first-pass recons
'()"
•! Values in derived files
•! While DQ flags should
!! Yellow flags allowed.
Usage depends on
physics analysis.
!! In process of being
finalized.
4
•! Do not use DQ infor
!! No yellow flags for
physics analysis!
•! [Updates only reflecte
!! (Tertiary flags not yetlater]
defined.)
Max Baak, CERN
James Walder
Example GRL
Ex
!! Common
run/LB xml format
agreed-upon for
good run list file.
!! Common
run/LB xml format
agreed-upon for
good run list file.
•! Design by TAG grp
•! Design by TAG grp
!! Simple and
transparent
structure
!! Simple and
transparent
structure
•! Ranges of LBs
•! Ranges of LBs
!! Also contains
versioning and
metadata info
!! Also contains
versioning and
metadata info
•! Name, version nr.
•! Search query used to create xml file.
•! Streams, trigger names of interest (work in progress)
5
•! Name, version nr.
•! Search query used t
•! Streams, trigger nam
Max Baak, CERN
James Walder
Generating a Good Run List
•
The simplest way is to use the Run Query Tool:
•
•
•
•
either the web-based interface,
•
Where you can download the xml
or the command-line tool:
•
•
AtlRunQuery.py (you need to setup the Athena runtime to use this)
Which will create a directory ‘data’ and generate the file
MyLBCollection.xml
Ultimately it will be the physics groups that generate the GRLs.
•
For the moment, and with first data it is a good time to learn about data
quality.
AtlRunQuery.py 'insert your query here', eg.
•
(note, it appears you need to explicity remove any stablebeams criteria
for the command-line option)
•
e.g. AtlRunQuery.py 'f r 141748+ and det pix and mag s / sh t and lhc'
•
More advanced techniques exist, but we won’t cover those at this tutorial.
6
James Walder
Using the GRLs in Athena
•
•
•
The good part is that to use the GRL in Athena, no modification
is require to your C++ code.
•
All done in jobOptions
May require modification to the default set of jobOptions
The basic lines to be added are:
from GoodRunsLists.GoodRunsListsConf import *
ToolSvc += GoodRunsListSelectorTool()
GoodRunsListSelectorTool.GoodRunsListVec = [ 'MyLBCollection.xml' ]
from GoodRunsListsUser.GoodRunsListsUserConf import *
job.ModSequence1 += GRLTriggerSelectorAlg('GRLTriggerAlg1')
job.ModSequence1.GRLTriggerAlg1.GoodRunsListArray = ['MyLBCollection']
•
Note that if you have your own set of job Options, then some more modification is
required.
•
User Algorithms need to be added to the same as the AthSequencer as the
selection algoritms:
job = AlgSequence()
job += AthSequencer("ModSequence1")
job.ModSequence1 += GRLTriggerSelectorAlg('GRLTriggerAlg1')
job.ModSequence1 += JpsiAlg('JpsiAlg')
job.ModSequence1 += EarlyDataSkeleton('EarlyDataSkeleton')
7
James Walder
Tasks in this session
•
Use the Run Query Tool (web or command line) to create a GoodRunList for the first data (or
just the run number you have downloaded a file for).
•
•
•
•
Use the basic criteria from your Run Query Tool selection, or add additional criteria;
Be as complex as you wish.
Look inside the MyLBCollection.xml file (use a standard text editor);
•
try to understand the key tags in the text.
Add the Good Run List code into the Athena job options,
•
•
See the TWiki to look at this.
Run Athena over the data again, and see if there is any effect.
•
•
Also, see how your GRL compares with some of the already generated files:
•
The Athena GoodRunList packages also will take trigger selection;
this is needed for the luminosity calculation.
•
For more details and if you have time follow the tutorial at
https://twiki.cern.ch/twiki/bin/view/AtlasProtected/GoodRunListsForData
•
•
https://twiki.cern.ch/twiki/bin/viewauth/Atlas/GoodRunsListsTutorial
http://indico.cern.ch/getFile.py/access?
contribId=8&sessionId=2&resId=0&materialId=slides&confId=72458
8
James Walder