T owards common philosophy about rejecting hiding badqual of the calibration data Reason for rejecting to assure that only certifiedgood calibrations are used to be associated with science data science ID: 306352
Download Presentation The PPT/PDF document "To hide, or not to hide, that is the que..." is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
![[ Jeroboam II] restored the border of Israel from Lebo-](https://thumbs.docslides.com/652794/jeroboam-ii-restored-the-border-of-israel-from-lebo.jpg)
Slide1
To hide, or not to hide, that is the questionTowards common philosophy about rejecting, hiding badqual of the calibration data
Reason for rejecting: to assure that only certified/good calibrations are used to be associated with science data (science ABs, the static solution of the calSelector,) and only certified/good master calibrations are ingested in the Archive;Reason for hiding: to clean the ESO Archive from bad/unusable calibration raw frames that could otherwise be picked up by future users (the dynamic solution of the calSelector);Reason for badqual: to assure that, on the calChecker level, only certified/good calibrations are considered for science association; main motivation is to alert Paranal if good calibrations are missing;
Good data
– definition: stable in time, closely correspond to the
status
of the instrument;
should be “scored
green
”,
but
can also be “scored
red” if the reasons are understood
and
accepted;Slide2
Data
REJECTVCAL rm
HIDE
BADQUAL
saturated, severely underexposed, contaminated by artifacts, unusable/bad for science
YES
YES
YES
YES
pipeline failed
because data are faulty/bad
YES
YES
YES
“scored red” but reflect out of ordinary, acceptable status of the instrument;
correspond to the science data
NO
NO
NO
NO
“scored red” because
reflect inacceptable, out of ordinary status of the instrument; not needed
for science
YES
YES
YES
NO
“scored red” but show only slight/acceptable departure from thresholds; useful for science
NO
NO
NO
NO
“scored red” but can still be useful for science; calibrations cannot
be replaced
NO
but open ticket to USD
NO
NO
NO
“scored red” but still useful;
new, good
set was re-taken
YES
YES
NO
NO
“scored red”,
but may still be useful
(e.g. IR
twilight flats sampling too narrow dynamic range)
YES
YES
NO
YES
pipeline
failed but data fine,
usable
for science (e.g. recipe cannot handle
instr. setup, incomplete template)
YES
NO
YES
pipeline failed,
data fine but not
usable
for
science (e.g. incomplete template)
YES
YES
YESSlide3
FOOTNOTES:Hiding of the raw frames in the Archive should be exception and not a habit. The assumption is that Paranal
delivers mainly good data.