5. Tips and Tricks
This is a collection of tips and tricks that can be useful for reducing different data, or to do it slightly differently from what is presented in the example.
5.1. Getting Bad Pixel Masks from the archive
Starting with DRAGONS v3.1, the static bad pixel masks (BPMs) are now handled as calibrations. They are downloadable from the archive instead of being packaged with the software. There are various ways to get the BPMs.
Note that at this time there no static BPMs for Flamingos-2 data.
5.1.1. Manual search
Ideally, the BPMs will show up in the list of associated calibrations, the “Load Associated Calibration” tab on the archive search form (next section). This will happen of all new data. For old data, until we fix an issue recently discovered, they will not show up as associated calibration. But they are there and can easily be found.
On the archive search form, set the “Instrument” to match your data, set the “Obs.Type” to “BPM”, if relevant for the instrument, set the “Binning”. Hit “Search” and the list of BPMs will show up as illustrated in the figure below.
The date in the BPM file name is a “Valid-from” date. It is valid for data taken on or after that date. Find the one most recent BPM that is valid for your date and download (click on “D”) it. Then follow the instructions found in the tutorial examples.
5.1.2. Associated calibrations
The BPMs are now handled like other calibrations. This means that they are also downloaded from the archive. From the archive search form, once you have identified your science data, select the “Load Associated Calibrations” (which turns to “View Calibrations” once the table is loaded). The BPM will show up with the green background.
This will be the case for new data (from late March 2023). For old data, until we fix an issue recently discovered, they will not show up as associated calibration and you will have to find them manual as explained in the previous section, Manual search. We understand the issue and are working on a fix.
5.1.3. Calibration service
The calibration service in DRAGONS 3.1 adds several new features. One of them is the ability to search multiple databases in a serial way, including online database, like the Gemini archive.
The system will look first in your local database for processed calibration
and BPMs. If it does not find anything that matches, it will look in the
next database. To activate this feature, in ~/.dragons/, create or edit
the configuration file dragonsrc as follows:
[calibs]
databases = ${path_to_my_data}/niriimg_tutorial/playground/cal_manager.db get store
https://archive.gemini.edu get
If you know that you will be connected to the internet when you reduce the data, you do not need to pre-download the BPM, DRAGONS will find it for you in the archive.
If you want to pre-download the BPM without having to search for it, like in the previous two sections, you can let DRAGONS find it and download it for you:
$ reduce -r getBPM <file_for_which_you_need_bpm>
$ caldb add calibrations/processed_bpm/<the_bpm>
5.2. Bypassing automatic calibration association
We can think of two reasons why a user might want to bypass the calibration manager and the automatic processed calibration association. The first is to override the automatic selection, to force the use of a different processed calibration than what the system finds. The second is if there is a problem with the calibration manager and it is not working for some reason.
Whatever the specific situation, the following syntax can be used to bypass the calibration manager and set the input processed calibration yourself:
$ reduce @target.lis --user_cal processed_dark:N20160102S0423_dark.fits processed_flat:N20160102S0373_flat.fits
The list of recognized processed calibration is:
processed_arc
processed_bias
processed_dark
processed_flat
processed_fringe
processed_standard