trusty (7) kmo_flat.7.gz

Provided by: cpl-plugin-kmos-doc_1.2.8+dfsg-2_all bug

NAME

       kmo_flat - Create master flatfield frame and badpixel map to be used during science reduction

SYNOPSIS

       esorex kmo_flat [OPTIONS] FILE.sof

DESCRIPTION

       This  recipe  creates the master flat field and calibration frames needed for spatial calibration for all
       three detectors. It must  be  called  after  the  kmo_dark-recipe,  which  generates  a  bad  pixel  mask
       (badpixel_dark.fits). The bad pixel mask will be updated in this recipe (goes into badpixel_flat.fits).

       As  input  at  least  3  dark  frames,  3  frames with the flat lamp on are recommen- ded. Additionally a
       badpixel mask from kmo_dark is required.

       The badpixel mask contains 0 for bad pixels and 1 for good ones.

       The structure of the resulting xcal and ycal frames is quite complex since the arrangement  of  the  IFUs
       isn´t  just linear on the detector. Basically the inte- ger part of the calibration data shows the offset
       of each pixels centre in mas (Milli arcsec) from the field centre. The  viewing  of  an  IFU  is  2800mas
       (14pix*0.2arcsec/pix).  So  the  values  in  these two frames will vary between +/-1500 (One would expect
       1400, but since the slitlets aren´t expected to be exactly vertical, the values can even go up to  around
       1500).  Additionally  in  the calibration data in y-direction the decimal part of the data designates the
       IFU to which the slitlet corresponds to (for each detector from 1 to 8).

       Because of the irregular arrangement of the IFUs not all x-direction calibra- tion data is found in  xcal
       and similarly not all y-direction calibration data is located in ycal. For certain IFUs they are switched
       and/or flipped in x- or y-direction: For IFUs 1,2,3,4,13,14,15,16:      x- and y- data  is  switched  For
       IFUs  17,18,19,20:            y-data  is flipped For IFUs 21,22,23,24:              x-data is flipped For
       IFUs 5,6,7,8,9,10,11,12:      x- and y- data is switched and x- and
                                             y- data is flipped

       Furthermore frames can be provided for several rotator angles. In this  case  the  resulting  calibration
       frames for each detector are repeatedly saved as extension for every angle.

       Advanced features: ------------------ To create the badpixel mask the edges of all slitlets are fitted to
       a polyno- mial. Since it can happen that some of these fits (3 detectors * 8 IFUs * 14slitlets * 2  edges
       (left  and  right  edge  of  slitlet)= 672 edges) fail, the fit parameters are themselves fitted again to
       detect any outliers. By default the parameters of all left and all right edges are  grouped  individually
       and  then  fitted  using  chebyshev  polynomials.  The  advantage of a chebyshev polyno- mial is, that it
       consists in fact of a series  of  orthogonal  polynomials.  This  implies  that  the  parameters  of  the
       polynomials  are  independent.  This fact pre- destines the use of chebyshev polynomials for our case. So
       each individual pa- rameter can be examined independently. The reason why the left and  right  edges  are
       fitted  individually  is that there is a systematic pattern specific to these groups. The reason for this
       pattern is probably to be found in the opti- cal path the light is traversing.

       The behaviour of this fitting step can be influenced via environment parameters: *  KF_ALLPARS  (default:
       1)
         When set to 1 all coefficients of the polynomial of an edge are to be cor-
         rected, also when just one of these coefficients is an outlier. When set to
         0 only the outlier is to be corrected.

       * KF_CH (default: 1)
         When set to 1 chebyshev polynomials are used to fit the fitted parameters.

         When set to 0 normal polynomials are used.

       * KF_SIDES (default: 2)
         This variable can either be set to 1 or 2. When set to 2 the left and right
         edges are examined individually. When set to 1 all edges are examined as one
         group.

       * KF_FACTOR(default: 4)
         This factor defines the threshold factor. All parameters deviating
         KF_FACTOR*stddev are to be corrected

   BASIC PARAMETERS
       --badpix_thresh  The  threshold  level  to  mark  pixels  as  bad  on  the  dark  subtracted  frames  [%]
       --surrounding_pixels The amount of bad pixels to surround a specific pixel, to let it be  marked  bad  as
       well.

       --cmethod Following methods of frame combination are available:
          * ´ksigma´ (Default)
          An iterative sigma clipping. For each position all pixels in the spectrum
          are examined. If they deviate significantly, they will be rejected according
          to the conditions:
              val > mean + stdev * cpos_rej
          and
              val < mean - stdev * cneg_rej
          where --cpos_rej, --cneg_rej and --citer are the corresponding configuration
          parameters. In the first iteration median and percentile level are used.

          * ´median´
          At each pixel position the median is calculated.

          * ´average´
          At each pixel position the average is calculated.

          * ´sum´
          At each pixel position the sum is calculated.

          * ´min_max´
          The specified number of minimum and maximum pixel values will be rejected.

          --cmax and --cmin apply to this method.

   ADVANCED PARAMETERS
       --cpos_rej --cneg_rej --citer see --cmethod=´ksigma´

       --cmax --cmin see --cmethod=´min_max´

       --suppress_extension  If  set  to  TRUE,  the  arbitrary  filename  extensions are supressed. If multiple
       products with the same category are produced, they will be numered consecutively starting from 0.

         Input files:

          DO                    KMOS
          category              Type   Explanation                    Required #Frames
          --------              -----  -----------                    -------- -------
          FLAT_ON               RAW    Flatlamp-on exposures             Y       1-n
                                       (at least 3 frames recommended)
          FLAT_OFF              RAW    Flatlamp-off exposures            Y       1-n
                                       (at least 3 frames recommended)
          BADPIXEL_DARK         B2D    Bad pixel mask                    Y        1

         Output files:

          DO                    KMOS
          category              Type   Explanation
          --------              -----  -----------
          MASTER_FLAT           F2D    Normalised flat field
                                       (6 extensions: alternating data & noise
          BADPIXEL_FLAT         B2D    Updated bad pixel mask (3 Extensions)
          XCAL                  F2D    Calibration frame 1 (3 Extensions)
          YCAL                  F2D    Calibration frame 2 (3 Extensions)
          FLAT_EDGE             F2L    Frame containing parameters of fitted
                                       slitlets of all IFUs of all detectors

OPTIONS

       --badpix_thresh <long>
              The threshold level to mark pixels as bad on the dark subtracted frames [%]. (long; default:  35).
              The  full  name  of  this  option for the EsoRex configuration file is kmos.kmo_flat.badpix_thresh
              [default = 35].

       --surrounding_pixels <long>
              The amount of bad pixels to surround a specific pixel, to let it be marked  bad  as  well.  (long;
              default:   5).   The   full   name   of   this   option  for  the  EsoRex  configuration  file  is
              kmos.kmo_flat.surrounding_pixels [default = 5].

       --suppress_extension <bool>
              Suppress arbitrary filename extension.(TRUE (apply) or FALSE (don´t apply) (bool; default: False).
              The full name of this option for the EsoRex configuration file is kmos.kmo_flat.suppress_extension
              [default = False].

       --cmethod <str>
              Either apply "average", "median", "sum", "min_max." or "ksigma".  (str;  default:  ´ksigma´).  The
              full  name  of  this  option for the EsoRex configuration file is kmos.kmo_flat.cmethod [default =
              ksigma].

       --cpos_rej <float>
              The positive rejection threshold for kappa-sigma-clipping (sigma).   (float;  default:  3.0).  The
              full  name  of  this option for the EsoRex configuration file is kmos.kmo_flat.cpos_rej [default =
              3.0].

       --cneg_rej <float>
              The negative rejection threshold for kappa-sigma-clipping (sigma).   (float;  default:  3.0).  The
              full  name  of  this option for the EsoRex configuration file is kmos.kmo_flat.cneg_rej [default =
              3.0].

       --citer <long>
              The number of iterations for kappa-sigma-clipping. (long; default:  3).  The  full  name  of  this
              option for the EsoRex configuration file is kmos.kmo_flat.citer [default = 3].

       --cmax <long>
              The  number  of  maximum pixel values to clip with min/max-clipping.  (long; default: 1). The full
              name of this option for the EsoRex configuration file is kmos.kmo_flat.cmax [default = 1].

       --cmin <long>
              The number of minimum pixel values to clip with min/max-clipping.  (long; default:  1).  The  full
              name of this option for the EsoRex configuration file is kmos.kmo_flat.cmin [default = 1].

       Note  that  it  is  possible to create a configuration file containing these options, along with suitable
       default values. Please refer to the details provided by the 'esorex --help' command.

SEE ALSO

       The full documentation for the kmos pipeline can be downloaded as a PDF file using the following URL:

              ftp://ftp.eso.org/pub/dfs/pipelines/kmos/kmos-pipeline-manual-2.9.pdf

       An   overview   over   the   existing   ESO   pipelines    can    be    found    on    the    web    page
       http://www.eso.org/sci/software/pipelines/.

       Basic documentation about the EsoRex program can be found at the esorex (1) man page.

       It   is   possible   to   call   the   pipelines   from   python   using  the  python-cpl  package.   See
       http://packages.python.org/python-cpl/index.html for further information.

       The  other  recipes  of  the  kmos  pipeline  are   kmo_dev_setup(7),   kmo_copy(7),   kmo_fits_check(7),
       kmo_sci_red(7),      kmo_illumination(7),     kmo_fits_stack(7),     kmo_noise_map(7),     kmo_rotate(7),
       kmo_extract_spec(7), kmo_multi_reconstruct(7), kmo_stats(7), kmo_shift(7), kmo_wave_cal(7),  kmo_dark(7),
       kmo_arithmetic(7),    kmo_std_star(7),   kmo_fits_strip(7),   kmo_combine(7),   kmo_illumination_flat(7),
       kmo_make_image(7), kmo_sky_tweak(7), kmo_fit_profile(7), kmo_sky_mask(7), kmo_reconstruct(7)

VERSION

       kmo_flat 1.2.8

AUTHOR

       Alex Agudo Berbel <kmos-spark@mpe.mpg.de>

BUG REPORTS

       Please report any problems to kmos-spark@mpe.mpg.de. Alternatively, you may send a report to the ESO User
       Support Department <usd-help@eso.org>.

LICENSE

       This file is part of the KMOS Instrument Pipeline Copyright (C) 2002,2003 European Southern Observatory

       This  program  is  free  software;  you  can  redistribute it and/or modify it under the terms of the GNU
       General Public License as published by the Free Software Foundation; either version 2 of the License,  or
       (at your option) any later version.

       This  program  is  distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even
       the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the GNU General  Public
       License for more details.

       You  should have received a copy of the GNU General Public License along with this program; if not, write
       to the Free Software Foundation, 51 Franklin Street, Suite 500, Boston, MA  02110-1335  USA