1. Standard Imaging pipeline specification

1.1. Association Diagram

generated/associationmatrix.png

1.2. MICADO Dataitems

Summary of all Raw Instrument Data observed in imaging mode.

|DPR keywords

Name

Description

CATG

TECH

TYPE

DO.CATG

I_DARK_RAW

Detector exposure without illumination (via block in pupil filter wheel and field restrictor).

CALIB

IMAGE,SI

DARK

RAW_DARK

I_FLAT_RAW

Raw exposure using the flatfield lamp in imaging mode.

CALIB

IMAGE,SI

FLAT,LAMP

RAW_OPT_FLAT

I_NONLIN_RAW

Raw exposure using the flatfield lamp in imaging mode for non-linearity correction.

CALIB

IMAGE,SI

NONLIN,LAMP

RAW_OPT_NONLIN

I_ILLUM_RAW

Raw Science data for Illumination correction.

CALIB

IMAGE,SI

STD,ILLUM

RAW_OPT_SKY_ILLUM

I_STDFIELD_RAW

Raw data for Photometric Zerpoint determination.

CALIB

IMAGE,SI

STD,PHOTOM

RAW_OPT_SKY_STDFIELD

I_BKGFIELD_RAW

Raw data for background determination.

CALIB

IMAGE,AI

OBJECT,BCKGRND

RAW_OPT_SKY_BKGFIELD

I_SCI_RAW

Raw on-sky exposure.

SCIENCE

IMAGE,SI

OBJECT,SKY

RAW_OPT_SKY_SKYSIAI_SCIENCE

I_SCI_CORO_WAFFLE_RAW

Focal plane image of bright star with waffle pattern added.

SCIENCE

CORONOGRAPHY,WAFFLE

OBJECT

RAW_OPT_SKY_SKYHCI_CORO_SCIENCECOROWAFFLE

I_CORO_OFFSET_RAW

Image on bright point source with coronagraph in place. Star must be offset from coronagraph.

CALIB

CORONOGRAPHY

STAR

RAW_OPT_SKY_SKYHCI_CORO_COROOFFSET

I_SCI_CORO_PUPIL_RAW

Pupil plane mask HCI image.

SCIENCE

CORONOGRAPHY

PUPIL

RAW_OPT_SKY_SKYHCI_CORO_SCIENCECOROPUPIL

I_CORO_BGD_RAW

Background sky image for the science images (and online processing).

CALIB

CORONOGRAPHY

BACKGROUND

RAW_OPT_SKY_SKYHCI_CORO_COROBACKGROUND

I_SCI_AI_RAW

Raw on-sky exposure for astrometric imaging.

SCIENCE

IMAGE,AI

OBJECT,SKY

RAW_OPT_SKY_SKYSIAI_SCIENCEAI

I_WAM_RAW

Raw warm astrometric mask data for distortion determination.

CALIB

IMAGE,AI

PINHOLE,WAM

RAW_OPT_WAMCAM_WAM

I_CAM_RAW

Raw cold astrometric mask data for distortion determination. Not used in the automatic pipeline.

CALIB

IMAGE,AI

PINHOLE,CAM

RAW_OPT_WAMCAM_CAM

I_ASTROMFIELD_RAW

Raw data for distortion determination.

CALIB

IMAGE,SI

STD,ASTROMETRY

RAW_OPT_SKY_ASTROMFIELD

Summary of all External DataItems for imaging.

|PRO keywords

Name

Description

DO.CATG

REF_I_ASTROM_CAT

Catalog with (ra,dec) of on-sky astrometric reference standards. Input surveys: Gaia and Euclid.

CAT_DISTORTIONREF_ASTROMREF

REF_I_PHOTOM_CAT

Catalog with magnitudes of a photometric reference standards in a series of filters. Input surveys: JWST, Euclid YJH, VISTA surveys. Such catalogs are input for determination of zeropoints and/or illumination correction.

CAT_PHOTOMREF

REF_I_WAM_CAT

Catalog with reference positions of the warm astrometric mask pinholes.

CAT_DISTORTIONREF_WAMREF

Summary of all Intermediate and Final Data for imaging.

|PRO keywords

Name

Description

DO.CATG

I_ASTROM_HDR

Astrometric solution. One per detector.

HDR_ASTROM

I_BGD_IMG

Background per detector.

IMG_BACKGROUND

I_MASTER_DARK_IMG

MasterDark calibration image.

IMG_MASTERDARK

I_MASTER_FLAT_IMG

Flatfield image obtained by combining a series of internal flatfield lamp observations.

IMG_MASTERFLAT

I_DT_SCI_SI_IMG

Image which has been corrected for instrumental effects, not background subtracted.

IMG_FNL_CATALOGABLE_DT_DTSIAI_DT

I_DTFNL_SCI_IMG

Image which has been corrected for instrumental effects, and background subtracted.

IMG_FNL_CATALOGABLE_DTFNL_DTFNLSIAI_DTFNL

I_ILLUM_CORR_HDR

Table with the coefficients of the polynomial describing the large-scale variation in the illumination by the flatfield lamp, and gain (e-/ADU), which is a single number per detector.

HDR_STATICTABLE_ILLUMCORR

I_PERSISTENCE_IMG

Persistence image.

IMG_PERSISTENCE

I_PHOTOM_HDR

Zeropoint and extinction coefficient, one pair per detector.

HDR_PHOTOM

I_SCI_STACK_IMG

Coaddition of calibrated images.

IMG_STACK

I_DT_SCI_CORO_WAFFLE_IMG

Waffle image which has been corrected for instrumental effects for HCI, and background subtracted.

IMG_FNL_CATALOGABLE_DT_DTHCI_DTWAFFLE

I_DT_SCI_CORO_PUPIL_IMG

Pupil image which has been corrected for instrumental effects for HCI, and background subtracted.

IMG_FNL_CATALOGABLE_DT_DTHCI_DTPUPIL

I_STARCENTER_WAFFLE_HDR

Table with the star center during the OB on the detector. The position is in pixel units in the Pixel Grid Coordinate System. Derived from waffle pattern.

HDR_STARCENTER_STARCENTERWAFFLE

I_STARCENTER_PUPIL_HDR

Table with the star center during the OB on the detector. The position is in pixel units in the Pixel Grid Coordinate System.

HDR_STARCENTER_STARCENTERPUPIL

1.3. MICADO Pipeline

1.4. MICADO Recipes

1.4.1. I_PERSISTENCE_IMG

Purpose:

null

Algorithm and workflow:

null

Name

Persistence

ReqID

None

Parent ReqID

None

Objective

Determine the persistence correction for an exposure.

Responsible

ESO

Phase

N/A

MICADO Set-up

N/A

Calibration Unit setup

N/A

Observing Template

N/A

Template parameters

N/A

Frequency

N/A

Duration estimate [s]

N/A

Prerequisites

N/A

Recipe frequency

Once for each exposure. (Possibly batched.)

Input data

RAW_

Output products

I_PERSISTENCE_IMG

QC parameters

None

DRL Recipe ID

micado_det_persistence

Procedure

Use the HDRL routine developed by Mark Neeser.

Mathematical description

See proposal by Mark Neeser.

Remarks

Currently under development by ESO. This recipe will be primarily be ran by ESO since it requires all previous data (up till a certain time in the past), including proprietary data. It can also be ran by users after the proprietary period is over.

Accuracy

Measurement uncertainty 10%. Systematic error 10%.

generated/Persistence.png

Workflow diagram for I_PERSISTENCE_IMG

1.4.2. I_MASTER_DARK_IMG

Purpose:

Darks will be used for the dark current correction and requires the same exposure time as the science data. Thus, these frames have to be taken on daily basis, but during day time.

Algorithm and workflow:

The observation template MCD_img_cal_dark provides N dark frames, which are median or mean combined to create the MASTERDARK_IMG frame. The input frames have to be taken with the same exposure time as the SCIENCE exposures.

Name

Master Dark

ReqID

DPS-masterdark

Parent ReqID

R-MCD-100

Objective

Determine the dark current and flag hot pixels.

Responsible

Science Operations

Phase

Daytime

MICADO Set-up

    1. Ensure calibration Unit off

    1. Set wheel with blocking filter in right position

    1. Take 5 exposures

  1. Repeat for 3 detector usage modes and for 5 pre-defined exposure times.

Calibration Unit setup

Not active

Observing Template

MICADO_img_cal_dark

Template parameters

INS.MODE, INS.READMODE, DET.DIT, DET.NDIT, INSTRUME

Frequency

daily

Duration estimate [s]

4654

Prerequisites

None

Recipe frequency

Once per Observing Block with dark frames.

Input data

I_DARK_RAW_

Output products

I_MASTER_DARK_IMG

QC parameters

QC DARKMEAN, QC DARKMED, QC DARKSTD, QC NPIXSAT, QC FPIXSAT

DRL Recipe ID

micado_det_dark

Procedure

Median filtering of the input exposures; hdrl_imagelist_collapse with median filtering will be used. Pixels above PAR{THRESH_UPLIM_DARK} in all input darks are flagged as hot pixels.

Mathematical description

hdrl_imagelist_collapse with median filtering will be used.

Remarks

It is expected that dark current is independent of read option. Baseline is to limit all science exposures to a finite set of exposure times. This ensures the darks, with the same finite set of exposure times, can be taken before a night instead of following it: mitigates persistence in the raw darks.

Accuracy

Dark current measurement uncertainty 10%. Systematic error 10% as inferred from simulated data. 90% hot pixels flagged.

generated/MasterDark.png

Workflow diagram for I_MASTER_DARK_IMG

1.4.3. I_MASTER_FLAT_IMG

Purpose:

Algorithm and workflow:

Name

Master Flat

ReqID

DPS-flatfield

Parent ReqID

R-MCD-100

Objective

Determine pixelsensitivity variation at scale of few pixels and flag cold pixels.

Responsible

Science Operations

Phase

Daytime

MICADO Set-up

  • Set observing mode to standard imaging

  • Set ADC + wheel into right position

  • Put flatfield lamp in Calibration Unit into optical path

  • Set detector readout mode to TLI

  • Do 5 flatfield exposures with identical exposure time

  • Repeat for Y, J, H and K

Calibration Unit setup

Flat field lamp ON

Observing Template

MICADO_img_cal_flat

Template parameters

INS.MODE, INS.FILT1.NAME, INS.FILT2.NAME, INS.OPTI6.NAME, INS.DROT, INS.READMODE, DET.DIT, DET.NDIT, INSTRUME

Frequency

daily

Duration estimate [s]

254

Prerequisites

Normal instrumental conditions.

Recipe frequency

Once per Observing Block with flat frames.

Input data

I_FLAT_RAW_, I_NONLINEARITY_IMG_, I_MASTER_DARK_IMG

Output products

I_MASTER_FLAT_IMG

QC parameters

QC FLATMEAN, QC FLATMED, QC FLATSTD, QC NPIXHOT, QC FPIXHOT

DRL Recipe ID

micado_img_flat

Procedure

Subtraction of additive components followed by median/mean filtering of the input exposures. Pixels below PAR{THRESH_LOWLIM_FLAT} in all input flats are flagged as cold pixels.

Mathematical description

hdrl_imagelist_collapse with median filtering will be used.

Remarks

None

Accuracy

0.5% precision on pixel sensitivity, validated on simulated data. 90% cold pixels flagged.

generated/MasterFlat.png

Workflow diagram for I_MASTER_FLAT_IMG

1.4.4. I_DT_SCI_SI_IMG

Purpose:

null

Algorithm and workflow:

null

Name

First Detrend exposure step

ReqID

DPS-3120-SCI

Parent ReqID

[R-MCD-130]D/ /I/ ; [I-INS/ELT-203] / / / ; [R-INS-928] / /I/T

Objective

Apply to a raw exposure pixels the additive and multiplicative factors to correct for detector instrumental fingerprint.

Responsible

User

Phase

N/A

MICADO Set-up

N/A

Calibration Unit setup

N/A

Observing Template

N/A

Template parameters

N/A

Frequency

N/A

Duration estimate [s]

N/A

Prerequisites

N/A

Recipe frequency

Once for each OB with raw science (and potentially offset sky) exposures.

Input data

I_SCI_RAW_, I_NONLINEARITY_IMG_, I_MASTER_DARK_IMG, I_PERSISTENCE_IMG, I_MASTER_FLAT_IMG

Output products

I_DT_SCI_SI_IMG

QC parameters

QC DETSMEAN, QC DETSMED, QC DETSSTD, QC DETRENCR, QC NPIXNONL, QC FPIXNONL

DRL Recipe ID

micado_img_detrend

Procedure

See individual steps.

Mathematical description

See individual steps.

Remarks

None

Accuracy

TODO

generated/Detrend.png

Workflow diagram for I_DT_SCI_SI_IMG

1.4.5. I_BGD_IMG

Purpose:

null

Algorithm and workflow:

null

Name

Background

ReqID

None

Parent ReqID

None

Objective

Determine the background of all exposures in an observation. Created either from a background field observation offset from the science observation, or directly from the science observation itself.

Responsible

User

Phase

Nighttime

MICADO Set-up

  • Acquire on-sky background field, near science field

  • Otherwise identical to corresponding Science observation

Calibration Unit setup

Not active.

Observing Template

MICADO_img_obs[bg]

Template parameters

INS.MODE, INS.READMODE, DET.DIT, DET.NDIT, INSTRUME

Frequency

For each science observation that cannot be used for background determination.

Duration estimate [s]

varying

Prerequisites

Photometric conditions. Input products imply the recipes that must run prior to this recipe.

Recipe frequency

Once for each OB with raw science or bkgfield exposures.

Input data

I_DT_BKGFIELD_IMG_

Output products

I_BGD_IMG

QC parameters

QC BACKGROUNDMEANn, QC BACKGROUNDMEDn, QC BACKGROUNDSTDn

DRL Recipe ID

micado_img_background

Procedure

Derive background for each frame from all exposures. hdrl_collapse_imagelist_to_image_sigclip will be used.

Mathematical description

TODO

Remarks

None

Accuracy

TODO

generated/Background.png

Workflow diagram for I_BGD_IMG

1.4.6. I_ILLUM_CORR_HDR

Purpose:

null

Algorithm and workflow:

null

Name

Flatlamp illumination correction

ReqID

DPS-illumcorr

Parent ReqID

R-MCD-100

Objective

Determine spatial variation in illumination by flatlamp over detector array

Responsible

Science Operations

Phase

Nighttime

MICADO Set-up

  • Acquire LMC Reference Field

  • Do 3 dithered exposures.

  • Repeat for Y, J, H and K filter.

  • Repeat for high and low resolution imager.

Calibration Unit setup

Not active.

Observing Template

MICADO_img_tec_illum

Template parameters

INS.MODE, INS.READMODE, DET.DIT, DET.NDIT, INSTRUME

Frequency

During commissioning and after each instrument intervention.

Duration estimate [s]

2050

Prerequisites

Photometric observing conditions.

Recipe frequency

Once after each instrument intervention.

Input data

I_DT_ILLUM_IMG_, I_BGD_IMG, REF_I_PHOTOM_CAT_

Output products

I_ILLUM_CORR_HDR

QC parameters

QC ILLUNMAT, QC ILLSNRMD

DRL Recipe ID

micado_img_illum

Procedure

Use a “MICADO Photometric Reference Field” for which a catalog of at least relative stellar fluxes with sufficiently dense stellar distribution already exists. Such a catalog could be established through external data (e.g., JWST, Euclid and/or Gaia) or a one-time dedicated programme with MICADO (e.g., during commissioning). With that catalog in hand, single exposures of that field suffice to monitor variation in the illumination variation. The determination of the IllumMap is then a fit to stellar flux measurements. Whether a parametric fit suffices (e.g., polynomial of degree N) depends on the complexity of illumination variation.

Mathematical description

The algorithm from by href{https://doi.org/10.1007/s10686-011-9266-x}{McFarland, Verdoes-Kleijn, Sikkema, et al. Exp Astron 35, 45-78 (2013)}.

Remarks

These observations are on the Large Magellanic Cloud Reference Field (described in Section~ref{sec:photometricreferencestars}). The reference magnitudes have accuracies of 1% or better. This calibration task assumes a polynomial behavior of the illumination variation.

Accuracy

Measurement precision of 1% and accuracy of 10% on value of illumination variation value over full FoV. So if true illumination variation is 20% we want an accuracy of 20% +/-2%.

generated/IllumCorr.png

Workflow diagram for I_ILLUM_CORR_HDR

1.4.7. I_DTFNL_SCI_IMG

Purpose:

null

Algorithm and workflow:

null

Name

Final Detrend exposure step

ReqID

None

Parent ReqID

None

Objective

Subtract background and apply illumination correction.

Responsible

User

Phase

N/A

MICADO Set-up

N/A

Calibration Unit setup

N/A

Observing Template

N/A

Template parameters

N/A

Frequency

N/A

Duration estimate [s]

N/A

Prerequisites

N/A

Recipe frequency

Once for each OB with raw science exposures.

Input data

I_DT_SCI_SI_IMG, I_BGD_IMG, I_ILLUM_CORR_HDR

Output products

I_DTFNL_SCI_IMG

QC parameters

None

DRL Recipe ID

micado_img_detrend_final

Procedure

See individual steps.

Mathematical description

See individual steps.

Remarks

None

Accuracy

TODO

generated/DetrendFinal.png

Workflow diagram for I_DTFNL_SCI_IMG

1.4.8. I_ASTROM_HDR

Purpose:

This recipe requires as input several data items representing the instrumental geometric distortions. The recipes that create these data items are described in the Astrometric Imaging section.

Algorithm and workflow:

null

Name

Astrometric solution

ReqID

DPS-3140-SCI

Parent ReqID

[R-MCD-116] /A/ /T ; [I-INS/ELT-101] / / /

Objective

Determine a polynomial function that maps pixel coordinates (x,y) into (RA,Dec).

Responsible

User

Phase

MICADO Set-up

None

Calibration Unit setup

None

Observing Template

MCD_img_obs_siai_base

Template parameters

INS.MODE, OBS.RA, OBS.DEC, INS.FILT1.NAME, INS.FILT2.NAME, INS.OPTI6.NAME, INS.DROT, INS.READMODE, DET.DIT, DET.NDIT, INSTRUME

Frequency

None

Duration estimate [s]

None

Prerequisites

None

Recipe frequency

Once for each detrended science exposure.

Input data

I_DTFNL_SIAI_IMG_, I_DISTORTION_WAM_HDR_, I_DISTORTION_ELT_HDR_, REF_I_ASTROM_CAT_

Output products

I_ASTROM_HDR

QC parameters

QC DCRVALn, QC DCRVALn, QC RMSDRA, QC RMSDDEC

DRL Recipe ID

micado_img_astrom

Procedure

Plan to use procedure similar to SCAMP (Bertin 2006: ASP Conference Series, Vol. 351, 2006), HAWK-I, and VIKING.

Mathematical description

TODO: choose from SCAMP, HAWK-I and VIKING, e.g. SCAMP (Bertin 2006: ASP Conference Series, Vol. 351, 2006, https://www.astromatic.net/software/scamp). Add to recipe steps: differential atmospheric refraction computation available in HDRL.

Remarks

The plan is to use Gaia and Euclid catalogs to construct the astrometric reference catalog (ASTROMREF_CAT).

Accuracy

TODO

generated/Astrom.png

Workflow diagram for I_ASTROM_HDR

1.4.9. I_PHOTOM_STDFIELD_HDR

Purpose:

null

Algorithm and workflow:

null

Name

Photometric solution

ReqID

DPS-photomstandardfield

Parent ReqID

R-MCD-100

Objective

Determine the scalar zeropoint that converts fluxes (in units of ADUs) into magnitudes at the top of the atmosphere.

Responsible

User

Phase

Nighttime

MICADO Set-up

  • Acquire on-sky photometric standard field

  • Other settings identical to corresponding science observation

Calibration Unit setup

Not active.

Observing Template

MICADO_img_cal_zeropoint

Template parameters

INS.MODE, OBS.RA, OBS.DEC, INS.FILT1.NAME, INS.FILT2.NAME, INS.OPTI6.NAME, INS.DROT, INS.READMODE, DET.DIT, DET.NDIT, INSTRUME

Frequency

The User decides whether this Observing Block is added to its phase 2 set to derive the zeropoint independent from the science observations. By default the zeropoint is determined using reference stars inside the science images.

Duration estimate [s]

247 (for 1 filter)

Prerequisites

Photometric conditions.

Recipe frequency

Once per exposure of a photometric reference field.

Input data

I_DTFNL_STDFIELD_IMG_, I_ASTROM_HDR, REF_I_PHOTOM_CAT_

Output products

I_PHOTOM_STDFIELD_HDR

QC parameters

QC ZPTSTDi, QC NMATCHi

DRL Recipe ID

micado_img_photom

Procedure

Procedure planned to be similar as used for HAWK-I (see ftp://ftp.eso.org/pub/dfs/pipelines/hawki/hawki-pipeline-manual-2.4.3.pdf) Include as recipe steps (i) object catalog production available in HDRL, (ii) Strehl ratio computation available in HDRL, (iii) airmass computation available in HDRL.

Mathematical description

Algorithm planned to be similar as used for HAWK-I (see ftp://ftp.eso.org/pub/dfs/pipelines/hawki/hawki-pipeline-manual-2.4.3.pdf)

Remarks

PHOTOMSTDFIELD_HDR contains zeropoint and extinction coefficient, one pair per detector. No user defined parameters by default. User can manually optimize source extraction parameters (e.g., aperture, SNR threshold reference sources).

Accuracy

1% measurement precision, 5% accuracy

generated/PhotomStdfield.png

Workflow diagram for I_PHOTOM_STDFIELD_HDR

1.4.10. I_SCI_CALIBRATED_IMG

Purpose:

null

Algorithm and workflow:

null

Name

Apply photom and astrom solution

ReqID

DPS-3160-SCI

Parent ReqID

R-INS-928] / /I/T

Objective

Apply the photometric and astrometric solution for exposures to the pixels.

Responsible

User

Phase

MICADO Set-up

None

Calibration Unit setup

None

Observing Template

MCD_img_obs_siai_base

Template parameters

INS.MODE, OBS.RA, OBS.DEC, INS.FILT1.NAME, INS.FILT2.NAME, INS.OPTI6.NAME, INS.DROT, INS.READMODE, DET.DIT, DET.NDIT, INSTRUME

Frequency

None

Duration estimate [s]

None

Prerequisites

None

Recipe frequency

Once per Observing Block

Input data

I_DTFNL_SIAI_IMG_, I_ASTROM_HDR, I_PHOTOM_HDR_

Output products

I_SCI_CALIBRATED_IMG

QC parameters

QC CALIMEAi, QC CALISTDi

DRL Recipe ID

micado_img_calibrate

Procedure

Procedure planned to be similar as used for HAWK-I (see Section 6.6 of ftp://ftp.eso.org/pub/dfs/pipelines/hawki/hawki-pipeline-manual-2.4.3.pdf)

Mathematical description

Algorithm planned to be similar as used for HAWK-I (see Section 6.6 of ftp://ftp.eso.org/pub/dfs/pipelines/hawki/hawki-pipeline-manual-2.4.3.pdf)

Remarks

None

Accuracy

TODO

generated/Calibrated.png

Workflow diagram for I_SCI_CALIBRATED_IMG

1.4.11. I_SCI_STACK_IMG

Purpose:

null

Algorithm and workflow:

null

Name

Stack

ReqID

None

Parent ReqID

None

Objective

Combine calibrated exposures into one stack.

Responsible

User

Phase

MICADO Set-up

None

Calibration Unit setup

None

Observing Template

MCD_img_obs_siai_base

Template parameters

INS.MODE, OBS.RA, OBS.DEC, INS.FILT1.NAME, INS.FILT2.NAME, INS.OPTI6.NAME, INS.DROT, INS.READMODE, DET.DIT, DET.NDIT, INSTRUME

Frequency

None

Duration estimate [s]

None

Prerequisites

None

Recipe frequency

Once per Observing Block

Input data

I_SCI_CALIBRATED_IMG

Output products

I_SCI_STACK_IMG

QC parameters

QC STACKMEANn, QC STACKSTDn, QC STACKMEDn

DRL Recipe ID

micado_img_stack

Procedure

Procedure planned to be similar as used for HAWK-I (see Section 6.6 of ftp://ftp.eso.org/pub/dfs/pipelines/hawki/hawki-pipeline-manual-2.4.3.pdf)

Mathematical description

Algorithm planned to be similar as used for HAWK-I (see Section 6.6 of ftp://ftp.eso.org/pub/dfs/pipelines/hawki/hawki-pipeline-manual-2.4.3.pdf)

Remarks

TODO: User defined parameters: Projection point for stack. For stacking: weighting scheme in coaddition.

Accuracy

TODO

generated/Stack.png

Workflow diagram for I_SCI_STACK_IMG

1.4.12. I_DT_CORO_OFFSET_IMG

Purpose:

null

Algorithm and workflow:

null

Name

Detrend high-contrast off-axis exposure

ReqID

DPS-3130-SCI

Parent ReqID

R-MCD-120]D/ /I/

Objective

Apply to a raw exposure pixels observed in high-contrast imaging mode the additive and multiplicative factors to correct for detector instrumental fingerprint.

Responsible

User

Phase

Nighttime

MICADO Set-up

  • Move central star relative to the coronagraph such that it is not blocked anymore by the latter

  • insert neutral density filter if user requested it

  • other configurations identical to science observations for which the calibration is used

Calibration Unit setup

Not active.

Observing Template

MICADO_coro_cal_starvisible

Template parameters

INS.MODE, OBS.RA, OBS.DEC, INS.FILT1.NAME, INS.FILT2.NAME, INS.OPTI6.NAME, INS.DROT, INS.READMODE, DET.DIT, DET.NDIT, INSTRUME

Frequency

The User decides the number of observing Templates instances added to its phase 2 Observing Blocks.

Duration estimate [s]

252 (per observing Template in this case)

Prerequisites

None

Recipe frequency

Once for each raw off-axis HCI exposure.

Input data

I_CORO_OFFSET_RAW_, I_NONLINEARITY_IMG_, I_MASTER_DARK_IMG, I_PERSISTENCE_IMG, I_MASTER_FLAT_IMG

Output products

I_DT_CORO_OFFSET_IMG

QC parameters

QC DETSMEAN, QC DETSMED, QC DETSSTD, QC DETRENCR, QC NPIXNONL, QC FPIXNONL

DRL Recipe ID

micado_img_detrend_hci

Procedure

See individual steps. Same as DetrendFinal except without illumination correction.

Mathematical description

See individual steps.

Remarks

Identical to DetrendHCI.

Accuracy

TODO

generated/DetrendHCIOffset.png

Workflow diagram for I_DT_CORO_OFFSET_IMG

1.4.13. I_STAROFFSET_HDR

Purpose:

null

Algorithm and workflow:

null

Name

Coronagraphic star zeropoint and centroid

ReqID

DPS-corostarzptandcentroid

Parent ReqID

R-MCD-119

Objective

Determine zeropoint and centroid of the central bright star.

Responsible

User

Phase

Nighttime

MICADO Set-up

  • Move central star relative to the coronagraph such that it is not blocked anymore by the latter

  • insert neutral density filter if user requested it

  • other configurations identical to science observations for which the calibration is used

Calibration Unit setup

Not active.

Observing Template

MICADO_coro_cal_starvisible

Template parameters

INS.MODE, OBS.RA, OBS.DEC, INS.FILT1.NAME, INS.FILT2.NAME, INS.OPTI6.NAME, INS.DROT, INS.READMODE, DET.DIT, DET.NDIT, INSTRUME

Frequency

The User decides the number of observing Templates instances added to its phase 2 Observing Blocks.

Duration estimate [s]

252 (per observing Template in this case)

Prerequisites

None

Recipe frequency

Execute for each Observing Block

Input data

I_DTFNL_CORO_OFFSET_IMG_, I_PHOTOM_HDR_, I_PHOTOM_HDR_

Output products

I_STAROFFSET_HDR

QC parameters

QC STAROFFSETSNRMINn, QC STAROFFSETSNRMAXn, QC STAROFFSETSNRMEDn, QC STAROFFSETSNRMEANn

DRL Recipe ID

micado_img_star_photom

Procedure

Measure throughput in calibration filter and using zeropoint for science filter and calibration filter to estimate throughput for science filter. Position of the star used to point the star on the mask determined using DPS-1700-INS information and calibration of the astrometric shift between observation with and without ND filter.

Mathematical description

To be added at FDR.

Remarks

See Section 5 in cite{MICADO-DRLD} for details of procedure and algorithm.

Accuracy

Accuracy of algorithm is a zeropoint better than 1% and a centroid better than 0.1 pixel in each dimension.

generated/Staroffset.png

Workflow diagram for I_STAROFFSET_HDR

1.4.14. I_CALIB_HCI_IMG

Purpose:

null

Algorithm and workflow:

null

Name

Calibrated high-contrast science exposure

ReqID

None

Parent ReqID

None

Objective

Calculate proper angle.

Responsible

User

Phase

MICADO Set-up

None

Calibration Unit setup

None

Observing Template

template

Template parameters

INS.READMODE, DET.DIT, DET.NDIT, INSTRUME

Frequency

None

Duration estimate [s]

None

Prerequisites

None

Recipe frequency

Once for each raw HCI science exposure.

Input data

I_DTFNL_HCI_SCI_IMG_, I_STAROFFSET_HDR, I_STARCENTER_HDR_

Output products

I_CALIB_HCI_IMG

QC parameters

QC CALIMEAi, QC CALISTDi

DRL Recipe ID

micado_img_calib_hci

Procedure

See individual steps. Same as DetrendFinal except without illumination correction.

Mathematical description

See individual steps.

Remarks

None

Accuracy

TODO

generated/CalibHCI.png

Workflow diagram for I_CALIB_HCI_IMG

1.5. MICADO Recipe Steps

1.5.1. mcd_img_vardqlayers_create

Create variance and data quality layers.

generated/CreateVarDqLayers.png

1.5.2. mcd_det_persistence_derive

Derive Persistence Correction.

generated/DerivePersistence.png

1.5.3. mcd_det_persistence_apply

Apply Persistence Correction.

For each detector adapt the extensions as follows:

  • DATA: Subtract the DATA layer of the Persistence image.

  • ERR: Propagate the ERR layer of the Persistence image

assuming uncorrelated uncertainties. * DQ: XOR with the DQ layer of the Persistence image.

TODO: Ensure that the external Persistence map meets these requirements. TODO: Perhaps keep the persistence as a separate layer.

generated/ApplyPersistence.png

1.5.4. mcd_img_dark_apply

Apply MasterDark Correction.

generated/ApplyMasterDark.png

1.5.5. mcd_img_flat_apply

Apply MasterFlat Correction.

generated/ApplyMasterFlat.png

1.5.6. mcd_det_dark_derive

Derive MasterDark.

generated/DeriveMasterDark.png

1.5.7. mcd_img_flat_derive

Derive MasterFlat.

generated/DeriveMasterFlat.png

1.5.8. mcd_img_background_derive

Derive Background.

TODO: Describe background subtraction.

generated/DeriveBackground.png

1.5.9. mcd_img_illum_derive

Derive illumination correction.

Creates the IllumCorr data product by applying the procedure described in ILLUMCORR_TAB recipe.

generated/DeriveIllumCorr.png

1.5.10. mcd_img_illum_apply

Apply illumination correction.

For each detector generate an illumination correction image and adapt the extensions as follows:

  • DATA: Multiply with the DATA layer of the illumination correction image.

  • ERR: Propagate the ERR layer of the illumination correction image

assuming uncorrelated uncertainties. * DQ: Nothing.

generated/ApplyIllumCorr.png

1.5.11. mcd_img_catalog_create_final

Create Source Catalog from DetrendFinal.

generated/CreateSourceCatalogFinal.png

1.5.12. mcd_img_catalog_create_illum

Create Source Catalog from DetrendIllum.

generated/CreateSourceCatalogIllum.png

1.5.13. mcd_img_astrom_geom_correct

CorrectGeomDistortion.

TODO: describe

generated/CorrectGeomDistortion.png

1.5.14. mcd_img_astrom_crossmatch

SpatialCrossmatch.

generated/SpatialCrossmatch.png

1.5.15. mcd_img_astrom_derive

DeriveAstrom.

generated/DeriveAstrom.png

1.5.16. mcd_img_catalog_create_astrom

Create Source Catalog using Astrometric solution.

generated/CreateSourceCatalogAstrom.png

1.5.17. mcd_img_photom_crossmatch

SpatialCrossmatch for photometric calibration.

generated/SpatialCrossmatchPhotom.png

1.5.18. mcd_img_photom_derive

DerivePhotom.

generated/DerivePhotom.png

1.5.19. mcd_img_astrom_apply

ApplyAstrom.

generated/ApplyAstrom.png

1.5.20. mcd_img_photom_apply

ApplyPhotom.

generated/ApplyPhotom.png

1.5.21. mcd_img_stack_combine

None.

generated/CombineExposures.png

1.5.22. mcd_img_catalog_create_hci

Create Source Catalog from DetrendHCI.

generated/CreateSourceCatalogHCI.png

1.5.23. mcd_img_hci_starpos_waffle_diffraction_extract

None.

generated/ExtractDiffractionPeaks.png

1.5.24. mcd_img_hci_waffle_starpos_centroid

None.

generated/ComputeCentroid.png

1.5.25. mcd_img_hci_photom_compute

None.

generated/ComputePhotomInScienceFilter.png