105.6. Create a custom coadded image#
105.6. Create custom coadd images¶
For the Rubin Science Platform at data.lsst.cloud.
Data Release: Data Preview 1
Container Size: large
LSST Science Pipelines version: r29.2.0
Last verified to run: 2025-09-02
Repository: github.com/lsst/tutorial-notebooks
Learning objective: How to create a custom coadd from a desired subset of DP1 exposures.
LSST data products: visit_image, visit_table, deep_coadd_predetection
Packages: lsst.daf.butler, lsst.ctrl.mpexec, lsst.pipe.base
Credit: Originally developed by the Rubin Community Science team with assistance from Rubin Data Management. Please consider acknowledging them if this notebook is used for the preparation of journal articles, software releases, or other notebooks.
Get Support: Everyone is encouraged to ask questions or raise issues in the Support Category of the Rubin Community Forum. Rubin staff will respond to all questions posted there.
1. Introduction¶
In certain scientific applications, it may be desirable to make a custom coadd of DP1 exposures that, for example, includes only exposures before or after some date. For instance, when looking for any potential faint precursor of a transient of interest, coadding only the subset of exposures prior to the date of the transient's brightening could reveal such a precursor even if the precursor is fainter than the single-exposure depth.
This tutorial illustrates the process of selecting a subset of DP1 exposures at a given sky location and creating a custom coadd based on the curated list of desired input exposures.
Related tutorials: The first 100-level tutorial in this series provides a basic introduction to how to use the LSST Science Pipelines; later tutorials in this series demonstrate other image analysis techniques available with the LSST Science Pipelines.
1.1. Import packages¶
From the LSST Science Pipelines, import modules for data access via the Butler (lsst.daf.butler), for image display (lsst.afw.display), pipeline definition (lsst.pipe.base), and pipeline execution (lsst.ctrl.mpexec). In addition, import the matplotlib and getpass modules.
In [1]:
import os
from pathlib import Path
from lsst.daf.butler import Butler
from lsst.ctrl.mpexec import SimplePipelineExecutor
from lsst.pipe.base import Pipeline
import getpass
import lsst.afw.display as afwDisplay
import matplotlib.pyplot as plt
1.2. Define parameters and functions¶
Create an instance of the Butler with the repository and collection for DP1, and assert that it exists.
In [2]:
butler = Butler("dp1", collections="LSSTComCam/DP1")
assert butler is not None
Perform custom coaddition at the center of the Extended Chandra Deep Field South (ECDFS), which offers a large number of input exposures from which to subselect. Use r-band. The ECDFS overview tutorial notebook shows that the tract and patch corresponding to the center of ECDFS is (tract, patch) = (5063, 34).
In [3]:
my_filter = 'r'
my_tract = 5063
my_patch = 34
Configure plotting to use matplotlib to display figures directly within this notebook.
In [4]:
afwDisplay.setDefaultBackend('matplotlib')
2. Select input exposures¶
Use the standard (i.e., not customized) DP1 deep coadd at the center of ECDFS to access the full list of available DP1 r-band exposures at this sky location. Start by retrieving the relevant deep coadd using the Butler.
In [5]:
my_dataId = {'band': my_filter, 'tract': my_tract, 'patch': my_patch}
my_deepCoadd = butler.get('deep_coadd', dataId=my_dataId)
Get the coadd inputs, which include the list of input exposures.
In [6]:
deep_coadd_inputs = my_deepCoadd.getInfo().getCoaddInputs()
The coadd inputs object's .visit attribute contains the full list of r-band input exposures used to make the standard DP1 custom coadd for this tract/patch. Check how many exposures contribute to the standard DP1 deep coadd at the center of ECDFS.
In [7]:
len(deep_coadd_inputs.visits)
Out[7]:
230
Convert the deep coadd's input visits to an astropy Table.
In [8]:
deep_coadd_visits = deep_coadd_inputs.visits.asAstropy()
Option: see what the deep coadd's visit table looks like laid out in terms of rows and columns.
In [9]:
# deep_coadd_visits
The custom coadd will use a subset of input exposures based on timestamp. Check what columns are available from the deep coadd's visit list, to determine whether timestamp information is available there.
In [10]:
deep_coadd_visits.colnames
Out[10]:
['id', 'bbox_min_x', 'bbox_min_y', 'bbox_max_x', 'bbox_max_y', 'goodpix', 'weight', 'filter']
The deep coadd's visit list doesn't include timestamp information. Timestamp information will be retrieved by looking up the relevant visit id values in the DP1 visit_table, because the DP1 visit_table contains more extensive metadata about every exposure in DP1.
Retrieve the DP1 visit_table.
In [11]:
visitTableRef = list(butler.registry.queryDatasets('visit_table'))
visitTable = butler.get(visitTableRef[0])
Check the DP1 visit_table column names to verify that timestamp information is available.
In [12]:
visitTable.colnames
Out[12]:
['visitId', 'visit', 'physical_filter', 'band', 'ra', 'dec', 'decl', 'skyRotation', 'azimuth', 'altitude', 'zenithDistance', 'airmass', 'expTime', 'expMidpt', 'expMidptMJD', 'obsStart', 'obsStartMJD']
The last five columns contain timestamp-related information. Use expMidptMJD, the exposure midpoint Modified Julian Date (MJD), to select the subsample of exposures to be used for building the custom coadd. Put the rows of the deep coadd visits table and the DP1 visit table in correspondence by matching up the id column of the former to the visitId column of the latter. With the MJD values retrieved, add these as a new column to the table of deep coadd visits.
In [13]:
visitTable.add_index('visitId')
deep_coadd_visits_mjds = visitTable.loc[deep_coadd_visits['id']]['expMidptMJD']
deep_coadd_visits['expMidptMJD'] = deep_coadd_visits_mjds
Make a histogram of the MJD values of the exposures contributing to the DP1 deep coadd at the center of ECDFS.
In [14]:
plt.hist(deep_coadd_visits['expMidptMJD'])
plt.xlabel('MJD')
plt.ylabel('number of input exposures')
Out[14]:
Text(0, 0.5, 'number of input exposures')
Figure 1: Histogram of input exposure dates in MJD.
Imagining that a transient of interest "turned on" around MJD = 60630 (roughly 2024 November 16), create a custom coadd isolating any precursor to the transient by selecting only exposures with MJD < 60627.
In [15]:
early_exposures = deep_coadd_visits[deep_coadd_visits['expMidptMJD'] < 60630]
Per the above histogram, selecting exposures before MJD = 60630 isolates the first ~30+ exposures. For the sake of relatively rapid custom coadd creation, downselect to only 8 of these ~30+ early-time exposures. Making a custom coadd with 30+ input exposures is possible, but would require a longer coaddition processing time (and a larger peak memory).
In [16]:
n_exposures_max = 8
early_exposure_ids = early_exposures[0:n_exposures_max]['id']
early_exposure_ids
Out[16]:
<Column name='id' dtype='int64' description='unique ID' length=8>
| 2024110800246 |
| 2024110800247 |
| 2024110800250 |
| 2024110800251 |
| 2024110800254 |
| 2024110800255 |
| 2024110800258 |
| 2024110800259 |
3. Create the custom coadd¶
3.1. Define and configure the pipeline¶
Creating the custom coadd means running a subset of the full DP1 "Data Release Production" (DRP) pipeline on the desired list of input exposures, for the tract/patch at the center of ECDFS. Refer to the first 100-level tutorial in this series for more background information about defining pipelines using YAML files. For custom coaddition, the four processing steps to run are makeDirectWarp, assembleDeepCoadd, makePsfMatchedWarp, and selectDeepCoaddVisits. Thus, create a custom pipeline with a Uniform Resource Identifier (URI) that consists of the name of the DP1 DRP pipeline's YAML file followed by # and then a comma separated list of the four processing steps to be executed.
In [17]:
drp_yaml_file = "$DRP_PIPE_DIR/pipelines/LSSTComCam/DRP-v2-compat.yaml"
uri = drp_yaml_file + "#makeDirectWarp,assembleDeepCoadd,makePsfMatchedWarp,selectDeepCoaddVisits"
pipeline = Pipeline.from_uri(uri)
The DP1 dataset available to users does not contain all intermediate data products. To work around this, use pipeline configuration overrides to ensure that custom coaddition will draw needed metadata information directly from the calibrated exposures rather than other intermediate products.
In [18]:
pipeline.addConfigOverride('makeDirectWarp', 'useVisitSummaryPsf', False)
pipeline.addConfigOverride('makeDirectWarp', 'useVisitSummaryPhotoCalib', False)
pipeline.addConfigOverride('makeDirectWarp', 'useVisitSummaryWcs', False)
pipeline.addConfigOverride('makeDirectWarp', 'connections.calexp_list', 'visit_image')
3.2. Make a writable Butler¶
Use the convention u/<Your User Name>/<Collection Identifier> to set up a new Butler output collection for the custom coadd. Access your username through the getpass module.
In [19]:
my_username = getpass.getuser()
print(my_username)
melissagraham
Construct the output collection name.
In [20]:
my_collection_identifier = 'custom_coadd_ecdfs'
my_outputCollection = 'u/'+my_username+'/'+my_collection_identifier
my_outputCollection
Out[20]:
'u/melissagraham/custom_coadd_ecdfs'
Creating the writable Butler requires first creating a pipeline executor, which in turn requires a query string defining the specific input data to use. Construct the custom coaddition query string specifying the coadd footprint (tract and patch), as well as the custom list of input exposures. The custom subset of visit identifiers is expressed within the query as a comma-separated list. The skymap value of lsst_cells_v1 is simply the sky tiling that has been used in general for DP1.
In [21]:
my_visits_tupleString = "("+",".join(early_exposure_ids.astype(str))+")"
query_string = """tract = {} AND patch = {} AND visit IN {} AND skymap = 'lsst_cells_v1'
""".format(my_tract, my_patch, my_visits_tupleString)
print(query_string)
tract = 5063 AND patch = 34 AND visit IN (2024110800246,2024110800247,2024110800250,2024110800251,2024110800254,2024110800255,2024110800258,2024110800259) AND skymap = 'lsst_cells_v1'
Create a SimplePipelineExecutor object that will enable running the custom coaddition pipeline. The SimplePipelineExecutor's inputs are the pipeline structural definition, the DP1 Butler object, the output collection name, and the query string.
In [22]:
executor = SimplePipelineExecutor.from_pipeline(pipeline, butler=butler,
output=my_outputCollection, where=query_string)
lsst.pipe.base.quantum_graph_builder INFO: Processing pipeline subgraph 1 of 1 with 4 task(s).
lsst.pipe.base.quantum_graph_builder INFO: Iterating over data ID query results.
lsst.pipe.base.quantum_graph_builder INFO: Initial bipartite graph has 18 quanta, 100 dataset nodes, and 142 edges.
lsst.pipe.base.quantum_graph_builder INFO: Generated 8 quanta for task makeDirectWarp.
lsst.pipe.base.quantum_graph_builder INFO: Generated 8 quanta for task makePsfMatchedWarp.
lsst.pipe.base.quantum_graph_builder INFO: Generated 1 quantum for task selectDeepCoaddVisits.
lsst.pipe.base.quantum_graph_builder INFO: Generated 1 quantum for task assembleDeepCoadd.
Users cannot write to the main DP1 Butler repository. Instead, make a writable repository where custom coadd outputs will be written. The call to use_local_butler creates a new directory that will contain the local Butler repository, within the $SCRATCH_DIR temporary space that gets deleted weekly. Use this temporary space because the custom coadd processing produces of order a gigabyte of intermediate files.
In [23]:
local_repo_path = Path(os.getenv("SCRATCH_DIR"), "my_local_repo")
out_butler = executor.use_local_butler(local_repo_path)
lsst.daf.butler.direct_butler._direct_butler INFO: Importing 28 datasets into Butler(collections=DirectButlerCollections(defaults=()), run=None, datastore='file:///deleted-sundays/melissagraham/my_local_repo/', registry='SQLite3@/deleted-sundays/melissagraham/my_local_repo/gen3.sqlite3')
3.3. Run the coadd processing¶
Use the executor to run the custom coadd processing. This processing may take several minutes to complete and prints many lines of logging output along the way.
In [24]:
executor.run(register_dataset_types=True)
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Preparing execution of quantum for label=makeDirectWarp dataId={instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800255, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}.
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Constructing task and executing quantum for label=makeDirectWarp dataId={instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800255, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}.
lsst.makeDirectWarp.select INFO: Selecting calexp {instrument: 'LSSTComCam', detector: 5, visit: 2024110800255, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}
lsst.makeDirectWarp.select INFO: Selecting calexp {instrument: 'LSSTComCam', detector: 8, visit: 2024110800255, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Execution of task 'makeDirectWarp' on quantum {instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800255, band: 'r', day_obs: 20241108, physical_filter: 'r_03'} took 16.152 seconds
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Preparing execution of quantum for label=makeDirectWarp dataId={instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800246, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}.
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Constructing task and executing quantum for label=makeDirectWarp dataId={instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800246, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}.
lsst.makeDirectWarp.select INFO: Selecting calexp {instrument: 'LSSTComCam', detector: 1, visit: 2024110800246, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}
lsst.makeDirectWarp.select INFO: Selecting calexp {instrument: 'LSSTComCam', detector: 2, visit: 2024110800246, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}
lsst.makeDirectWarp.select INFO: Selecting calexp {instrument: 'LSSTComCam', detector: 5, visit: 2024110800246, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Execution of task 'makeDirectWarp' on quantum {instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800246, band: 'r', day_obs: 20241108, physical_filter: 'r_03'} took 18.596 seconds
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Preparing execution of quantum for label=makeDirectWarp dataId={instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800259, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}.
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Constructing task and executing quantum for label=makeDirectWarp dataId={instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800259, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}.
lsst.makeDirectWarp.select INFO: Selecting calexp {instrument: 'LSSTComCam', detector: 5, visit: 2024110800259, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}
lsst.makeDirectWarp.select INFO: Selecting calexp {instrument: 'LSSTComCam', detector: 8, visit: 2024110800259, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Execution of task 'makeDirectWarp' on quantum {instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800259, band: 'r', day_obs: 20241108, physical_filter: 'r_03'} took 14.237 seconds
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Preparing execution of quantum for label=makeDirectWarp dataId={instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800250, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}.
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Constructing task and executing quantum for label=makeDirectWarp dataId={instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800250, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}.
lsst.makeDirectWarp.select INFO: Selecting calexp {instrument: 'LSSTComCam', detector: 2, visit: 2024110800250, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}
lsst.makeDirectWarp.select INFO: Selecting calexp {instrument: 'LSSTComCam', detector: 5, visit: 2024110800250, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Execution of task 'makeDirectWarp' on quantum {instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800250, band: 'r', day_obs: 20241108, physical_filter: 'r_03'} took 11.048 seconds
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Preparing execution of quantum for label=makeDirectWarp dataId={instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800254, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}.
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Constructing task and executing quantum for label=makeDirectWarp dataId={instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800254, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}.
lsst.makeDirectWarp.select INFO: Selecting calexp {instrument: 'LSSTComCam', detector: 5, visit: 2024110800254, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}
lsst.makeDirectWarp.select INFO: Selecting calexp {instrument: 'LSSTComCam', detector: 8, visit: 2024110800254, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Execution of task 'makeDirectWarp' on quantum {instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800254, band: 'r', day_obs: 20241108, physical_filter: 'r_03'} took 8.622 seconds
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Preparing execution of quantum for label=makeDirectWarp dataId={instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800247, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}.
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Constructing task and executing quantum for label=makeDirectWarp dataId={instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800247, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}.
lsst.makeDirectWarp.select INFO: Selecting calexp {instrument: 'LSSTComCam', detector: 2, visit: 2024110800247, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}
lsst.makeDirectWarp.select INFO: Selecting calexp {instrument: 'LSSTComCam', detector: 5, visit: 2024110800247, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Execution of task 'makeDirectWarp' on quantum {instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800247, band: 'r', day_obs: 20241108, physical_filter: 'r_03'} took 14.072 seconds
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Preparing execution of quantum for label=makeDirectWarp dataId={instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800258, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}.
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Constructing task and executing quantum for label=makeDirectWarp dataId={instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800258, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}.
lsst.makeDirectWarp.select INFO: Selecting calexp {instrument: 'LSSTComCam', detector: 4, visit: 2024110800258, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}
lsst.makeDirectWarp.select INFO: Selecting calexp {instrument: 'LSSTComCam', detector: 5, visit: 2024110800258, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}
lsst.makeDirectWarp.select INFO: Selecting calexp {instrument: 'LSSTComCam', detector: 7, visit: 2024110800258, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}
lsst.makeDirectWarp.select INFO: Selecting calexp {instrument: 'LSSTComCam', detector: 8, visit: 2024110800258, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Execution of task 'makeDirectWarp' on quantum {instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800258, band: 'r', day_obs: 20241108, physical_filter: 'r_03'} took 22.375 seconds
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Preparing execution of quantum for label=makeDirectWarp dataId={instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800251, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}.
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Constructing task and executing quantum for label=makeDirectWarp dataId={instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800251, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}.
lsst.makeDirectWarp.select INFO: Selecting calexp {instrument: 'LSSTComCam', detector: 5, visit: 2024110800251, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}
lsst.makeDirectWarp.select INFO: Selecting calexp {instrument: 'LSSTComCam', detector: 8, visit: 2024110800251, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Execution of task 'makeDirectWarp' on quantum {instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800251, band: 'r', day_obs: 20241108, physical_filter: 'r_03'} took 14.502 seconds
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Preparing execution of quantum for label=selectDeepCoaddVisits dataId={band: 'r', instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34}.
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Constructing task and executing quantum for label=selectDeepCoaddVisits dataId={band: 'r', instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34}.
lsst.selectDeepCoaddVisits INFO: 8 images selected with FWHM range of 0.863737--0.954459 arcseconds
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Execution of task 'selectDeepCoaddVisits' on quantum {band: 'r', instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34} took 0.612 seconds
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Preparing execution of quantum for label=makePsfMatchedWarp dataId={instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800255, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}.
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Constructing task and executing quantum for label=makePsfMatchedWarp dataId={instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800255, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}.
lsst.makePsfMatchedWarp.psfMatch INFO: compute Psf-matching kernel
lsst.makePsfMatchedWarp.psfMatch INFO: Adjusted dimensions of reference PSF model from (27, 27) to (41, 41)
lsst.ip.diffim.generateAlardLuptonBasisList INFO: PSF sigmas are not available or scaling by fwhm disabled, falling back to config values
lsst.makePsfMatchedWarp.psfMatch INFO: Psf-match science exposure to reference
lsst.makePsfMatchedWarp.psfMatch INFO: done
lsst.makePsfMatchedWarp INFO: Copied 8875949 pixels from CCD 5 to exposure_psf_matched
lsst.makePsfMatchedWarp.psfMatch INFO: compute Psf-matching kernel
lsst.makePsfMatchedWarp.psfMatch INFO: Adjusted dimensions of reference PSF model from (27, 27) to (41, 41)
lsst.ip.diffim.generateAlardLuptonBasisList INFO: PSF sigmas are not available or scaling by fwhm disabled, falling back to config values
lsst.makePsfMatchedWarp.psfMatch INFO: Psf-match science exposure to reference
lsst.makePsfMatchedWarp.psfMatch INFO: done
lsst.makePsfMatchedWarp INFO: Copied 844434 pixels from CCD 8 to exposure_psf_matched
lsst.makePsfMatchedWarp INFO: Total number of good pixels = 9720383
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Execution of task 'makePsfMatchedWarp' on quantum {instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800255, band: 'r', day_obs: 20241108, physical_filter: 'r_03'} took 47.410 seconds
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Preparing execution of quantum for label=makePsfMatchedWarp dataId={instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800246, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}.
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Constructing task and executing quantum for label=makePsfMatchedWarp dataId={instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800246, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}.
lsst.makePsfMatchedWarp.psfMatch INFO: compute Psf-matching kernel
lsst.makePsfMatchedWarp.psfMatch INFO: Adjusted dimensions of reference PSF model from (27, 27) to (41, 41)
lsst.ip.diffim.generateAlardLuptonBasisList INFO: PSF sigmas are not available or scaling by fwhm disabled, falling back to config values
lsst.makePsfMatchedWarp.psfMatch INFO: Psf-match science exposure to reference
lsst.makePsfMatchedWarp.psfMatch INFO: done
lsst.makePsfMatchedWarp INFO: Copied 182366 pixels from CCD 1 to exposure_psf_matched
lsst.makePsfMatchedWarp.psfMatch INFO: compute Psf-matching kernel
lsst.makePsfMatchedWarp.psfMatch INFO: Adjusted dimensions of reference PSF model from (27, 27) to (41, 41)
lsst.ip.diffim.generateAlardLuptonBasisList INFO: PSF sigmas are not available or scaling by fwhm disabled, falling back to config values
lsst.makePsfMatchedWarp.psfMatch INFO: Psf-match science exposure to reference
lsst.makePsfMatchedWarp.psfMatch INFO: done
lsst.makePsfMatchedWarp INFO: Copied 8523705 pixels from CCD 2 to exposure_psf_matched
lsst.makePsfMatchedWarp.psfMatch INFO: compute Psf-matching kernel
lsst.makePsfMatchedWarp.psfMatch INFO: Adjusted dimensions of reference PSF model from (27, 27) to (41, 41)
lsst.ip.diffim.generateAlardLuptonBasisList INFO: PSF sigmas are not available or scaling by fwhm disabled, falling back to config values
lsst.makePsfMatchedWarp.psfMatch INFO: Psf-match science exposure to reference
lsst.makePsfMatchedWarp.psfMatch INFO: done
lsst.makePsfMatchedWarp INFO: Copied 1586043 pixels from CCD 5 to exposure_psf_matched
lsst.makePsfMatchedWarp INFO: Total number of good pixels = 10292114
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Execution of task 'makePsfMatchedWarp' on quantum {instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800246, band: 'r', day_obs: 20241108, physical_filter: 'r_03'} took 52.284 seconds
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Preparing execution of quantum for label=makePsfMatchedWarp dataId={instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800259, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}.
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Constructing task and executing quantum for label=makePsfMatchedWarp dataId={instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800259, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}.
lsst.makePsfMatchedWarp.psfMatch INFO: compute Psf-matching kernel
lsst.makePsfMatchedWarp.psfMatch INFO: Adjusted dimensions of reference PSF model from (27, 27) to (41, 41)
lsst.ip.diffim.generateAlardLuptonBasisList INFO: PSF sigmas are not available or scaling by fwhm disabled, falling back to config values
lsst.makePsfMatchedWarp.psfMatch INFO: Psf-match science exposure to reference
lsst.makePsfMatchedWarp.psfMatch INFO: done
lsst.makePsfMatchedWarp INFO: Copied 3586259 pixels from CCD 5 to exposure_psf_matched
lsst.makePsfMatchedWarp.psfMatch INFO: compute Psf-matching kernel
lsst.makePsfMatchedWarp.psfMatch INFO: Adjusted dimensions of reference PSF model from (27, 27) to (41, 41)
lsst.ip.diffim.generateAlardLuptonBasisList INFO: PSF sigmas are not available or scaling by fwhm disabled, falling back to config values
lsst.makePsfMatchedWarp.psfMatch INFO: Psf-match science exposure to reference
lsst.makePsfMatchedWarp.psfMatch INFO: done
lsst.makePsfMatchedWarp INFO: Copied 4101645 pixels from CCD 8 to exposure_psf_matched
lsst.makePsfMatchedWarp INFO: Total number of good pixels = 7687904
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Execution of task 'makePsfMatchedWarp' on quantum {instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800259, band: 'r', day_obs: 20241108, physical_filter: 'r_03'} took 37.103 seconds
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Preparing execution of quantum for label=makePsfMatchedWarp dataId={instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800250, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}.
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Constructing task and executing quantum for label=makePsfMatchedWarp dataId={instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800250, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}.
lsst.makePsfMatchedWarp.psfMatch INFO: compute Psf-matching kernel
lsst.makePsfMatchedWarp.psfMatch INFO: Adjusted dimensions of reference PSF model from (27, 27) to (41, 41)
lsst.ip.diffim.generateAlardLuptonBasisList INFO: PSF sigmas are not available or scaling by fwhm disabled, falling back to config values
lsst.makePsfMatchedWarp.psfMatch INFO: Psf-match science exposure to reference
lsst.makePsfMatchedWarp.psfMatch INFO: done
lsst.makePsfMatchedWarp INFO: Copied 1260720 pixels from CCD 2 to exposure_psf_matched
lsst.makePsfMatchedWarp.psfMatch INFO: compute Psf-matching kernel
lsst.makePsfMatchedWarp.psfMatch INFO: Adjusted dimensions of reference PSF model from (27, 27) to (41, 41)
lsst.ip.diffim.generateAlardLuptonBasisList INFO: PSF sigmas are not available or scaling by fwhm disabled, falling back to config values
lsst.makePsfMatchedWarp.psfMatch INFO: Psf-match science exposure to reference
lsst.makePsfMatchedWarp.psfMatch INFO: done
lsst.makePsfMatchedWarp INFO: Copied 2730516 pixels from CCD 5 to exposure_psf_matched
lsst.makePsfMatchedWarp INFO: Total number of good pixels = 3991236
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Execution of task 'makePsfMatchedWarp' on quantum {instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800250, band: 'r', day_obs: 20241108, physical_filter: 'r_03'} took 22.331 seconds
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Preparing execution of quantum for label=makePsfMatchedWarp dataId={instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800254, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}.
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Constructing task and executing quantum for label=makePsfMatchedWarp dataId={instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800254, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}.
lsst.makePsfMatchedWarp.psfMatch INFO: compute Psf-matching kernel
lsst.makePsfMatchedWarp.psfMatch INFO: Adjusted dimensions of reference PSF model from (27, 27) to (41, 41)
lsst.ip.diffim.generateAlardLuptonBasisList INFO: PSF sigmas are not available or scaling by fwhm disabled, falling back to config values
lsst.makePsfMatchedWarp.psfMatch INFO: Psf-match science exposure to reference
lsst.makePsfMatchedWarp.psfMatch INFO: done
lsst.makePsfMatchedWarp INFO: Copied 698683 pixels from CCD 5 to exposure_psf_matched
lsst.makePsfMatchedWarp.psfMatch INFO: compute Psf-matching kernel
lsst.makePsfMatchedWarp.psfMatch INFO: Adjusted dimensions of reference PSF model from (27, 27) to (41, 41)
lsst.ip.diffim.generateAlardLuptonBasisList INFO: PSF sigmas are not available or scaling by fwhm disabled, falling back to config values
lsst.makePsfMatchedWarp.psfMatch INFO: Psf-match science exposure to reference
lsst.makePsfMatchedWarp.psfMatch INFO: done
lsst.makePsfMatchedWarp INFO: Copied 592351 pixels from CCD 8 to exposure_psf_matched
lsst.makePsfMatchedWarp INFO: Total number of good pixels = 1291034
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Execution of task 'makePsfMatchedWarp' on quantum {instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800254, band: 'r', day_obs: 20241108, physical_filter: 'r_03'} took 11.512 seconds
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Preparing execution of quantum for label=makePsfMatchedWarp dataId={instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800247, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}.
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Constructing task and executing quantum for label=makePsfMatchedWarp dataId={instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800247, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}.
lsst.makePsfMatchedWarp.psfMatch INFO: compute Psf-matching kernel
lsst.makePsfMatchedWarp.psfMatch INFO: Adjusted dimensions of reference PSF model from (27, 27) to (41, 41)
lsst.ip.diffim.generateAlardLuptonBasisList INFO: PSF sigmas are not available or scaling by fwhm disabled, falling back to config values
lsst.makePsfMatchedWarp.psfMatch INFO: Psf-match science exposure to reference
lsst.makePsfMatchedWarp.psfMatch INFO: done
lsst.makePsfMatchedWarp INFO: Copied 93712 pixels from CCD 2 to exposure_psf_matched
lsst.makePsfMatchedWarp.psfMatch INFO: compute Psf-matching kernel
lsst.makePsfMatchedWarp.psfMatch INFO: Adjusted dimensions of reference PSF model from (27, 27) to (41, 41)
lsst.ip.diffim.generateAlardLuptonBasisList INFO: PSF sigmas are not available or scaling by fwhm disabled, falling back to config values
lsst.makePsfMatchedWarp.psfMatch INFO: Psf-match science exposure to reference
lsst.makePsfMatchedWarp.psfMatch INFO: done
lsst.makePsfMatchedWarp INFO: Copied 8046800 pixels from CCD 5 to exposure_psf_matched
lsst.makePsfMatchedWarp INFO: Total number of good pixels = 8140512
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Execution of task 'makePsfMatchedWarp' on quantum {instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800247, band: 'r', day_obs: 20241108, physical_filter: 'r_03'} took 38.764 seconds
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Preparing execution of quantum for label=makePsfMatchedWarp dataId={instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800258, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}.
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Constructing task and executing quantum for label=makePsfMatchedWarp dataId={instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800258, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}.
lsst.makePsfMatchedWarp.psfMatch INFO: compute Psf-matching kernel
lsst.makePsfMatchedWarp.psfMatch INFO: Adjusted dimensions of reference PSF model from (27, 27) to (41, 41)
lsst.ip.diffim.generateAlardLuptonBasisList INFO: PSF sigmas are not available or scaling by fwhm disabled, falling back to config values
lsst.makePsfMatchedWarp.psfMatch INFO: Psf-match science exposure to reference
lsst.makePsfMatchedWarp.psfMatch INFO: done
lsst.makePsfMatchedWarp INFO: Copied 424173 pixels from CCD 4 to exposure_psf_matched
lsst.makePsfMatchedWarp.psfMatch INFO: compute Psf-matching kernel
lsst.makePsfMatchedWarp.psfMatch INFO: Adjusted dimensions of reference PSF model from (27, 27) to (41, 41)
lsst.ip.diffim.generateAlardLuptonBasisList INFO: PSF sigmas are not available or scaling by fwhm disabled, falling back to config values
lsst.makePsfMatchedWarp.psfMatch INFO: Psf-match science exposure to reference
lsst.makePsfMatchedWarp.psfMatch INFO: done
lsst.makePsfMatchedWarp INFO: Copied 3467231 pixels from CCD 5 to exposure_psf_matched
lsst.makePsfMatchedWarp.psfMatch INFO: compute Psf-matching kernel
lsst.makePsfMatchedWarp.psfMatch INFO: Adjusted dimensions of reference PSF model from (27, 27) to (41, 41)
lsst.ip.diffim.generateAlardLuptonBasisList INFO: PSF sigmas are not available or scaling by fwhm disabled, falling back to config values
lsst.makePsfMatchedWarp.psfMatch INFO: Psf-match science exposure to reference
lsst.makePsfMatchedWarp.psfMatch INFO: done
lsst.makePsfMatchedWarp INFO: Copied 253976 pixels from CCD 7 to exposure_psf_matched
lsst.makePsfMatchedWarp.psfMatch INFO: compute Psf-matching kernel
lsst.makePsfMatchedWarp.psfMatch INFO: Adjusted dimensions of reference PSF model from (27, 27) to (41, 41)
lsst.ip.diffim.generateAlardLuptonBasisList INFO: PSF sigmas are not available or scaling by fwhm disabled, falling back to config values
lsst.makePsfMatchedWarp.psfMatch INFO: Psf-match science exposure to reference
lsst.makePsfMatchedWarp.psfMatch INFO: done
lsst.makePsfMatchedWarp INFO: Copied 5932324 pixels from CCD 8 to exposure_psf_matched
lsst.makePsfMatchedWarp INFO: Total number of good pixels = 10077704
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Execution of task 'makePsfMatchedWarp' on quantum {instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800258, band: 'r', day_obs: 20241108, physical_filter: 'r_03'} took 52.903 seconds
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Preparing execution of quantum for label=makePsfMatchedWarp dataId={instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800251, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}.
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Constructing task and executing quantum for label=makePsfMatchedWarp dataId={instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800251, band: 'r', day_obs: 20241108, physical_filter: 'r_03'}.
lsst.makePsfMatchedWarp.psfMatch INFO: compute Psf-matching kernel
lsst.makePsfMatchedWarp.psfMatch INFO: Adjusted dimensions of reference PSF model from (27, 27) to (41, 41)
lsst.ip.diffim.generateAlardLuptonBasisList INFO: PSF sigmas are not available or scaling by fwhm disabled, falling back to config values
lsst.makePsfMatchedWarp.psfMatch INFO: Psf-match science exposure to reference
lsst.makePsfMatchedWarp.psfMatch INFO: done
lsst.makePsfMatchedWarp INFO: Copied 5739829 pixels from CCD 5 to exposure_psf_matched
lsst.makePsfMatchedWarp.psfMatch INFO: compute Psf-matching kernel
lsst.makePsfMatchedWarp.psfMatch INFO: Adjusted dimensions of reference PSF model from (27, 27) to (41, 41)
lsst.ip.diffim.generateAlardLuptonBasisList INFO: PSF sigmas are not available or scaling by fwhm disabled, falling back to config values
lsst.makePsfMatchedWarp.psfMatch INFO: Psf-match science exposure to reference
lsst.makePsfMatchedWarp.psfMatch INFO: done
lsst.makePsfMatchedWarp INFO: Copied 2565315 pixels from CCD 8 to exposure_psf_matched
lsst.makePsfMatchedWarp INFO: Total number of good pixels = 8305144
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Execution of task 'makePsfMatchedWarp' on quantum {instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800251, band: 'r', day_obs: 20241108, physical_filter: 'r_03'} took 39.926 seconds
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Preparing execution of quantum for label=assembleDeepCoadd dataId={band: 'r', skymap: 'lsst_cells_v1', tract: 5063, patch: 34}.
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Constructing task and executing quantum for label=assembleDeepCoadd dataId={band: 'r', skymap: 'lsst_cells_v1', tract: 5063, patch: 34}.
lsst.assembleDeepCoadd INFO: Weight of deepCoadd_directWarp {instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800250, band: 'r', day_obs: 20241108, physical_filter: 'r_03'} = 0.004
lsst.assembleDeepCoadd INFO: Weight of deepCoadd_directWarp {instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800254, band: 'r', day_obs: 20241108, physical_filter: 'r_03'} = 0.004
lsst.assembleDeepCoadd INFO: Weight of deepCoadd_directWarp {instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800247, band: 'r', day_obs: 20241108, physical_filter: 'r_03'} = 0.004
lsst.assembleDeepCoadd INFO: Weight of deepCoadd_directWarp {instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800251, band: 'r', day_obs: 20241108, physical_filter: 'r_03'} = 0.004
lsst.assembleDeepCoadd INFO: Weight of deepCoadd_directWarp {instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800246, band: 'r', day_obs: 20241108, physical_filter: 'r_03'} = 0.004
lsst.assembleDeepCoadd INFO: Weight of deepCoadd_directWarp {instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800259, band: 'r', day_obs: 20241108, physical_filter: 'r_03'} = 0.004
lsst.assembleDeepCoadd INFO: Weight of deepCoadd_directWarp {instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800258, band: 'r', day_obs: 20241108, physical_filter: 'r_03'} = 0.004
lsst.assembleDeepCoadd INFO: Weight of deepCoadd_directWarp {instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800255, band: 'r', day_obs: 20241108, physical_filter: 'r_03'} = 0.004
lsst.assembleDeepCoadd INFO: Found 8 deepCoadd_directWarp
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Weight of deepCoadd_psfMatchedWarp {instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800250, band: 'r', day_obs: 20241108, physical_filter: 'r_03'} = 0.541
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Weight of deepCoadd_psfMatchedWarp {instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800254, band: 'r', day_obs: 20241108, physical_filter: 'r_03'} = 0.528
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Weight of deepCoadd_psfMatchedWarp {instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800247, band: 'r', day_obs: 20241108, physical_filter: 'r_03'} = 0.571
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Weight of deepCoadd_psfMatchedWarp {instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800251, band: 'r', day_obs: 20241108, physical_filter: 'r_03'} = 0.554
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Weight of deepCoadd_psfMatchedWarp {instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800246, band: 'r', day_obs: 20241108, physical_filter: 'r_03'} = 0.665
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Weight of deepCoadd_psfMatchedWarp {instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800259, band: 'r', day_obs: 20241108, physical_filter: 'r_03'} = 0.558
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Weight of deepCoadd_psfMatchedWarp {instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800258, band: 'r', day_obs: 20241108, physical_filter: 'r_03'} = 0.534
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Weight of deepCoadd_psfMatchedWarp {instrument: 'LSSTComCam', skymap: 'lsst_cells_v1', tract: 5063, patch: 34, visit: 2024110800255, band: 'r', day_obs: 20241108, physical_filter: 'r_03'} = 0.643
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Found 8 deepCoadd_psfMatchedWarp
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Assembling 8 deepCoadd_psfMatchedWarp
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 8800), maximum=(15199, 8899))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 8900), maximum=(15199, 8999))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 9000), maximum=(15199, 9099))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 9100), maximum=(15199, 9199))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 9200), maximum=(15199, 9299))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 9300), maximum=(15199, 9399))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 9400), maximum=(15199, 9499))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 9500), maximum=(15199, 9599))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 9600), maximum=(15199, 9699))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 9700), maximum=(15199, 9799))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 9800), maximum=(15199, 9899))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 9900), maximum=(15199, 9999))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 10000), maximum=(15199, 10099))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 10100), maximum=(15199, 10199))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 10200), maximum=(15199, 10299))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 10300), maximum=(15199, 10399))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 10400), maximum=(15199, 10499))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 10500), maximum=(15199, 10599))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 10600), maximum=(15199, 10699))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 10700), maximum=(15199, 10799))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 10800), maximum=(15199, 10899))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 10900), maximum=(15199, 10999))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 11000), maximum=(15199, 11099))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 11100), maximum=(15199, 11199))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 11200), maximum=(15199, 11299))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 11300), maximum=(15199, 11399))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 11400), maximum=(15199, 11499))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 11500), maximum=(15199, 11599))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 11600), maximum=(15199, 11699))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 11700), maximum=(15199, 11799))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 11800), maximum=(15199, 11899))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 11900), maximum=(15199, 11999))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 12000), maximum=(15199, 12099))
lsst.assembleDeepCoadd.assembleStaticSkyModel INFO: Stacking subregion (minimum=(11800, 12100), maximum=(15199, 12199))
lsst.assembleDeepCoadd.assembleStaticSkyModel.interpImage INFO: Creating psf model for interpolation from fwhm(pixels) = 3.0 [default]
lsst.assembleDeepCoadd.assembleStaticSkyModel.interpImage INFO: fallbackValueType MEDIAN has been set to 0.0244
lsst.assembleDeepCoadd.assembleStaticSkyModel.interpImage INFO: Interpolated over 0 NO_DATA pixels.
lsst.assembleDeepCoadd.detectTemplate INFO: Setting factor for negative detections equal to that for positive detections: 1.000000
lsst.assembleDeepCoadd.detectTemplate INFO: Detected 2844 positive peaks in 1382 footprints to 50 +ve and 50 -ve sigma
lsst.assembleDeepCoadd.scaleWarpVariance INFO: Renormalizing variance by 1.290639
lsst.assembleDeepCoadd.detect INFO: Setting factor for negative detections equal to that for positive detections: 1.000000
lsst.assembleDeepCoadd.detect INFO: Detected 6 positive peaks in 6 footprints and 5 negative peaks in 3 footprints to 5 +ve and 5 -ve sigma
lsst.assembleDeepCoadd.scaleWarpVariance INFO: Renormalizing variance by 1.281973
lsst.assembleDeepCoadd.detect INFO: Setting factor for negative detections equal to that for positive detections: 1.000000
lsst.assembleDeepCoadd.detect INFO: Detected 1 positive peaks in 1 footprints and 8 negative peaks in 5 footprints to 5 +ve and 5 -ve sigma
lsst.assembleDeepCoadd.scaleWarpVariance INFO: Renormalizing variance by 1.325116
lsst.assembleDeepCoadd.detect INFO: Setting factor for negative detections equal to that for positive detections: 1.000000
lsst.assembleDeepCoadd.detect INFO: Detected 25 positive peaks in 17 footprints and 39 negative peaks in 27 footprints to 5 +ve and 5 -ve sigma
lsst.assembleDeepCoadd.scaleWarpVariance INFO: Renormalizing variance by 1.325765
lsst.assembleDeepCoadd.detect INFO: Setting factor for negative detections equal to that for positive detections: 1.000000
lsst.assembleDeepCoadd.detect INFO: Detected 18 positive peaks in 16 footprints and 52 negative peaks in 28 footprints to 5 +ve and 5 -ve sigma
lsst.assembleDeepCoadd.scaleWarpVariance INFO: Renormalizing variance by 1.347203
lsst.assembleDeepCoadd.detect INFO: Setting factor for negative detections equal to that for positive detections: 1.000000
lsst.assembleDeepCoadd.detect INFO: Detected 86 positive peaks in 53 footprints and 92 negative peaks in 73 footprints to 5 +ve and 5 -ve sigma
lsst.assembleDeepCoadd.scaleWarpVariance INFO: Renormalizing variance by 1.315769
lsst.assembleDeepCoadd.detect INFO: Setting factor for negative detections equal to that for positive detections: 1.000000
lsst.assembleDeepCoadd.detect INFO: Detected 13 positive peaks in 12 footprints and 20 negative peaks in 14 footprints to 5 +ve and 5 -ve sigma
lsst.assembleDeepCoadd.scaleWarpVariance INFO: Renormalizing variance by 1.344281
lsst.assembleDeepCoadd.detect INFO: Setting factor for negative detections equal to that for positive detections: 1.000000
lsst.assembleDeepCoadd.detect INFO: Detected 46 positive peaks in 33 footprints and 36 negative peaks in 21 footprints to 5 +ve and 5 -ve sigma
lsst.assembleDeepCoadd.scaleWarpVariance INFO: Renormalizing variance by 1.320982
lsst.assembleDeepCoadd.detect INFO: Setting factor for negative detections equal to that for positive detections: 1.000000
lsst.assembleDeepCoadd.detect INFO: Detected 76 positive peaks in 48 footprints and 117 negative peaks in 68 footprints to 5 +ve and 5 -ve sigma
lsst.assembleDeepCoadd INFO: Assembling 8 deepCoadd_directWarp
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 8800), maximum=(15199, 8899))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 8900), maximum=(15199, 8999))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 9000), maximum=(15199, 9099))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 9100), maximum=(15199, 9199))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 9200), maximum=(15199, 9299))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 9300), maximum=(15199, 9399))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 9400), maximum=(15199, 9499))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 9500), maximum=(15199, 9599))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 9600), maximum=(15199, 9699))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 9700), maximum=(15199, 9799))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 9800), maximum=(15199, 9899))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 9900), maximum=(15199, 9999))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 10000), maximum=(15199, 10099))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 10100), maximum=(15199, 10199))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 10200), maximum=(15199, 10299))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 10300), maximum=(15199, 10399))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 10400), maximum=(15199, 10499))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 10500), maximum=(15199, 10599))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 10600), maximum=(15199, 10699))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 10700), maximum=(15199, 10799))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 10800), maximum=(15199, 10899))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 10900), maximum=(15199, 10999))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 11000), maximum=(15199, 11099))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 11100), maximum=(15199, 11199))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 11200), maximum=(15199, 11299))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 11300), maximum=(15199, 11399))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 11400), maximum=(15199, 11499))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 11500), maximum=(15199, 11599))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 11600), maximum=(15199, 11699))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 11700), maximum=(15199, 11799))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 11800), maximum=(15199, 11899))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 11900), maximum=(15199, 11999))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 12000), maximum=(15199, 12099))
lsst.assembleDeepCoadd INFO: Stacking subregion (minimum=(11800, 12100), maximum=(15199, 12199))
lsst.assembleDeepCoadd.interpImage INFO: Creating psf model for interpolation from fwhm(pixels) = 3.0 [default]
lsst.assembleDeepCoadd.interpImage INFO: fallbackValueType MEDIAN has been set to 0.3120
lsst.assembleDeepCoadd.interpImage INFO: Interpolated over 72 NO_DATA pixels.
lsst.ctrl.mpexec.singleQuantumExecutor INFO: Execution of task 'assembleDeepCoadd' on quantum {band: 'r', skymap: 'lsst_cells_v1', tract: 5063, patch: 34} took 119.482 seconds
Out[24]:
[<lsst.daf.butler._quantum.Quantum at 0x7eb9dbafb700>, <lsst.daf.butler._quantum.Quantum at 0x7eb9daebb5e0>, <lsst.daf.butler._quantum.Quantum at 0x7eb9dbb58a60>, <lsst.daf.butler._quantum.Quantum at 0x7eb9daee9f60>, <lsst.daf.butler._quantum.Quantum at 0x7eb9daee9c00>, <lsst.daf.butler._quantum.Quantum at 0x7eb9dac9bf40>, <lsst.daf.butler._quantum.Quantum at 0x7eb9dab26260>, <lsst.daf.butler._quantum.Quantum at 0x7eb9daebb340>, <lsst.daf.butler._quantum.Quantum at 0x7eb9daebbbe0>, <lsst.daf.butler._quantum.Quantum at 0x7eb9dbd51120>, <lsst.daf.butler._quantum.Quantum at 0x7eb9db704280>, <lsst.daf.butler._quantum.Quantum at 0x7eb9db7060e0>, <lsst.daf.butler._quantum.Quantum at 0x7eb9dab261a0>, <lsst.daf.butler._quantum.Quantum at 0x7eb9dab26aa0>, <lsst.daf.butler._quantum.Quantum at 0x7eb9db600220>, <lsst.daf.butler._quantum.Quantum at 0x7eb9db633b20>, <lsst.daf.butler._quantum.Quantum at 0x7eb9db7044c0>, <lsst.daf.butler._quantum.Quantum at 0x7eb9db41a620>]
Retrieve the custom deep coadd from the local Butler repository. Retrieve the deep_coadd_predetection dataset type, as that's the output type that the custom coaddition generated.
In [25]:
deepCoadd = out_butler.get('deep_coadd_predetection', tract=my_tract, patch=my_patch,
band='r', instrument='LSSTComCam', skymap='lsst_cells_v1',
collections=executor.quantum_graph.metadata["output_run"])
Display a grayscale image of the custom deep coadd. Note that this custom deep coadd is shallower than the deep coadd provided by default within DP1 for this same tract/patch, as the latter uses all available r-band DP1 exposures.
In [26]:
fig = plt.figure(figsize=(10, 8))
afw_display = afwDisplay.Display(frame=fig)
afw_display.scale('asinh', 'zscale')
afw_display.mtv(deepCoadd.image)
plt.gca().axis('on')
plt.show()
Figure 2: The custom
deep_coaddimage using only the selected subset of input visit images.
3.4. Copy the custom coadd output file¶
The writable Butler repository used for custom coaddition is located within a temporary storage area. The Butler retrieveArtifacts method can be used to retrieve a copy of just the custom coadd output file, without copying intermediate files generated by the processing, and placing the custom coadd output file in a desired location. This can be useful to preserve the custom coadd image file without filling up a significant amount of disk quota in a permanent location. Start by retrieving the dataset reference for the custom coadd image output file.
In [27]:
refs = out_butler.query_datasets('deep_coadd_predetection',
collections=executor.quantum_graph.metadata["output_run"])
As an example, choose to put the copy of the custom coadd output file in your scratch space area.
In [28]:
outdir = os.getenv("SCRATCH_DIR")
Option: instead choose to copy the custom coadd output file to your home directory, where it will not be deleted within a week.
In [29]:
# outdir = os.getenv("HOME")
Copy the FITS file containing the custom coadd image to the desired location.
In [30]:
out_butler.retrieveArtifacts(refs, outdir, preserve_path=False, transfer="copy", overwrite=True)
Out[30]:
[ResourcePath("file:///deleted-sundays/melissagraham/deep_coadd_predetection_5063_34_r_lsst_cells_v1_u_melissagraham_custom_coadd_ecdfs_20250904T023433Z.fits")]
To free up space, delete the writable Butler repository used for custom coaddition. If you wish to continue exploring the writable Butler repository then the following cell can be skipped, though note that the local Butler repo will still be deleted within a week because it is within temporary scratch space. In general, be very careful about any rm -r or similar commands that you run on RSP, as there is potential for inadvertently deleting files you wish to retain.
Option: Skip the final cell below if you wish to continue working with variables previously defined in this notebook and/or continue using your writable Butler repo.
In [31]:
%reset -f
! rm -r $SCRATCH_DIR/my_local_repo