Data Challenges

From CMB-S4 wiki
Revision as of 13:43, 12 June 2017 by Jdborrill (talk | contribs)
Jump to navigationJump to search

At the SLAC meeting it was agreed to separate "experiment definitions" (bands, resolutions, sensitivity level) from "sky models" (LCDM+dust+sync+). Each of these will be designated by a number. The combination of a given experiment definition XX acting on a given sky model YY will be designated XX.YY.

Experiment models, sky models and the datasets obtained by applying for former to the latter will be stored at NERSC in /project/projectdirs/cmbs4/{expt_xx,sky_yy,data_xx.yy}

Experiment Definitions

Experiment Definitions

Input Sky Components

Sky Components

Sky Models

Sky model 00

This is simply LCDM + Gaussian dust + Gaussian Sync. Since the dust and sync levels are set to the levels found in the BICEP/Keck field it wouldn't make any sense to use this model for a large sky fraction.

Sky Model 01

This is PySM run in a1d1f1s1 mode - i.e. with the default settings for AME, dust, free-free and synchrotron.

Sky Model 02

This is PySM run in a2d4f1s3 mode - GitHub for some description of what this means.

Sim Data Sets

01.00

This is the 01 experiment definition acting on the 00 sky model (Gaussian dust and sync). The full 1000 realizations have been generated and are available at /project/projectdirs/cmbs4/data_xx.yy/01.00 in the NERSC system. We can see these maps in this posting. The directory contains the fully combined LCDM+noise+dust+sync realizations, noise-only realizations, and signal-only realizations of lensed LCDM. Some preliminary results of re-analyzing these maps can be found in [Justin's posting] and [Victor's Mar 17] logbook posting.

01.01

This is the 01 experiment definition acting on the 01 sky model. The full 1000 realizations have been generated and are available at /project/projectdirs/cmbs4/data_xx.yy/01.01 in the NERSC system. We can see these maps in this posting. Note that these all contain the same PySM foreground plus randomly permuted LCDM and noise realizations drawn from the sets used for 01.00. The directory contains only the fully combined signal+noise realizations - when analyzing these maps one should use the noise realizations from 01.00.

01.02

This is the 01 experiment definition acting on the 02 sky model. The full 1000 realizations have been generated and are available at /project/projectdirs/cmbs4/data_xx.yy/01.02 in the NERSC system. Note that these all contain the same PySM foreground plus randomly permuted LCDM and noise realizations drawn from the sets used for 01.00. The directory contains only the fully combined signal+noise realizations - when analyzing these maps one should use the noise realizations from 01.00.

NERSC Info

Shared space is available on NERSC, where everyone is welcome to sign-up for an account under the "Data Analysis for Post-Planck CMB Experiments" allocation (PI Borrill). The files are located in the shared CMB-S4 file space (/project/projectdirs/cmbs4). In order to manage this space, all files stored there should be owned by the cmbs4 project account but accessible to the cmbs4 group. To do this:

  • log in to the cmbs4 project account following the instructions [here]
  • sync the files to an appropriate subdirectory in the project space
  • ensure that the permissions are set appropriately (g+rX,o-rwx)

Remember to include a README and to post the details on this wiki page.

For any NERSC issues, including access to the filegroup and/or project account, please contact Julian Borrill.