Indexing and integration
Data processing for "diffract-before-destroy" experiments is a serial, two-step procedure. In the first step, the image is
In practice, indexing and integration for "diffract-before-destroy" experiments is a two-step procedure. The first step consists of hitfinding. The purpose of hit-finding is merely to avoid spending further computational resources on images that quickly can be determined to be blank.
Indexing and integration are tightly coupled; it is impossible to integrate an image without an indexing solution.
For historical reasons, hit-findinding and indexing/integration are implemented in the same module, mod_hitfind
. On instance of mod_hitfind
is configured for hit-finding, while another is configured for indexing and integration.
What action the module takes depends
pyana section
For historical reasons, hit-finding and indexing/integration are both implemented in the same analysis module, called mod_hitfind
. To chain the two functions together, pyana must be configured to pass each event through two different instances of the same module. The two instances are differentiated by their name following the colon. In the example below, the first instance is called hitfind
, and the second is index
.
[pyana] modules = my_ana_pkg.mod_hitfind:hitfind \ my_ana_pkg.mod_hitfind:index
Any instance of an analysis module can signal pyana to skip further processing of the event. In the case above, the hitfind
instance of mod_hitfind
would signal pyana to skip the event if it determines that the image associated with the event is not a hit. In that case, the second instance, index
, will never see the event. Otherwise, the event is fed to the second instance, which will attempt indexing and integration on the associated image.
The pyana-section of the processing configuration used for this part of the tutorial has one more feature.
[pyana] modules = my_ana_pkg.mod_hitfind:hitfind \ my_ana_pkg.mod_dump:hit \ my_ana_pkg.mod_hitfind:index \ my_ana_pkg.mod_dump:indexed
Each instance of mod_hitfind
is followed by an instance of mod_dump
. mod_dump
is a simple module that just outputs the image associated with the event to the file system. In the above configuration, images are written to disk if they are determined to be hits, and then written again—possibly using a different name—if indexing and integration succeeds.
Hit-finding
The configuration for the hitfind
instance of mod_hitfind
is shown below.
[my_ana_pkg.mod_hitfind:hitfind] address = CxiDs1-0|Cspad-0 calib_dir = /reg/neh/home1/hattne/projects/phenix-src/cxi_xdr_xes/cftbx/metrology/CSPad/run4/CxiDs1.0:Cspad.0 dark_path = /reg/d/ffb/cxi/temp/cctbx/tutorials/scratch/brewster/darks/Ds1-r0066-avg.pickle dark_stddev = /reg/d/ffb/cxi/temp/cctbx/tutorials/scratch/brewster/darks/Ds1-r0066-stddev.pickle detz_offset = 581 dispatch = nop distl_flags = permissive distl_min_peaks = 16 threshold = 450 xtal_target = /reg/neh/home1/hattne/projects/phenix-src/labelit_regression/xfel/hitfind-7.1.phil
address
- Full data source address of the DAQ device, see Data Source Address in the Pyana User Manual. This identifies the detector from which images are to be extracted.
calib_dir
- This value defines the initial placement of the detector elements. cctbx.xfel implements its metrology corrections with respect to these initial definitions. As a result, the value of this option should not be changed.
dark_path
- Path to an average image from a dark run (i.e. pedestal) to use for dark-subtraction.
dark_stddev
- Path to a standard-deviation image from a dark run.
detz_offset
- The distance from the interaction region, where the X-ray pulse and the sample jet intersect, and the back of the detector stage, in mm.
dispatch
- What action
mod_hitfind
is to take. The value should benop
for hit-finding, andindex
for indexing. distl_flags
- General behavior of the hit-finder, either
permissive
orrestrictive
. distl_min_peaks
- How many strong, low-resolution peaks are required to classify the image as a hit.
threshold
- How high a peak must be above the background to be classified as strong, in analog-to-digital units (ADU).
xtal_target
- phil-file containing further configuration options for the hit-finder.
Indexing and integration
The result of successfully indexing an image is essentially a model of crystal–beam interaction. The model not only describes how the crystal is oriented with respect to the direction of the X-ray pulse, but also it's degree of imperfection (i.e. mosaicity), and qualities of the illuminating pulse (e.g. bandwidth). The model