# Statistical analysis of tomographic reconstruction algorithms by morphological image characteristics.

INTRODUCTIONThe principle of tomographic reconstruction of a volume from lower-dimensional projections as, e.g., applied in x-ray or electron tomography was mathematically discovered by Radon (1917). For a comprehensive introduction and important aspects of applications see, e.g., Frank (2005), Banhart (2007), and Buzug (2008). Tomographic reconstructions can be computed by a variety of different techniques such as filtered backprojection (FBP) (Feldkamp et al, 1984; Kak and Slaney, 1988), algebraic reconstruction techniques (ART) (Gilbert, 1972; Carazo etal, 2005), geometric tomography (Gardner, 1995) or discrete tomography (Batenburg, 2005; Herman and Kuba, 2007). The comparative evaluation of these algorithms is naturally dependent on the choice of quality criteria. These are mathematically formulated by a figure of merit (FOM) measuring the deviation of a phantom data set from its reconstruction, which is computed from simulated projections of the phantoms. Since ranking of the reconstruction quality provided by different algorithms is FOM-dependent (Herman and Odhner, 1991), FOMs need to be chosen in a task-oriented way (Hanson, 1990). That means, the FOM needs to detect differences in reconstruction quality which are relevant to the further analysis of the tomograms in a specific application, e.g., from medicine or materials science. Typical FOMs for medical applications are based on curves of the receiver operator characteristics. They allow to study the detectability of different tissues and thus the reliability of diagnostics (Herman and Yeung, 1989; Hanson, 1990). There is a large variety of FOMs focusing on the correct reproduction of gray values. The most common representative of gray value oriented FOMs is the mean squared deviation

[MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII.] (1)

which averages over the gray value differences [x.sup.rec.sub.j] [x.sup.phan.sub.j] between all pixeis j in tne reconstruction and the phantom (Gilbert, 1972; Hansis et al, 2008). Alternatively, mean absolute differences of gray values as well as deviations of gray value means and variances in the reconstruction from the respective values of the phantom have been considered (Sorzano et al, 2001). Moreover, phase-specific mean gray values have been used to assess the detectability of different components within a material (Sorzano et al, 2001).

Especially if--as in real experiments--the density to reconstruct is unknown, reconstruction residuals can be a valuable source of information for assessing the quality of a tomogram (Lange et al., 2008). These residuals are obtained by subtracting a simulated projection of the reconstruction from the measured projection for all rotation angles.

All approaches described above focus on global accuracy of the reconstruction, whereas evaluation results can hardly be interpreted with respect to the preservation of locally defined image characteristics such as little cracks in the material or the exact shape of phase boundaries. Correct reconstruction of locally defined characteristics is however crucial for unbiased computation of morphological image characteristics such as connectivity, boundary length or surface area. Quantitative information on these characteristics is a valuable source of information in a wide range of applications such as metrology (Neuschaefer-Rube et al., 2008), pathology (Mattfeldt et al., 2007), environmental health (Stoeger et al., 2006) or design of materials (Frost et al., 2006). We therefore suggest to directly incorporate measurements of morphological image characteristics into the FOMs used to evaluate tomographic reconstruction algorithms. Apart from measurements of phase boundary length and surface area (see, e.g., Park et al., 2000) many other morphological characteristics such as connectivity (Ohser and Schladitz, 2008) and fractal dimension (Baumann et al., 1993) are sensitive to the shape of phase boundaries. We nevertheless decided to assess local reconstruction quality along phase boundaries by measuring deviations in boundary length between the original 2D phantom images and their tomographic reconstructions. Other approaches, which have been suggested to study reconstruction quality with focus on the vicinity of phase boundaries, are based on weighted averaging of gray value deviations between phantom and reconstruction (Sorzano et al., 2001), where weighting is with respect to distance from phase boundaries. In contrast to this FOM our method provides a direct assessment of reconstruction quality in terms of quantitative morphological image analysis. Previous methods to locally evaluate reconstruction quality consider average gray value deviations within certain regions of interest (Furuie et al., 1994) and thus have the additional disadvantage that these regions need to be specified a priori.

The two principle questions arising in comparison of reconstruction algorithms ask for the relevance and for the significance of differences in reconstruction quality, respectively. Relevant differences can possibly be detected by computation ofan appropriately chosen FOM for a single phantom such as the well-known section of a head introduced in Shepp and Logan (1974). The use of such deterministic input offers the advantage that specific features which typically present challenges for correct reconstruction (e.g., certain gray value gradients) can be incorporated. However, insights with respect to the statistical significance of differences in reconstruction quality can only be gained if instead of a small number of deterministic phantoms a sufficiently large sample of random phantom data is investigated (Herman and Yeung, 1989; Hanson, 1990; Matej et al., 1994 and 1996; Herman, 2009). This way statistical tests can be applied to compare reconstruction errors caused by different algorithms. Many types of artifacts in tomographic reconstructions such as smearing or stripes result from the relative positions of single objects within the scene to be reconstructed (Hanson, 1990). Thus, a sample of random phantoms resembling the experimentally occurring range of scenes ensures that statistically significant errors of this type are taken into account, whereas they may not even occur in deterministic phantom data. To the best of our knowledge in previous studies samples of phantoms have only been generated under moderate randomization with respect to object positioning. In particular, objects were clearly separated from each other (Hanson, 1990). For studies discussing detectability of tumors in biological tissue potential tumor locations were even fixed a priori and random effects were limited to Bernoulli experiments marking the sites as occupied by a tumor or by regular tissue (Herman and Yeung 1989; Hanson, 1990). Compared to these images the phantoms considered in our study exhibit a substantially higher morphological variability. They are realizations of a model from stochastic geometry, namely a 2D Boolean model consisting of overlapping discs (Molchanov, 1997; Schneider and Weil, 2008), which are placed at randomly chosen locations within the image (for details see Section Phantom Data). Thus, our phantom data reflect properties of composite or porous materials with an irregular spatial structure, which nevertheless exhibit spatial homogeneity in the sense of stochastic geometry. Repeated sampling from the Boolean model sets us in a position to compare reconstruction errors of different algorithms by two-sample-goodness-offit tests. In this way, differences in reconstruction quality of two algorithms can be assessed on a statistically sound basis. The approach we suggest occurs particularly natural for the selection of tomographic reconstruction algorithms in applications aiming at the quantitative analysis of complex materials. For a specific experimental setting, the methodology suggested in this study can be adapted to phantom data sets resembling structural properties of the experimentally investigated material. Additionally, artifacts related to the specific imaging technique or even to a specific experimental instrument need to be taken into account. Simulations of projections would thus, e.g., incorporate noise, beam hardening, limited rotation or alignment problems (Carazo et al, 2005; Haibel 2008).

In the following the suggested methodology will be applied to investigate the performance of standard FBP algorithms in comparison to the innovative reconstruction technique DIRECTT (Direct Iterative Reconstruction of Computed Tomography Trajectories) (Lange et al, 2008). The phantom data will be two-dimensional. In many applications such as electron tomography, projections are acquired in parallel beam geometry. As a consequence, tomograms of 3D volumes are a stack of 2D reconstructions from ID projection data. Thus, in parallel beam geometry our results on 2D datasets are also relevant for the 3D case. The exact consequences for 3D morphological image analysis remain an interesting subject for future applications of our methodology.

We will see that the applied FBP algorithms alter the structure of phase boundaries in such a way that boundary length measurements are substantially affected whereas the DIRECTT reconstructions preserve boundary structures in a much better way. In a first step we will demonstrate these effects for projections of phantoms without noise (referred to as 'ideal projections' below). Afterwards we will show that the superiority of the DIRECTT reconstruction remains valid under the addition of simulated noise to the projection data.

The paper is organized as follows. After discussing phantom generation and simulation of projections we give an introduction to the investigated reconstruction techniques in order to illustrate their principle ideas to a non-expert reader. Then we briefly discuss the estimation techniques for measuring boundary length, leaving additional details for the appendix. Furthermore, we introduce the FOMs serving as basis for the evaluation and the statistical tests we applied. We conclude by the presentation of the results and their discussion.

METHODS

PHANTOM DATA

The phantoms projected and reconstructed for this study were discretized versions of realizations of Boolean models in 2D, which were sampled on an observation window W = [[0,500].sup.2] (Fig. 1a). Boolean models are a class of random closed sets whose construction is based on a homogeneous Poisson point pattern [{[S.sub.n]}.sub.n [greater than or equal to] 1]. In our specific setting we used a Boolean model which is defined as the union B = [U.sup.[infinity].sub.n = 1] B([S.sub.n], r) of circles B([S.sub.n],r) of radius r = 10 centered at [S.sub.n]. The intensity of the homogeneous Poisson process on [R.sup.2] determining the random locations [{[S.sub.n]}.sub.n [greater than or equal to] 1] was chosen such that the mean number of points in W = [[0,500].sup.2] was 1200. Since reconstructions are pixel images, throughout our study we investigated discretized realizations of this Boolean model on a grid of 500 x 500 pixels. The gray value of each pixel was chosen proportional to its area fraction covered by the realization of the Boolean model. Notice that gray values are chosen independently of the number of circles covering a location. All gray values were rounded to integers and the maximum gray value was set to 255. In order to allow for statistical analysis, 100 independent realizations [b.sub.1], ..., [b.sub.100] of B were generated and discretized.

SIMULATION OF IDEAL AND NOISY PROJECTIONS

Projections were performed in parallel beam geometry. The sample was rotated in steps of 0.5[degrees] up to a maximum angle of 180[degrees]. For the ideal projections model elements were projected individually and added to the sinogram, i.e., we performed a projection of mass (or density, resp.) instead of intensities. This approach is equivalent to integration over strips of detector width, and thus reflects that detector elements as well as the pixels of the phantom are not points but area elements. The detector elements had exactly the same size as the reconstruction pixels. The original observation window was extended by a two pixel edge of zero entries on all sides. The rotation axis was set at the windows' center. In order to ensure complete visibility of the reconstruction pixels under all projection angles, the length of the line detector was chosen sufficiently large.

In order to assess the impact of noise on the reconstruction results we simulated intensity sinograms under a noisy X-ray source. Other experimental artifacts such as cross-talking, focal smearing, beam hardening or limited dynamic range (non-linearities in detection) were not simulated. For the noisy intensity measured at detector location % under rotation angle y one obtains the approximative formula

[I.sub.y]([xi]) = [X.sub.[xi], [gamma]] exp(-[p.sub.[gamma]]([xi])), (2)

where the process {[X.sub.[xi], [gamma]]} denotes Gaussian white noise with fixed expectation [EX.sub.[xi], [gamma]] = [mu] > 0 and variance [VarX.sub.[xi], [gamma]] = [[sigma].sup.2] > 0 and [p.sub.[gamma]]([xi]) denotes the corresponding ideal projection of density for a given object. This approximates a Poisson-distributed number of X-ray quanta with high expectation (Buzug, 2008). Notice that for each detector location [xi] and rotation angle y the recorded intensity [I.sub.[gamma]]([xi]) has a normal distribution. However, expectation and variance differ from the respective values of the initial intensity [X.sub.[xi], [gamma]] and are given by [mu] exp(-[P.sub.[gamma]]([xi])) and [[sigma].sup.2] exp [(-[p.sub.[gamma]]([xi])).sup.2], respectively. Thus, the stochastic counting rate at the detector depends not only on the input intensity but also on the projected object. The noise level is expressed by the signal-to-noise-ratio (SNR) [mu]/[sigma]. In an experimental setting under Gaussian approximation of Poisson noise one has [sigma] = [square root of ([mu])]. However, for simulation purposes we fixed [mu] and varied o, since the parameter of interest was the SNR rather than the absolute value of the initial intensity.

[FIGURE 1 OMITTED]

TOMOGRAPHIC RECONSTRUCTION ALGORITHMS

Filtered backprojection

A standard technique for the tomographic reconstruction of projection data is filtered backprojection (FBP) (Feldkamp et al, 1984; Kak and Slaney, 1988). FBP is widely utilized in computed tomography using X-rays (Buzug, 2008) as well as electrons (Carazo et al, 2005). In the following we will briefly summarize the mathematical foundations of FBP.

Let f: [R.sup.2] [right arrow] [0, [infinity]) denote a density distribution on [R.sup.2] with bounded support which is to be reconstructed from the set of projections {[p.sub.[gamma]]: [gamma] [member of] [0,2[pi])} where [gamma] denotes the rotation angle. A single projection [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII.] is an integral taken along the line

[MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII.] (3)

which is perpendicular to the first axis rotated by y and has distance [xi] from the origin. The mathematical key ingredient of FBP is the Fourier slice theorem. For the Fourier transform [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII.] of a projection Pyiff) at a fixed rotation angle [gamma] [member of] [0,2[pi]) the Fourier slice theorem states the identity (cf. Buzug, 2008)

[P.sub.[gamma]](q) = F(qcos([gamma]), q sin([gamma])). (4)

That is, the Fourier transform of the onedimensional projection at rotation angle [gamma] corresponds to the slice of the two-dimensional Fourier transformed object F passing through the origin in direction [gamma]. Substituting polar coordinates in the formula of the inverse Fourier transform and a subsequent application of the Fourier slice theorem yields the identity (for details cf. Buzug, 2008)

[MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII.] (5)

The most commonly used FBP algorithm is based on this formula and organized as follows. In a first step the Fourier transforms [P.sub.[gamma]](q) of the projections are computed. These are subjected to an inverse Fourier transform after radial weighting by the factor [absolute value of q], which yields filtered projection images. Backprojections without weighting result in a convolution of the image to be reconstructed with the point spread function 1/[parallel]x[parallel] (Buzug, 2008). In practice, the transforms are naturally done by discrete (inverse) Fourier transforms of the discretely sampled signal. In the backprojection step, for every pixel of the discrete output image the corresponding position on each filtered projection image is determined and the corresponding value is added to the sum which discretizes the outer integral in Eq. 5. Since this position will in most cases be a non-integer pixel position, interpolation schemes need to be applied to neighboring pixels. By Shannon's sampling theorem, at a given real space sampling distance [DELTA][xi] the signal can only be correctly reconstructed up to a frequency Q = [(2[DELTA][xi]).sup.-1] in Fourier space. Thus, the radial weighting by the function [absolute value of q] in Eq. 5 is only reasonable for [absolute value of q] < Q. In other words, the sampling scheme imposes a band limitation which naturally determines the range of integration in the discrete approximation of the inner integral in Eq. 5. In applications high frequencies are often considered as noise. Therefore, in practice frequencies are not weighted radially but the filter function is replaced by a modified version [absolute value of q] W(q), where W(q) is a window function that decreases the weight of the high frequency band. Apart from a simple cutoff at frequency [q.sub.max] (i.e., setting [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII.] (Ramachandran and Lakshminarayanan, 1971), a variety of smoother kernel functions have been suggested, which suppress undesired local extrema in the reconstructions (cf. Buzug, 2008). A less commonly used alternative algorithm to the real space FBP outlined above directly exploits the sampling on a polar grid, which is determined by the Fourier slice theorem (Sandberg et al, 2003). This Fourier space algorithm is more efficient than real space FBP if the number of projections is sufficiently large. Moreover, it allows for higher order spline interpolation of the data without additional cost. In order to monitor the impact of the FBP algorithm, reconstructions were computed by the real space and the Fourier space approach. The latter will be referred to as 'fast FBP'. For this study the implementation of the fast FBP provided by the IMod software (Kremer et al, 1996) was applied. Notice that the license for this component is not included in the standard version. In order to assess the influence of specific implementations on the reconstruction quality of the commonly used real space FBP we computed real space FBPs by two different software packages namely Inspect3D (version 3.0, FEI company[TM]) and the IMod software (version 3.11.2).

An unmodified radial filter with simple cutoff was used for comparison of FBP to other reconstruction techniques. The cutoff frequency was set to the maximum spatial frequency that could occur in our image data. We will nevertheless demonstrate the effect on reconstructions which is caused by switching to a Gaussian decay of the filter function at varying cutoff frequencies.

Both software packages we applied are designed to reconstruct 3D volumes from 2D projections. However, the software backprojects each 2D slice of the volume separately and thus each sample of our 2D phantom data could be considered as a single slice of a 3D volume. Sample reconstructions can be found in Fig. 1.

DIRECTT

The algorithm DIRECTT (Lange et al, 2008) represents a promising alternative to conventional reconstruction algorithms such as FBP or ART. Fig. 2 schematically displays the algorithm's iterative philosophy. The 2D algorithm is applicable to parallel as well as fan beam geometry of projection. In the following we study parallel beam projections as illustrated in Fig. 2, which are computed in strips for each detector element. Fig. 2a (top left) indicates a model volume at the example of a 14 pixel object. Fig. 2b (bottom left) represents the respective density sinogram (Radon transform (Radon, 1917)) which is either achieved by computed projection of model densities (Fig. 2a) or is the initial experimental intensity data converted according to Lambert-Beer's law (cf. Buzug, 2008). Demanding that each element of the reconstruction array corresponds to exactly one sinusoidal trajectory of the sinogram (Fig. 2b), the DIRECTT algorithm selects pixels, i.e., area elements, corresponding to trajectories of dominant weight for an update of the reconstruction. The given density sinogram can optionally be filtered along the detector direction. This is helpful to avoid artifact formation equivalent to the effects of an unfiltered backprojection. However, an intriguing feature of DIRECTT is that adaptations of the filter function can be used to evaluate trajectories with focus on specific aspects of interest such as mass or contrast. Switching filters between subsequent iteration steps can be used to incorporate a variety of different aspects of the image into the reconstructions step by step. Let the discrete sinogram be given by the matrix S = ([s.sub.ij]), such that i = 1, ..., N and j = -l, ..., l, where N denotes the number of projection angles and 2l + 1 is the number of detector elements. Then the filtered sinogram is given by the matrix [S.sup.*], where the ith row [s.sup.*.sub.i] of [S.sup.*] is obtained by a convolution of the ith row [s.sub.i] of S (extended by l zeros at both ends) with the discrete filter function c : {-2l, ..., 2l} [right arrow] R, more precisely [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII.].

Computation of the DIRECTT reconstructions in the present study involved switching between two different filter functions. The first six iteration steps were performed after application of the mass filter

[MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII.]

The subsequent steps of iteration (fourteen for reconstructions of ideal projections) were based on contrast-filtered sinograms, where the contrast filter [c.sub.c] is given by

[MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII.]

The weights of all possible trajectories (corresponding to integer reconstruction positions) are computed by averaging along the respective traces within the optionally filtered sinogram. This involves interpolation between neighboring sinogram pixels corresponding to different detector elements. This is a substantial difference to FBP, where interpolation is performed in Fourier space (fast FBP) or in the backprojection step after the sinogram has been (inversely) Fourier transformed and filtered (real space FBP).

In the update step of DIRECTT, a fraction of the trajectory weight is added to the respective area element in the reconstruction array if the weight ranks within a predefined top percentage of all trajectory weights. This is illustrated in Fig. 2c, where 11 out of the 14 original elements in the example have been added. The projection (Radon transform) of the reconstruction array (i.e., a computed sinogram) is then subtracted from the original data set. The obtained residual sinogram (Fig. 2d, containing trajectories of 3 remaining elements in the example) is subject to the same procedure in the subsequent iteration steps until a pre-selected criterion of convergence is reached. This procedure can be described as an iterative Radon and inverse Radon transform. In contrast to FBP there is no integral computation along the line detector (including limited sampling due to its element size) but an optional over-sampling along the numerous projection angles. One of DIRECTT's unique characteristics is its very precise projection of reconstruction elements taking into account their actual size and shape which is essential for enhanced spatial resolution. That is, reconstruction pixels are considered as a set of densely packed elements instead of being (circularly smeared) point functions only. Hence, all previously described calculations are performed based on squared area elements in a Cartesian matrix. DIRECTT is of particular interest when the focus is on reconstruction of finely structured details or on precise location of reconstructed elements rather than on computing time. In contrast to FBP, DIRECTT does not treat each (detector) projection individually, i.e., it is not deconvolved globally or (Fourier) filtered, but the entire trajectory of a reconstruction element is considered over all projections. In contrast to ART, DIRECTT does not modify the entity of all reconstruction elements simultaneously.

[FIGURE 2 OMITTED]

ESTIMATION OF AREA AND BOUNDARY LENGTH

For the evaluation of reconstruction algorithms we compared the area as well as the boundary length as measured by two different computational methods in the discretized input data to values found for the various reconstructed images. Notice that we are interested in the boundary length and area of the discretized version of the entire Boolean model B = [U.sup.[infinity].sub.n = 1] B([S.sub.n], r) rather than in the cumulated morphological characteristics of the single circles B([S.sub.n], r), n [greater than or equal to] 1. Comparison of morphological image characteristics requires a binarization of the images, which was done by simple thresholding, where the threshold parameter was set to 50% of the maximum grey value. In order to exclude bias by pure scaling differences, thresholding was done after normalizing the gray values of each image in such a way that the average gray values occurring in the background and the foreground phase were set to 0 and 255, respectively.

Any attempt to measure morphological characteristics of a discretized set faces the problem that the shape of the set before discretization cannot be reconstructed from the pixel image. In order to estimate the foreground area we applied the natural approach of counting the number of foreground pixels. For estimating the original boundary length, different formulae from integral geometry and stereology can be exploited. Nevertheless, estimation results and consequently approximation errors are more than likely to differ with respect to the estimation method chosen. In order to ensure reliability of our statistical results on reconstruction quality, we therefore implemented two different methods for measuring the boundary length of the foreground phase.

The first method we applied has been introduced in Klenk et al. (2006) and further discussed in Guderlei et al. (2007). It will be referred to as the Steiner method since it is based on a discretized version of a Steinertype formula known from the geometry of poly convex sets. Details of this method are given in the appendix. As input parameter the algorithm needs a sequence of so-called dilation radii [r.sub.1] ..., [r.sub.n]. Measurement results are dependent on the choice of [r.sub.1] ..., [r.sub.n]. Therefore, for our investigations we used two different sets of dilation radii. The first choice [r.sub.i] = 4.2 + 1.3i, i = 1, ..., 1000, was suggested in Guderlei et al. (2007), whereas the second choice [r.sub.i] = 0.4 + 0.09i, i = 1, ..., 158, was optimized to obtain results whose mean coincides with the theoretical mean boundary length of the Boolean model used for phantom generation. The corresponding mean value formulae of Boolean models can be found in Schneider and Weil (2008).

The second method we applied in order to measure the boundary length of the input images and the reconstructed data is discussed in Ohser and Mucklich (2000) and will be referred to as the Cauchy method. It approximates the boundary length of a discretized set by a discrete analog of Cauchy's surface area formula, which expresses the boundary length L(K) of the set K as an integral of the total projection length of K over all directions (see appendix). The algorithms discussed in this section were implemented in the Geostoch software library (Mayer et al., 2004).

STATISTICAL TESTS FOR COMPARISON OF RECONSTRUCTION ERRORS

Reconstruction algorithms were statistically compared via the empirical probability distribution of the reconstruction error. The error was defined as relative deviation of the morphological characteristics on the reconstructions from the phantom data. The morphological characteristics measured were boundary length and area of the foreground. The following definition of reconstruction error is given for the example of a measurement method for the boundary length which leads to an estimator [??] for this morphological characteristic. Effects of different reconstruction algorithms on area measurements were compared in an analogous way.

Given two reconstruction algorithms [A.sub.1] and [A.sub.2] and an estimator L for the boundary length, for the phantoms [b.sup.phan.sub.1], ..., [b.sup.phan.sub.100] and their reconstructions [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII.] the relative reconstruction errors

[MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII.] (6)

were computed for i = 1, ..., 50. Since the phantoms [b.sup.phan.sub.100], ..., [p.sup.phan.sub.100] were discretized versions of independently sampled realizations of a Boolean model, the entire collection of errors from the two samples [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII.] inherited stochastic independence. Consequently, two-sample-goodnessof-fit tests could be applied in order to compare the two distributions the error samples [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII.] and [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII.] were drawn from. Given a pair of reconstruction algorithms [A.sub.1] and [A.sub.2], KolmogorovSmirnov (KST), Wilcoxon rank (WRT) and AnsariBradley (ABT) tests were performed. For KST and WRT two different null hypotheses were considered, firstly that the cumulative distribution functions (CDF) [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII.] and [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII.] of the error distributions are equal, and secondly, that the error of algorithm [A.sub.1] tends to be smaller than the one produced by [A.sub.2] in the stochastic sense defined below.

--The Kolmogorov-Smirnov test checks the null hypothesis [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII.] for all x [member of] R against the two-sided-alternative that the values of the two CDFs differ for some x [member of] R. Any differences between the two samples will lead to the rejection of [H.sub.0] if they are too large in the statistical sense. In the one-sided version of the KST the null hypothesis [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII.] for all x [member of] R is tested, which would imply that the first sample of [A.sub.1] statistically consists of smaller values than the second one. For details see Conover (1971, p. 309) and Gibbons (1985, p. 127).

--The Wilcoxon rank test is equivalent to the Mann-Whitney U-test. It is especially sensitive to deviations in the location parameters of [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII.] and [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII.], i.e., it is used to determine whether one of the distribution functions is shifted relative to the other. If the random variables [X.sub.1] and [X.sub.2] have CDFs [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII.] and [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII.], respectively, the two-sided version of the WRT tests [H.sub.0] : P([X.sub.1] > [X.sub.2]) = 1/2 against [H.sub.1]: P([X.sub.1] > [X.sub.2]) [not equal to] 1/2. Thus, differences in variabilities of reconstruction errors within the two samples will not lead to the rejection of [H.sub.0] as easily as differences in the means or medians of the two samples. The one-sided version tests [H.sub.0]: P([X.sub.1] < [X.sub.2]) [greater than or equal to] 1/2 against [H.sub.1]: P([X.sub.1] <[X.sub.2]) < 1/2, i.e., whether the sample of [A.sub.1] is statistically smaller than the second sample. For mathematical details, see, e.g., Gibbons (1985, p. 164) and Lehmann and Romano (2005, p. 243).

--The Ansari-Bradley test assumes that [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII.] for all x [member of] R, an unknown nuisance parameter m used to normalize the location of the sample and some scaling ratio [theta] > 0. The test focuses on the question if the distributions differ in dispersion rather than in location. Thus, the ABT tests [H.sub.0]: [theta] = 1 against [H.sub.1]: [theta] [not equal to] 1. Onesided alternatives are possible but not considered in this study. Details can be found in Gibbons (1985, p. 179).

For all tests in this study version 2.8.1 of the R programming language (R Development Core Team, 2007) was applied. Test results are given in terms of a p-value, which is the largest level of significance at which the null hypothesis is not rejected.

RESULTS

Reconstruction errors are visualized by boxplots (Figs. 3-6). The box depicts the median and the (possibly approximated) quartiles of the data. The centered vertical lines show the smallest and largest observations if their distance from the box does not exceed 1.5 times the box size. More extreme values within the sample are plotted as circles. Note that in the boxplots we consider signed relative errors, where these quantities are defined as in Eq. 6 but without taking absolute values. However, all statistical tests are based on unsigned relative errors.

RECONSTRUCTIONS FROM IDEAL PROJECTIONS

For DIRECTT the classic FOM of MSD defined in Eq. 1 had a value of 0.0139, whereas the corresponding values for the FBP algorithms were in the interval between 0.069 and 0.074, with best results for the Inspect3D software and the highest error measured for the standard FBP in IMOD (Fig. 3). Although very small, the differences in MSD between the FBP techniques were found to be statistically significant by KST and WRT. This is plausible since there was hardly stochastic variability in the single MSD samples.

[FIGURE 3 OMITTED]

The area measurements of the foreground phase behaved rather stable under all reconstruction algorithms and relative errors were only at the level of few per mille (Fig. 4). Errors fluctuated around 0 for DIRECTT and were only around 0.002 for the fast FBP and the Inspect3D software. The standard FBP implemented in IMod showed a slightly increased error level of around 0.006. KST and WRT classified the differences between the algorithms as statistically significant, though the absolute level was very small.

Boxplots in Fig. 5 indicate that the signed relative errors for measurements of boundary length differed between reconstruction algorithms. Stochastic variability of the errors within the sample was similar for all four reconstruction algorithms as indicated by the high p-values of the Ansari-Bradley test (Table 1). In the DIRECTT reconstructions the Steiner method measured a decrease in boundary length of around 1.5% and the Cauchy method a decrease of around 0.5% in comparison to the original phantoms. However, the FBP algorithms produced significantly higher relative errors than DIRECTT as indicated by the p-values of the tests in their one-sided versions in Table 1. The error produced by the fast FBP algorithm was significantly smaller than the error produced by the standard FBP implemented in IMod, which in turn was slightly but significantly smaller than the error found in the FBP reconstruction done with Inspect3D.

[FIGURE 4 OMITTED]

For all reconstruction algorithms error levels depended on the method used to measure boundary length. Averaging over all three FBP implementations, the Steiner method yielded a slightly stronger decrease in boundary lengths of around 13%. The choice of radii for the Steiner method had only a hardly noticeable impact on the measurements of relative errors (Fig. 5a vs. Fig. 5b). In summary, it should be emphasized that on the FBP-reconstructions all methods of measurement consistently indicated a decrease of boundary length in comparison to the original phantoms, whereas the deviation on the DIRECTT reconstructions was significantly smaller. All p-values of tests for equality of error distributions were so small that the KST as well as the WRT detected differences when the level of significance was set to [alpha] = 0.001/2. This in particular implies that the hypothesis of equal error distributions was rejected in a Bonferroni-corrected setting for multiple testing at level [alpha] = 0.01. The latter defines that a hypothesis [H.sub.0] is rejected at a level a once a single one of n tests performed on the same data rejects [H.sub.0] at level [alpha]/n. As a consequence, the probability of a false rejection is bounded by [alpha], which in most cases is quite a conservative estimate for the type 1 error of the test.

[FIGURE 5 OMITTED]

The cutoff frequency, at which FBP algorithms switch from highpass to Gaussian filtering of the Fourier transformed projections before backprojecting them, had a noticeable impact on the error in boundary length measurement. Suppression of high frequencies increased the relative deviation in boundary length measurements on the reconstructions from the original images independently of the method of measurement (Fig. 6).

[FIGURE 6 OMITTED]

RECONSTRUCTIONS FROM NOISY PROJECTIONS

The sensitivity of the relative error in boundary length measurements to noise in the projection data was investigated for the DIRECTT algorithm and FBP (Fig. 7). Since the errors of the different FBP algorithms were of similar order, we chose the standard FBP implementation of IMod for the comparison. Empirical 96% confidence intervals were computed from the two error samples under ideal projections. SNRs were considered between 50 and 400 in steps of 50. For each SNR a phantom was picked at random and noise was added to its projections as described in Section "Simulation of ideal and noisy projections". These were then used as input data for DIRECTT and FBP.

[FIGURE 7 OMITTED]

For noisy projections the quality of the DIRECTT reconstructions improved in terms of MSD over the first iterations but from a certain point on decreased again. This deterioration of the reconstruction quality occurs when the residual sinograms are dominated by noise and thus, further iterations introduce erroneous information into the reconstructions. The number of iterations for the DIRECTT reconstructions under noise evaluated in Fig. 7 was chosen such that MSD was minimized. Fig. 7 shows that the error of the DIRECTT reconstructions under noise was not contained in the confidence interval of the error under ideal projections. For SNRs higher than 150 the FBP reconstructions from noisy input data stayed within or close to the range of error under ideal projections. Nevertheless, the relative loss in boundary length caused by DIRECTT was in all cases less than in the FBP reconstructions. SNRs of less than 20 did not yield reasonable reconstruction results.

DISCUSSION

Our results demonstrate that standard FBP reconstruction algorithms for projection data may alter the boundary structure of two-phase phantom images in such a way that measurements of boundary length are substantially affected. As a standard gray value oriented global measure of reconstruction quality, MSD already indicated errors in the FBP reconstructions. Locally defined image characteristics such as phase boundaries and quantitative image characteristics can however hardly be related to global integral FOMs such as MSD in a direct way. Thus, for monitoring reconstruction artifacts distorting fine details and their consequences for quantitative image analysis it is important to consider alternative FOMs. In this context boundary length measurements can be a valuable source of information since they are sensitive to changes of local pixel configurations. Corresponding FOMs can thus provide a more comprehensive view on reconstruction quality.

Apart from boundary length also other characteristics frequently considered in quantitative morphological image analysis and spatial statistics such as connectivity (Ohser and Schladitz, 2008; Thiedmann et al, 2009), spherical contact distribution function (Mayer, 2004; Thiedmann et al, 2008) and fractal dimension are dependent on adequate reproduction of phase boundaries. Since we have seen that FBP algorithms alter the structure of phase boundaries, estimation of these image characteristics from FBP reconstructions occurs to be problematic, even if comparative studies of different materials or scenarios may still be possible. On the other hand, foreground area showed very limited sensitivity to the reconstruction artifacts produced by FBP algorithms. Thus, measurements of foreground area can be regarded as stable with respect to standard FBP techniques.

Our evaluation was based on a set of phantom images consisting of discretized realizations of a Boolean model, which were independently sampled. Therefore, classical two-sample tests could be applied to compare the errors of different algorithms. Since differences between error distributions of boundary length measurements for the considered reconstruction algorithms were rather pronounced (see the boxplots in Fig. 5) the unambiguous p-values of the KolmogorovSmirnov and the Wilcoxon rank test in Table 1 were to be expected. The Ansari-Bradley test indicated that dispersion of the error samples was not significantly different between algorithms and was probably mainly controlled by the stochastic variability of the phantom data.

The testing methodology we suggested can be transferred to any other FOM and set of randomly sampled phantom data. This way also subtle differences in reconstruction quality can be evaluated with statistical rigor. It should again be emphasized that a statistical approach to the evaluation of reconstruction quality essentially relies on randomly sampled phantoms. Reconstruction of deterministic phantom data is a valuable tool to investigate the capability of reconstruction algorithms to reproduce certain predefined image features. An approach based on randomly sampled phantoms is complementary since it can be used to monitor the statistical significance of errors produced by reconstruction algorithms. This information is especially important for the quantitative investigation of irregularly structured materials.

Throughout this study the relative error in boundary length was measured by two different techniques and--for the Steiner method--two choices of parameters. This way bias introduced by boundary measurement techniques could be excluded. Since the methods are based on discrete approximations of different formulae for the boundary length of a polyconvex set (see Appendix), deviations in measurement results naturally occurred. Although relative errors measured by the Cauchy method were found to be slightly smaller than the errors measured by the Steiner method, qualitative as well as statistical findings agreed for all methods applied. Thus, our findings were not tied to a specific measurement approach.

In order to relate the errors caused by the general technique of FBP to the effect caused by different algorithmic approaches, FBP reconstructions were conducted by the standard real space FBP and the fast FBP algorithm suggested by Sandberg et al, 2003. Moreover, for the real space FBP two different implementations from the IMod software and the Inspect3D package were compared. The reconstruction errors as assessed by the relative boundary length were found to be qualitatively similar for all three FBP implementations, even if the fast FBP yielded significantly better results than the two real space algorithms. The statistical significance of the differences in FBP reconstruction errors produced by the real space FBP in IMod and the Inspect3D software suggest that the performance of FBP techniques depends on their implementation. It should however again be pointed out that error levels are very similar and our qualitative findings are implementation-independent. It should also be emphasized that rankings of implementations can only be given with respect to a specific FOM. This is clearly illustrated by the rankings of the Inspect3D reconstructions which exhibit a higher boundary error than the other FBP reconstructions but performed best within the FBP group with respect to MSD. This rather good representation of gray values is possibly the consequence of the 16 bit image representation used in Inspect3D, whereas IMod computes reconstructions based on 8 bit images. Principle sources of errors in real space FBP algorithms are the interpolation schemes applied in the backprojection step. Both real space FBP implementations used a computationally fast linear interpolation. The slight superiority of the fast FBP is possibly the result of the Fourier space approach, which may reduce interpolation errors along boundaries.

Cutoff frequencies applied in FBPs can hamper correct reconstructions of phase boundaries in a substantial way (Fig. 6). This effect is plausible since edges are represented by high frequencies in Fourier space. It can also be expected to occur for other types of window functions which reduce the impact of high frequencies in comparison to simple radial weighting.

For ideal projection data DIRECTT presented itself as a powerful reconstruction algorithm, which reproduced phase boundaries in an almost perfect way. This has been achieved under the simple but essential assumptions of homogeneous density within the pixels, regarded as area elements, and identical pixel sizes within the model, the detector and the reconstruction. First tests with DIRECTT however indicated that the reconstruction quality is still remarkable when pixels of smaller size than the detector elements are reconstructed (Lange and Hentschel, 2007).

In order to challenge the results obtained for noiseless projections, noise of different level was added to the projection data of single randomly chosen phantoms and the reconstruction results of DIRECTT and FBP were compared. The FBP reconstructions exhibited a high noise tolerance, since the relative error in boundary length measurement did hardly leave an empirical 96% confidence interval that had been computed for the ideal projections (Fig. 7). This shows that under noisy projections the reconstruction error in the phase boundaries is not dominated by the noise but by properties of the FBP technique. The DIRECTT reconstructions reacted more sensitively to the noise, since the errors increased and were outside the 96% confidence interval for the DIRECTT reconstructions under ideal projections. Nevertheless, in all cases the DIRECTT reconstructions exhibited a substantially smaller error than the FBP tomograms. Thus, the improvement in reconstruction quality that can be achieved by DIRECTT appears to not to be limited to ideal sets of input data but can also be expected in experimental settings. The simulated projections of pixel data serving as input for the reconstruction algorithms do not exactly describe a tomographic experiment with a spatially continuous material. However, our methods chosen for the transformation of the spatially continuous realizations of the Boolean model into pixel phantoms and the computation of the projections by strip integrals yield an adequate approximation of an experimental setting.

It should be mentioned that it is difficult to determine the optimal number of iterations for the reconstruction of noisy experimental input data. It is a challenging problem to judge whether a residual sinogram is dominated by erroneous information from projection noise and hence, further steps of iteration will only result in artifacts. This is an important subject for further studies.

The merits of the DIRECTT reconstructions come at the cost of increased computation time, which totaled 22 min on an Intel Xeon 5130 processor (2.0 GHz, one core) for a single input image. However, standard algebraic reconstruction algorithms such as SIRT (Gilbert, 1972), which is commonly used in electron tomography (Bals et al, 2007), are also computationally more demanding than FBP. In contrast to DIRECTT, in addition to the number of iterations, they usually require optimization of other parameters in order to yield satisfactory results (Carazo et al, 2005). Since for our phantom data a SIRT reconstruction computed by the Inspect3D software with 20 iterations exhibited substantially increased blurring at the phase boundaries in comparison to the FBP results, we did not include SIRT in our comparative analysis.

It is possible that other backprojection techniques than standard FBP are capable of an improved representation of phase boundaries. These algorithms comprise [lambda]-tomography, where local inversion formulae ensure that space-continuously defined functions and their theoretical reconstructions have the same jumps. One should however point out that [lambda]-tomography does not reconstruct the density distribution / itself but the function [LAMBDA]f, where [LAMBDA] = [square root of (-[DELTA])] denotes the Calderon operator which does not preserve gray values (for details see Louis and Maass, 1993; Kuchment et al, 1995; Faridani et al, 1997). An innovative and computationally efficient reconstruction technique has been proposed by Louis (2008). This approach combines reconstruction and edge detection and could also enable superior reconstructions of phase boundaries in comparison to standard FBP techniques. Furthermore, for samples consisting of few different materials such as our phantom data, algorithms from discrete tomography have been reported to be very promising tools for tomographic reconstruction (Batenburg, 2005; Bals et al, 2007; Herman and Kuba, 2007). Discrete tomography exploits a priori information on the object to be reconstructed, namely the number of materials it is composed of. Therefore, the algorithms can partially compensate for missing information, e.g., caused by limited rotation of the sample (Lange et al, 2008). Furthermore, they return an image which does not require segmentation of the different materials. By construction, DIRECTT also offers the option to compute discrete tomograms and thereby to reconstruct details which cannot be extracted from the projections in the standard setting. Nevertheless, our results demonstrate that even without the a priori information needed for discrete tomography mode, DIRECTT reconstructions exhibit a level of contrast and detail preservation which is not achieved by conventional FBP reconstruction.

We have illustrated that under ideal and noisy projections reconstruction algorithms can cause statistically significant changes of image morphology. For practical applications the error caused by the reconstruction algorithms needs to be carefully related to the effect of experimental imperfections in the projection data. These may comprise alignment deviations, the specific noise level or limited rotation. Expert knowledge about these experimental conditions is important to identify appropriate reconstruction algorithms and their parameters, that meet the specific needs of an application. Nevertheless, whenever realistic projections can be simulated and a FOM capturing the aspects of interest has been defined, randomly generated phantom data reflecting the structural properties of the investigated object and statistical analysis provide a powerful setting to compare different reconstruction techniques.

APPENDIX

MEASURING BOUNDARY LENGTH BY THE STEINER METHOD

The algorithm for boundary length measurement we refer to as the Steiner method exploits the following Steiner-type formula: Let K [subset] [R.sup.2] be polyconvex set, i.e., a finite union of convex sets, then for r > 0 the so-called weighted volume [[rho].sub.r](K) of the set K can be written as

[[rho].sub.r](K) = [r.sup.2] [pi][V.sub.0](K) + [rV.sub.1] (K), (7)

where [2V.sub.1] (K) is the boundary length L (K) of K and [V.sub.0](K) denotes the Euler-Poincare characteristics of K. In the 2D setting the latter counts the number of connectivity components in the foreground minus the number of holes. For a convex set K the weighted volume [[rho].sub.r](K) coincides with the volume of the parallel set (K [cross product] B(r, o))\K, which consists of all points not contained in K but whose distance to K is at most r (Fig. 8). In case the boundary of K has concavity points, [[rho].sub.r](K) is obtained by partitioning (K[cross product]B(r, o))\ K in a specific way and counting the volumes of the obtained components with certain multiplicities (Klenk et al, 2006). If [[rho].sub.r](K) is known for two different dilation radii [r.sub.0] and [r.sub.1], by Eq. 7 we obtain the linear equation system

[MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII.] (8)

which can be uniquely solved for [V.sub.0](K) and [V.sub.1](K). This equation system can also be exploited to obtain an estimator for the boundary length of a discretized version of a set ^ on a square lattice. For details on how to compute the left-hand sides in Eq. 8 for discretized sets we refer to Klenk et al. (2006). Nevertheless, it should be pointed out that a central aspect of the algorithm is a polyhedral approximation of the set which is used to determine its boundary. For approximating [[rho].sub.r](K) the occurrences of certain 8-neighborhood configurations around boundary pixels are counted. In simulation studies, estimation results for the boundary length were shown to significantly improve if instead of approximating [[rho].sub.r](K) for only two dilation radii a higher number of dilation radii [r.sub.1], ..., [r.sub.n] was used (Klenk et al, 2006). This usually yields an overdetermined system of equations, and thus, a solution can be obtained by the standard least-squares method. Estimation results are dependent on the choice of the radii [r.sub.1] ..., [r.sub.n].

[FIGURE 8 OMITTED]

MEASURING BOUNDARY LENGTH BY THE CAUCHY METHOD

The algorithm for boundary length measurement we refer to as the Cauchy method relies on Cauchy's surface area formula, which expresses the boundary length L(K) of the polyconvex set K as an integral of the total projection length [[pi].sub.[theta]](K) of the set k in direction 6:

[MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII.] (9)

The total projection length is defined as [[pi].sub.[theta]] (K) = [[integral].sup.[infinity].sub.-[infinity] [V.sub.0] (K [intersection] [e.sub.r, [theta]] dr, i.e., as the integral of the number of connected components of the one-dimensional intersection of K and the lines [e.sub.r, [theta]], where [e.sub.r, [theta]] is the line with direction [theta] [member of] [0, [pi]) and the directed distance r [member of] R from the origin (Fig. 9). Integration is with respect to the distances r from the origin. On discretized binary images, the total projection length can be approximated by computing relative frequencies of certain pixel configurations at the phase boundary (Ohser and Mucklich, 2000). Based on these approximations of the total projection length in the 8 canonical directions in a 2D square lattice, the integral Eq. 9 can be numerically evaluated by means of a quadrature scheme.

[FIGURE 9 OMITTED]

ACKNOWLEDGMENTS

This research was supported by the German Federal Ministry for Education and Science (BMBF) (Grant. No. 03SF0324) and by a grant from Deutsche Forschungsgemeinschaft (SFB 518, project B21). The authors thank Thomas Steinle for his help in performing parts of the tomographic reconstructions. We are also grateful to Gregory Beylkin and David Mastronarde who kindly provided the license for the fast FBP algorithm. Valuable comments by the referees and Yannick Anguy as the handling editor helped to substantially improve the manuscript.

(Accepted March 17, 2010)

REFERENCES

Bals S, Batenburg KJ, Verbeeck J, Sijbers J, Van Tendeloo G (2007). Quantitative three-dimensional reconstruction of catalyst particles for bamboo-like carbon nanotubes. Nano Lett 7:3669-74.

Banhart J ed. (2007). Advanced tomographic methods in materials research and engineering. Oxford: Oxford University Press.

Batenburg KJ (2005). An evolutionary algorithm for discrete tomography. Discrete Appl Math 151:36-54.

Baumann G, Barth A, Nonnenmacher TF (1993). Measuring fractal dimensions of cell contours: practical approaches and their limitations. In: Nonnenmacher TF, Losa GA, Weibel EA eds. Fractals in biology and medicine. Boston: Birkhauser, 182-9.

Buzug TM (2008). Computed tomography. Berlin: Springer.

Carazo JM, Herman GT, Sorzano COS, Marabini R (2005). Algorithms for three-dimensional reconstruction from the imperfect projection data provided by electron microscopy. In: Frank J, ed. Electron tomography. 2nd ed. New York: Springer, 211-A3.

Conover WJ (1971). Practical nonparametric statistics. New York: J. Wiley & Sons.

Faridani A, Finch DV, Ritman EL, Smith KT (1997). Local tomography II. SIAM J Appl Math 57:1095-127.

Feldkamp LA, Davis LC, Kress JW (1984). Practical conebeam algorithm. J Opt Soc Am A6:612-9.

Frank J (2005) Electron tomography. 2nd ed. New York: Springer.

Frost H, Diiren T, Snurr RQ (2006). Effects of surface area, free volume, and heat adsorption on hydrogen uptake in met al-organic frameworks. J Phys Chem B 110:9565-70.

Furuie SS, Herman GT, Narayan TK, Kinahan PE, Karp JS, Lewitt RM (1994). A methodology for testing for statistically significant differences between fully 3D PET reconstruction algorithms. Phys Med Biol 39:341-54.

Gardner RJ (1995). Geometric tomography. Cambridge: Cambridge University Press.

Gilbert P (1972). Iterative methods for the three-dimensional reconstruction of an object from projections. J Theor Biol 36:105-17.

Gibbons JD (1985). Nonparametric statistical inference. 2nd ed. New-York: Marcel Dekker.

Guderlei R, Klenk S, Mayer J, Schmidt V, Spodarev E (2007). Algorithms for the computation of Minkowski functionals of deterministic and random polyconvex sets. Image Vision Comput 25:464-74.

Haibel A (2008). Synchrotron X-ray absorption tomography. In: J Banhart, ed. Advanced tomographic methods in materials research and engineering. Oxford: Oxford University Press, 141-60.

Hansis E, Schafer D, Dossel O, Grass M (2008). Evaluation of iterative sparse object reconstruction from few projections for 3-D rotational coronary angiography. IEEE T Med Imaging 27:1548-55.

Hanson KM (1990). Method of evaluating image recovery algorithms based on task-performance. J Opt Soc Am A 7:1294-304.

Herman GT, Yeung KTD (1989). Evaluators of image reconstruction algorithms. Int J Imag Syst Tech 1:187-95.

Herman GT, Odhner D (1991). Evaluation of reconstruction algorithms. In: GT Herman, AK Louis, F Natterer eds. Mathematical methods in tomography. Berlin: Springer 215-27.

Herman GT, Kuba A eds. (2007). Advances in discrete tomography and its applications. Boston: Birkhauser.

Herman GT (2009). Fundamentals of computerized tomography. London: Springer.

Kak AC, Slaney M (1988). Principles of computerized tomographic imaging. New York: IEEE.

Klenk S, Schmidt V, Spodarev E (2006). A new algorithmic approach for the computation of Minkowski functionals of polyconvex sets. Comp Geom Theor Appl 34:127-48.

Kuchment P, Lancaster K, Mogilevskaya L (1995). On local tomography. Inverse Probl 11:571-589.

Kremer JR, Mastronarde DN, McIntosh JR (1996). Computer visualization of three-dimensional image data using IMOD. J Struct Biol 116:71-6.

Lange A, Hentschel MP (2007). Direct iterative reconstruction of computed tomography trajectories (DIRECTT). International Symposium on Digital Industrial Radiology and Computed Tomography. Lyon. http://www.ndt.net/article/dir2007/papers/p6.pdf

Lange A, Hentschel MP, Kupsch A (2008). Computertomographische Rekonstruktion mit DIRECTT. MP Materials Testing 50:272-7. Patents DE 103 07 331 B4, DPMA (US 2006/0233459 A1).

Lehmann EL, Romano JP (2005). Testing statistical hypotheses. 3rd ed. New York: Springer.

Louis AK, Maass P (1993). Contour reconstruction in 3-D X-ray CT. IEEE T Med Imaging 12:764-9.

Louis AK (2008). Combining image reconstruction and image analysis with an application to 2D-tomography. SIAM J Imag Sci 1:188-208.

Matej S, Herman GT, Narayan TK, Furuie SS, Lewitt RM, Kinahan PE (1994). Evaluation of task-oriented performance of several fully 3D PET reconstruction algorithms. Phys Med Biol 39: 355-67.

Matej S, Furuie SS, Herman GT (1996). Relevance of statistically significant differences between reconstruction algorithms. IEEE T Image Process 5: 554-6.

Mattfeldt T, Meschenmoser D, Pantle U, Schmidt V (2007). Characterization of mammary gland tissue using joint estimators of Minkowski functionals. Image Anal Stereol 26:13-22.

Mayer J, Schmidt V, Schweiggert F (2004). A unified simulation framework for spatial stochastic models. Simul Model Pract Th 12:307-26.

Mayer J (2004). A time-optimal algorithm for the estimation of contact distribution functions of random sets. Image Anal Stereol 23:177-83.

Molchanov I (1997). Statistics of the Boolean model for practitioners and mathematicians. Chichester: J. Wiley & Sons.

Neuschaefer-Rube U, Neugebauer M, Ehrig W, Bartscher M, Hilpert U (2008). Tactile and optical microsensors: test procedures and standards. Meas Sci Technol 19:084010.

Ohser J, Mucklich F (2000). Statistical analysis of microstructures in materials science. Chichester: J. Wiley & Sons.

Ohser J, Schladitz K (2008). Visualization, processing and analysis of tomographic data. In: J Banhart, ed. Advanced tomographic methods in materials research and engineering. Oxford: Oxford University Press, 37105.

Park MS, Yoo SH, Lee DH (2000). Measurement of surface area in human mastoid air cell system. J Laryngol Otol 114:93-6.

Radon J (1917). Uber die Bestimmung von Funktionen langs gewisser Mannigfaltigkeiten. Ber Math Phys Sachs Ges Wissen 59:262-77.

Ramachandran GN, Lakshminarayanan AV (1971). Three-dimensional reconstruction from radiographs and electron micrographs. Proc Natl Acad Sci USA 68:2236-40.

R Development Core Team (2007). R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing.

Sandberg K, Mastronarde DN, Beylkin G (2003). A fast reconstruction algorithm for electron microscope tomography. J Struct Biol 144:61-72.

Schneider R, Weil W (2008). Stochastic and integral geometry. Berlin: Springer

Shepp LA, Logan BF (1974). The Fourier reconstruction of a head section. IEEE T Nucl Sci 21: 21-43.

Sorzano COS, Marabini R, Boisset N, Rietzel E, Schroder R, Herman GT, Carazo JM (2001). The effect of overabundant projection directions on 3D reconstruction algorithms. J Struct Biol 133: 108-18.

Stoeger T, Reinhard C, Takenaka S, Schroeppel A, Karg E, Ritter B, Heyder J, Schulz H (2006). Instillation ofsix different ultrafine carbon particles indicates a surface area threshold dose for acute lung inflammation in mice. Environ Health Persp 114:328-33.

Thiedmann R, Fleischer F, Hartnig C, Lehnert W, Schmidt V (2008). Stochastic 3D modeling of the GDL structure in PEM fuel cells based on thin section detection. J Electrochem Soc 155:B391-9.

Thiedmann R, Hartnig C, Manke I, Schmidt V, Lehnert W (2009). Local structural characteristics ofpore space in GDL's of PEM fuel cells based on geometric 3D graphs. J Electrochem Soc 156:B1339-47.

SEBASTIAN LUCK (1), ANDREAS KUPSCH (2), AXEL LANGE (2), MANFRED P HENTSCHEL (2) AND VOLKER SCHMIDT (1)

(1) Institute of Stochastics, Ulm University, d-89069 Ulm, Germany; (2) BAM Federal Institute for Materials Research and Testing, d-12200 Berlin, Germany e-mail: sebastian.lueck@uni-ulm.de

Table 1. Bounds for the p-values of the tests conducted for comparison of the relative errors of boundary length produced by the different reconstruction algorithms under noiseless projections. Small p-values of two-sided WR and KS tests indicate that error distributions are significantly different. Large p-values of the one-sided KST and WRT mean that the first of the algorithms in column 1 produces a significantly smaller error than the other one. Large p-values of the two-sided ABT suggest that the variability of the errors is similar for the two reconstruction algorithms considered. KST KST WRT p-values two-sided one-sided two-sided DIRECTT vs. FBP IMod < 0.0001 > 0.9999 < 0.0001 DIRECTT vs. FBP Inspect3D < 0.0001 > 0.9999 < 0.0001 DIRECTT vs. fast FBP < 0.0001 > 0.9999 < 0.0001 fast FBP vs. IMod < 0.0001 > 0.9999 < 0.0001 fast FBP vs. Inspect3D < 0.0001 > 0.9999 < 0.0001 FBP IMod vs. Inspect3D < 0.01 > 0.9999 < 0.001 WRT ABT p-values one-sided two-sided DIRECTT vs. FBP IMod > 0.9999 > 0.9999 DIRECTT vs. FBP Inspect3D > 0.9999 > 0.9999 DIRECTT vs. fast FBP > 0.9999 > 0.9999 fast FBP vs. IMod > 0.9999 > 0.9999 fast FBP vs. Inspect3D > 0.9999 > 0.9999 FBP IMod vs. Inspect3D > 0.9999 > 0.5

Printer friendly Cite/link Email Feedback | |

Title Annotation: | Original Research Paper |
---|---|

Author: | Luck, Sebastian; Kupsch, Andreas; Lange, Axel; Hentschel, Manfred P.; Schmidt, Volker |

Publication: | Image Analysis and Stereology |

Article Type: | Report |

Geographic Code: | 4EUGE |

Date: | Jul 1, 2010 |

Words: | 10051 |

Previous Article: | Measurement of the shortest path length; distance estimation within the 3D borders of a tissue of interest. |

Next Article: | Strategy on simulation of arbitrary-shaped cement grains in concrete. |

Topics: |