PurposeThis work aims to develop a new framework of image quality assessment using deep learning‐based model observer (DL‐MO) and to validate it in a low‐contrast lesion detection task that involves CT images with patient anatomical background.MethodsThe DL‐MO was developed using the transfer learning strategy to incorporate a pretrained deep convolutional neural network (CNN), a partial least square regression discriminant analysis (PLS‐DA) model and an internal noise component. The CNN was previously trained to achieve the state‐of‐the‐art classification accuracy over a natural image database. The earlier layers of the CNN were used as a deep feature extractor, with the assumption that similarity exists between the CNN and the human visual system. The PLSR model was used to further engineer the deep feature for the lesion detection task in CT images. The internal noise component was incorporated to model the inefficiency and variability of human observer (HO) performance, and to generate the ultimate DL‐MO test statistics. Seven abdominal CT exams were retrospectively collected from the same type of CT scanners. To compare DL‐MO with HO, 12 experimental conditions with varying lesion size, lesion contrast, radiation dose, and reconstruction types were generated, each condition with 154 trials. CT images of a real liver metastatic lesion were numerically modified to generate lesion models with four lesion sizes (5, 7, 9, and 11 mm) and three contrast levels (15, 20, and 25 HU). The lesions were inserted into patient liver images using a projection‐based method. A validated noise insertion tool was used to synthesize CT exams with 50% and 25% of routine radiation dose level. CT images were reconstructed using the weighted filtered back projection algorithm and an iterative reconstruction algorithm. Four medical physicists performed a two‐alternative forced choice (2AFC) detection task (with multislice scrolling viewing mode) on patient images across the 12 experimental conditions. DL‐MO was operated on the same datasets. Statistical analyses were performed to evaluate the correlation and agreement between DL‐MO and HO.ResultsA statistically significant positive correlation was observed between DL‐MO and HO for the 2AFC low‐contrast detection task that involves patient liver background. The corresponding Pearson product moment correlation coefficient was 0.986 [95% confidence interval (0.950, 0.996)]. Bland–Altman agreement analysis did not indicate statistically significant differences.ConclusionsThe proposed DL‐MO is highly correlated with HO in a low‐contrast detection task that involves realistic patient liver background. This study demonstrated the potential of the proposed DL‐MO to assess image quality directly based on patient images in realistic, clinically relevant CT tasks.
150-μm Spatial Resolution Using Photon-Counting Detector Computed Tomography Technology
Objective The aims of this study were to quantitatively assess two new scan modes on a photon-counting detector computed tomography system, each designed to maximize spatial resolution, and to qualitatively demonstrate potential clinical impact using patient data. Materials and Methods This Health Insurance Portability Act–compliant study was approved by our institutional review board. Two high–spatial-resolution scan modes (Sharp and UHR) were evaluated using phantoms to quantify spatial resolution and image noise, and results were compared with the standard mode (Macro). Patients were scanned using a conventional energy-integrating detector scanner and the photon-counting detector scanner using the same radiation dose. In first patient images, anatomic details were qualitatively evaluated to demonstrate potential clinical impact. Results Sharp and UHR modes had a 69% and 87% improvement in in-plane spatial resolution, respectively, compared with Macro mode (10% modulation-translation-function values of 16.05, 17.69, and 9.48 lp/cm, respectively). The cutoff spatial frequency of the UHR mode (32.4 lp/cm) corresponded to a limiting spatial resolution of 150 μm. The full-width-at-half-maximum values of the section sensitivity profiles were 0.41, 0.44, and 0.67 mm for the thinnest image thickness for each mode (0.25, 0.25, and 0.5 mm, respectively). At the same in-plane spatial resolution, Sharp and UHR images had up to 15% lower noise than Macro images. Patient images acquired in Sharp mode demonstrated better delineation of fine anatomic structures compared with Macro mode images. Conclusions Phantom studies demonstrated superior resolution and noise properties for the Sharp and UHR modes relative to the standard Macro mode and patient images demonstrated the potential benefit of these scan modes for clinical practice.
Inter‐laboratory comparison of channelized hotelling observer computation
PurposeThe task‐based assessment of image quality using model observers is increasingly used for the assessment of different imaging modalities. However, the performance computation of model observers needs standardization as well as a well‐established trust in its implementation methodology and uncertainty estimation. The purpose of this work was to determine the degree of equivalence of the channelized Hotelling observer performance and uncertainty estimation using an intercomparison exercise.Materials and MethodsImage samples to estimate model observer performance for detection tasks were generated from two‐dimensional CT image slices of a uniform water phantom. A common set of images was sent to participating laboratories to perform and document the following tasks: (a) estimate the detectability index of a well‐defined CHO and its uncertainty in three conditions involving different sized targets all at the same dose, and (b) apply this CHO to an image set where ground truth was unknown to participants (lower image dose). In addition, and on an optional basis, we asked the participating laboratories to (c) estimate the performance of real human observers from a psychophysical experiment of their choice. Each of the 13 participating laboratories was confidentially assigned a participant number and image sets could be downloaded through a secure server. Results were distributed with each participant recognizable by its number and then each laboratory was able to modify their results with justification as model observer calculation are not yet a routine and potentially error prone.ResultsDetectability index increased with signal size for all participants and was very consistent for 6 mm sized target while showing higher variability for 8 and 10 mm sized target. There was one order of magnitude between the lowest and the largest uncertainty estimation.ConclusionsThis intercomparison helped define the state of the art of model observer performance computation and with thirteen participants, reflects openness and trust within the medical imaging community. The performance of a CHO with explicitly defined channels and a relatively large number of test images was consistently estimated by all participants. In contrast, the paper demonstrates that there is no agreement on estimating the variance of detectability in the training and testing setting.