Skip to main content

Main menu

  • Home
  • Content
    • Current
      • JNMT Supplement
    • Ahead of print
    • Past Issues
    • Continuing Education
    • JNMT Podcast
    • SNMMI Annual Meeting Abstracts
  • Subscriptions
    • Subscribers
    • Rates
    • Journal Claims
    • Institutional and Non-member
  • Authors
    • Submit to JNMT
    • Information for Authors
    • Assignment of Copyright
    • AQARA Requirements
  • Info
    • Reviewers
    • Permissions
    • Advertisers
    • Corporate & Special Sales
  • About
    • About Us
    • Editorial Board
    • Contact Information
  • More
    • Alerts
    • Feedback
    • Help
    • SNMMI Journals
  • SNMMI
    • JNMT
    • JNM
    • SNMMI Journals
    • SNMMI

User menu

  • Subscribe
  • My alerts
  • Log in
  • My Cart

Search

  • Advanced search
Journal of Nuclear Medicine Technology
  • SNMMI
    • JNMT
    • JNM
    • SNMMI Journals
    • SNMMI
  • Subscribe
  • My alerts
  • Log in
  • My Cart
Journal of Nuclear Medicine Technology

Advanced Search

  • Home
  • Content
    • Current
    • Ahead of print
    • Past Issues
    • Continuing Education
    • JNMT Podcast
    • SNMMI Annual Meeting Abstracts
  • Subscriptions
    • Subscribers
    • Rates
    • Journal Claims
    • Institutional and Non-member
  • Authors
    • Submit to JNMT
    • Information for Authors
    • Assignment of Copyright
    • AQARA Requirements
  • Info
    • Reviewers
    • Permissions
    • Advertisers
    • Corporate & Special Sales
  • About
    • About Us
    • Editorial Board
    • Contact Information
  • More
    • Alerts
    • Feedback
    • Help
    • SNMMI Journals
  • Watch or Listen to JNMT Podcast
  • Visit SNMMI on Facebook
  • Join SNMMI on LinkedIn
  • Follow SNMMI on Twitter
  • Subscribe to JNMT RSS feeds
Research ArticleBasic Science Investigation

Validation of Convolutional Neural Networks for Fast Determination of Whole-Body Metabolic Tumor Burden in Pediatric Lymphoma

Elba Etchebehere, Rebeca Andrade, Mariana Camacho, Mariana Lima, Anita Brink, Juliano Cerci, Helen Nadel, Chandrasekhar Bal, Venkatesh Rangarajan, Thomas Pfluger, Olga Kagna, Omar Alonso, Fatima K. Begum, Kahkashan Bashir Mir, Vincent Peter Magboo, Leon J. Menezes, Diana Paez and Thomas NB Pascual
Journal of Nuclear Medicine Technology September 2022, 50 (3) 256-262; DOI: https://doi.org/10.2967/jnmt.121.262900
Elba Etchebehere
1University of Campinas, Campinas, Brazil;
2Medicina Nuclear de Campinas, Campinas, Brazil;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Rebeca Andrade
1University of Campinas, Campinas, Brazil;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mariana Camacho
2Medicina Nuclear de Campinas, Campinas, Brazil;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mariana Lima
1University of Campinas, Campinas, Brazil;
2Medicina Nuclear de Campinas, Campinas, Brazil;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Anita Brink
3University of Cape Town, Cape Town, South Africa;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Juliano Cerci
4QUANTA Diagnóstico e Terapia, Curitiba, Brazil;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Helen Nadel
5University of British Columbia, Vancouver, British Columbia, Canada;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Chandrasekhar Bal
6All India Institute of Medical Sciences, New Delhi, India;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Venkatesh Rangarajan
7Tata Memorial Centre, Mumbai, India;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Thomas Pfluger
8Ludwig‐Maximillian University of Munich, Munich, Germany;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Olga Kagna
9Rambam Health Care Campus, Haifa, Israel;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Omar Alonso
10Centro Uruguayo de Imagenología Molecular, Montevideo, Uruguay;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Fatima K. Begum
11National Institute of Nuclear Medicine and Allied Sciences, Dhaka, Bangladesh;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kahkashan Bashir Mir
12Nuclear Medicine, Oncology and Radiotherapy Institute, Islamabad, Pakistan;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Vincent Peter Magboo
13University of the Philippines, Manila, Philippines;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Leon J. Menezes
14Institute of Nuclear Medicine, London, United Kingdom; and
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Diana Paez
15Nuclear Medicine and Diagnostic Imaging Section, Division of Human Health, International Atomic Energy Agency, Vienna, Austria
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Thomas NB Pascual
15Nuclear Medicine and Diagnostic Imaging Section, Division of Human Health, International Atomic Energy Agency, Vienna, Austria
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Info & Metrics
  • PDF
Loading

Visual Abstract

Figure
  • Download figure
  • Open in new tab
  • Download powerpoint

Abstract

18F-FDG PET/CT quantification of whole-body tumor burden in lymphoma is not routinely performed because of the lack of fast methods. Although the semiautomatic method is fast, it is not fast enough to quantify tumor burden in daily clinical practice. Our purpose was to evaluate the performance of convolutional neural network (CNN) software in localizing neoplastic lesions in whole-body 18F-FDG PET/CT images of pediatric lymphoma patients. Methods: The retrospective image dataset, derived from the data pool of the International Atomic Energy Agency (coordinated research project E12017), included 102 baseline staging 18F-FDG PET/CT studies of pediatric lymphoma patients (mean age, 11 y). The images were quantified to determine the whole-body tumor burden (whole-body metabolic tumor volume [wbMTV] and whole-body total lesion glycolysis [wbTLG]) using semiautomatic software and CNN-based software. Both were displayed as semiautomatic wbMTV and wbTLG and as CNN wbMTV and wbTLG. The intraclass correlation coefficient (ICC) was applied to evaluate concordance between the CNN-based software and the semiautomatic software. Results: Twenty-six patients were excluded from the analysis because the software was unable to perform calculations for them. In the remaining 76 patients, CNN and semiautomatic wbMTV tumor burden metrics correlated strongly (ICC, 0.993; 95% CI, 0.989 − 0.996; P < 0.0001), as did CNN and semiautomatic wbTLG (ICC, 0.999; 95% CI, 0.998–0.999; P < 0.0001). However, the time spent calculating these metrics was significantly (<0.0001) less by CNN (mean, 19 s; range, 11–50 s) than by the semiautomatic method (mean, 21.6 min; range, 3.2–62.1 min), especially in patients with advanced disease. Conclusion: Determining whole-body tumor burden in pediatric lymphoma patients using CNN is fast and feasible in clinical practice.

  • 18F-FDG PET/CT
  • whole-body tumor burden
  • pediatric
  • lymphoma

For pediatric staging and treatment response evaluation of Hodgkin and non‐Hodgkin lymphoma, 18F-FDG PET/CT is an invaluable tool and an established modality (1–7). Visual interpretation of 18F-FDG PET/CT studies to assess the extent of disease can be subjective; therefore, qualitative interpretation is necessary to provide additional insight, reducing the subjectivity of visual interpretation (8,9). 18F-FDG PET/CT whole-body metabolic tumor burden parameters such as metabolic tumor volume (MTV) and total lesion glycolysis (TLG) bear a high prognostic value in lymphoma patients, much greater than SUVs (10–13). However, the prognostic determination, although easily measured in primary solid tumors (14–17), has not been applied in daily clinical practice to patients with widespread lymphoma disease because calculations are extremely time-consuming.

There is a wide variety of methods to quantify MTV and TLG, using threshold-based or algorithm-based methods. Specifically relating to the threshold-based methods, the most commonly applied is the volume-of-interest (VOI) isocontour method (15,17,18). Automatic multifocal segmentation quantification in patients with lymphoma uses VOI isocontour and has been validated before and proven to be quite fast (19). Depending on patient tumor burden, the time spent calculating MTV and TLG could be impractical and still not feasible in daily clinical practice. The extraction and processing of imaging features from radiologic data, also known as radiomics, may also link imaging features with patient outcome. However, radiomics also requires precise tumor ROI delineation, which is also time-consuming, with delineation variabilities between observers.

Computer deep learning and functioning as a neural network have evolved substantially, achieving remarkable success in tumor segmentation and diagnosis and ultimately transforming and optimizing clinical practice (18,20–23), providing objective and accurate diagnoses in medicine by building diagnostic models. For example, software for multimodality imaging using deep convolutional neural networks (CNNs) automatically localizes and delineates metastases in whole-body 18F-FDG PET/CT scans. Deep CNN seems capable of correctly localizing and classifying uptake patterns in 18F-FDG PET/CT images into foci suggestive and nonsuggestive of cancer. These extracted features help the semantic interpretation and may simplify the PET workflow with a 1-click calculation of whole-body tumor burden (24–26). However, the clinical applicability of this software has not yet been fully tested, and unusual features may be identified if unsupervised by a physician (27,28).

The purpose of this study was to evaluate the performance of the recently developed CNN software in a clinical setting in pediatric lymphoma patients.

MATERIALS AND METHODS

This dataset, retrospectively studied, is derived from a subset of 102 baseline staging 18F-FDG PET/CT studies of pediatric lymphoma patient images from the data pool of the prospective multicenter research project coordinated by the International Atomic Energy Agency (coordinated research project E12017).

Research Regulation and Data Protection

The study protocol was approved by each center’s Institutional Review Board. A signed parental consent form was an inclusion criterion for recruitment, and all subjects gave such consent. Cases and forms were anonymized to ensure confidentiality while sharing data internationally.

Patients

The eligibility criteria consisted of pediatric patients (age < 18 y) with newly diagnosed Hodgkin lymphoma or non-Hodgkin lymphoma who underwent a staging 18F-FDG PET/CT scan. According to the World Health Organization classification criteria, the diagnosis was based on biopsy with immunohistochemistry (29). Exclusion criteria consisted of prior radiation therapy and chemotherapy and concurrent HIV infection.

The patient’s clinical characteristics and tumor stage were evaluated, such as the age at diagnosis, the final clinical stage, spleen disease, additional nodal sites, disease volume, B symptoms, lactate dehydrogenase level, leukocytosis, erythrocyte sedimentation rate, anemia, albumin level, bone marrow 18F-FDG uptake, Deauville score, MTV, and TLG.

18F-FDG PET/CT Imaging and Quantification

All patients underwent staging whole-body 18F-FDG PET/CT, from the top of the skull to the toes. All scans were obtained according to standard Society of Nuclear Medicine and Molecular Imaging or European Association of Nuclear Medicine procedure guidelines (30).

The whole-body MTV (wbMTV) and whole-body TLG (wbTLG) metrics were calculated using semiautomatic and CNN software. All images on both types of software were processed by 2 observers. Differences in the wbMTV and wbTLG metrics (if any) were recalculated to reach consensus. The semiautomatic software was used as the reference standard to evaluate the CNN software’s performance.

Semiautomatic Quantification of Whole-Body Tumor Burden

The wbMTV and wbTLG metrics were calculated using semiautomatic multifocal segmentation software (Syngovia VB20; Siemens Medical Solutions), previously validated for clinical use (19) using a fixed threshold.

With this software, the whole-body tumor burden metrics (semiautomatic wbMTV and wbTLG) were obtained. The semiautomatic whole-body tumor burden was obtained by choosing the multifocal segmentation tool that automatically draws a rectangular VOI around the patient’s entire body on the coronal axis. If necessary, the VOI is adjusted in the axial and sagittal planes. The liver is set as the background reference, and then volumes of interest are automatically determined surrounding each lymphoma lesion with uptake higher than the SUVmean of the liver. A VOI threshold of 41% of the SUVmax using isocontour drawings was applied for all automatically delineated lesions. The image and VOIs were then reviewed to exclude physiologic areas incorrectly selected as cancer (such as brain, kidneys, bladder, and ureters) and include metastatic foci with relatively low uptake that were missed by the software (e.g., small lymph nodes). Afterward, whole-body MTV and TLG calculations were readily available and displayed as semiautomatic wbMTV and wbTLG (Fig. 1).

FIGURE 1.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 1.

Whole-body tumor burden quantification on baseline staging 18F-FDG PET/CT using semiautomatic software on patient with non-Hodgkin lymphoma. (A) Maximum-intensity projection shows hypermetabolic lymphoma infiltration in left supraclavicular and cervical lymph nodes, mediastinal lymph nodes, and extensively in abdominopelvic lymph nodes; lung nodules; and bone infiltration. (B) For calculation, liver is set as background reference, and VOIs automatically surround each lymphoma lesion with uptake higher than SUVmean of liver. VOIs also include physiologic areas incorrectly selected as cancer to include metastatic foci with relatively low uptake, such as lung nodule metastasis with mild 18F-FDG uptake in right upper lobe.

CNN Quantification of Whole-Body Tumor Burden

The wbMTV and wbTLG metrics were calculated using software based on deep CNN (Syngovia VB50; Siemens Healthineers). With this software, the whole-body tumor burden metrics (CNN wbMTV and wbTLG) were obtained.

Computation of the whole-body tumor burden on the CNN software was automatically performed by the deep CNN method as described by Sibille et al. (24). Unlike the semiautomatic software, the CNN software does not require an initial positioning of a VOI surrounding the body. The CNN automatically computes the maximum-intensity-projection 18F-FDG PET image and integrates the anatomic CT image using an intuitive interface. Afterward, the software automatically detects 18F-FDG–avid anatomic landmarks and discriminates hypermetabolic areas related to the physiologic activity that will be automatically excluded (Fig. 2) from cancer. Briefly, the PET VOIs are segmented using a fixed threshold algorithm and evaluated by the deep CNN. Whole-body CT examinations are aligned to an anatomic atlas. Finally, a maximum-intensity projection of the whole-body 18F-FDG PET/CT is reconstructed, and the lesions are classified. The deep CNN uses a combination of multiplanar reconstructions of PET and CT, 18F-FDG PET maximum-intensity projections, and anatomic atlases to predict the anatomic localization of 18F-FDG foci and determine whether a focus was suggestive (or not) for malignancy. The advantage of the CNN algorithm is that it does not require the initial positioning of a VOI. This specific CNN software is not yet validated for pediatric patients.

FIGURE 2.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 2.

Whole-body tumor burden quantification on staging 18F-FDG PET/CT using CNN. Displayed in red are regions that software excluded from analysis (regions related to physiologic uptake: brain, head and neck, heart, intestines, kidneys, and bladder), and displayed in green are regions that software included in calculation of whole-body tumor burden. In this patient, extensive cervical lymph node bulky mass and mediastinal lymph nodes were included.

Two forms of analyses were undertaken on the CNN software: the observer method, in which all VOIs automatically generated by the multifocal segmentation tool were reviewed (in a masked manner) by both observers to determine whether the VOIs were wrongly included or excluded from the results (afterward, values were calculated and displayed as CNN + observer wbMTV and wbTLG), and the no-observer method, in which the VOIs automatically obtained were accepted and did not undergo a masked review by each of the observers. The calculations were readily available and displayed as CNN wbMTV and wbTLG.

Statistical Analysis

The sample was characterized by descriptive analysis, performed using frequency tables for categoric variables and measures of position and dispersion for continuous variables (mean, SD, median, minimum and maximum).

The χ2 test or Fisher exact test was used to check associations or compare proportions, and the Mann–Whitney test was used to compare continuous or orderable measurements between the 2 groups. Risk factors associated with the event were identified with univariate and multiple Cox regression analyses. The variable selection process used was stepwise.

To verify the relationship between continuous measurements, the Spearman correlation coefficient was used ranging from −1 to 1.

To assess agreement between the semiautomatic and CNN software, the intraclass correlation coefficient (ICC) was used (values above 0.7 were considered to indicate substantial agreement). The Friedman test and the Wilcoxon test for related samples were used to compare the times. The time was defined as the moment that the physician began focusing on the task until the moment that the whole-body tumor burden calculation was completed. The level of significance was 0.05.

RESULTS

The whole-body tumor burden was quantified using both types of software in 102 18F-FDG PET/CT baseline scans of pediatric lymphoma patients. There were 32 (31.4%) girls and 70 (68.6%) boys. The mean age at lymphoma diagnosis was 11.1 ± 4.3 y (range, 4.0–18.0 y). Among these, 80 (78.4%) patients had Hodgkin lymphoma, and 22 (21.6%) had non-Hodgkin lymphoma. Table 1 displays the clinical characteristics.

View this table:
  • View inline
  • View popup
TABLE 1.

Clinical Characteristics of Patients (n = 102)

Semiautomatic Calculation of Whole-Body Tumor Burden

The semiautomatic wbMTV and wbTLG were calculated in all 102 patients. The average time spent on this calculation was 21.6 min, ranging from 3.2 to 62.1 min. Notably, in patients with widespread lesions in multiple organs or confluent with areas of physiologic excretion, the software took longer to identify and delineate abnormal areas.

CNN-Based Calculation of Tumor Burden

The CNN + observer wbMTV and wbTLG were also calculated in all 102 patients. The average time spent on this calculation, with the CNN software having the observers evaluate the images before calculation, was 3.8 min, ranging from 0.5 to 19.6 min.

On the other hand, CNN wbMTV and wbTLG (i.e., without any observer evaluating the CNN software’s performance before calculation) were calculated in 76 of the 102 patients. Twenty-six patients were excluded from the analyses because the software could not perform calculations because of patient movement or misregistration (n = 6), because the software could not recognize small lymph nodes as diseased (n = 8), or because there was widespread brown fat (n = 3), diffuse bone infiltration (n = 5), diffuse homogeneous mild infiltration of the spleen (n = 2), or subcutaneous infiltration of 18F-FDG at the injection site (n = 2) (Fig. 3).

FIGURE 3.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 3.

Baseline staging 18F-FDG PET/CT of patient with Hodgkin lymphoma. (A) Maximum-intensity projection reveals cervical hypermetabolic bulky mass. (B) Image displayed with different whole-body tumor burden quantification methods shows that using semiautomatic method, VOIs are delineated in cancer lesions and also in physiologic regions not related to cancer; these regions must be deleted before quantification. Whole-body tumor burden calculation showed semiautomatic wbMTV of 104 and TLG of 1,663; time spent calculating these metrics was 5 min. (C) CNN whole-body tumor burden quantification does not delineate regions nonrelated to cancer and demonstrates similar metrics: CNN + observer wbMTV of 105 and CNN + observer wbTLG of 1,671. Time spent calculating was significantly less (13 s) even though CNN software failed to delineate spleen, which had to be performed manually.

Impressively, the average total time spent calculating CNN wbMTV and wbTLG was 19 s, ranging from 11 to 50 s. This total time begins when the physician begins focusing on the task and ends at completion of the whole-body tumor burden calculation. Thus, the times spent calculating CNN, CNN + observer, and semiautomatic wbMTV metrics in 76 paired patients were significantly different (P < 0.0001). The CNN software alone was much faster and more precise than either the semiautomatic or the CNN + observer method (Table 2).

View this table:
  • View inline
  • View popup
TABLE 2.

Time Spent Quantifying Whole-Body Tumor Burden Metrics on Semiautomatic Software and CNN Software With and Without Observer Input

Comparison of Semiautomatic and CNN Tumor Burden Measurements

The CNN + observer and semiautomatic wbMTV metrics calculated on the 102 patients correlated strongly (ICC, 0.993; 95% CI, 0.989–0.996; P < 0.0001), as did the CNN + observer and semiautomatic wbTLG metrics (ICC, 0.999; 95% CI, 0.998–0.999; P < 0.0001). Among the 76 18F-FDG PET/CT studies in which the fully automatic CNN was performed, the CNN + observer, CNN, and semiautomatic wbMTV metrics also correlated strongly, as did the CNN + observer, CNN, and semiautomatic wbTLG metrics (Table 3).

View this table:
  • View inline
  • View popup
TABLE 3.

Correlation of Whole-Body Tumor Burden Metrics on Semiautomatic Software and CNN-Based Software With and Without Observer Input in 76 Patients

Impressively, the correlation between CNN and semiautomatic wbMTV was significantly high (ICC, 0.950; 95% CI, 0.922–0.968; P < 0.0001), as was CNN and semiautomatic wbTLG (ICC, 0.947; 95% CI, 0.917–0.966; P < 0.0001). Therefore, the CNN software performed equally well, similar to the semiautomatic tool in which an experienced observer evaluated the images.

More impressive, however, was the fact that the correlation between CNN + observer and CNN wbMTV was significantly high (ICC, 0.946; 95% CI, 0.912–0.966; P < 0.0001), as was CNN + observer and CNN wbTLG (ICC, 0.952; 95% CI, 0.925–0.969; P < 0.0001). Consequently, the CNN software performance did not require an observer to evaluate the images and validate all VOIs.

DISCUSSION

To our knowledge, this was the first study to quantify the whole-body tumor burden of pediatric lymphoma patients using CNN and deep learning. Despite the difference in 18F-FDG biodistribution between children and adults, the CNN-based software accurately delineated abnormal regions. The CNN-based software optimized the working time, was extremely fast, and performed better than the semiquantitative software in calculating whole-body tumor burden.

The CNN-based software allows a review of the VOIs provided automatically (i.e., VOIs can be added manually or incorrect ones deleted). Ultimately comparison of the CNN-based software with and without the observer’s review of the VOIs rendered the same metrics. However, the time spent determining the whole-body tumor burden metrics by the semiautomatic software was longer, because it depends primarily on the extent of the disease. The semiautomatic quantification does not allow preselection of VOIs by the operator before creating the definitive findings and thus does not distinguish diseased areas from physiologic areas, creating many VOIs that overload the program.

On the other hand, quantifying the whole-body tumor burden through CNN-based software was significantly faster, with and without the observer reviewing the VOIs. Impressively, when we compared quantification of the whole-body tumor burden on the CNN-based software (without observer interference) with the semiautomatic software and CNN-based software with observer interference, CNN-based software without the interference of the observer was significantly faster and just as precise. CNN-based software took as little as 20 s to calculate the patient’s entire tumor burden, without the need to review the VOIs (Figs. 4 and 5).

FIGURE 4.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 4.

Baseline staging 18F-FDG PET/CT of Hodgkin lymphoma. (A) Maximum-intensity projection reveals mediastinal hypermetabolic bulky mass and extensive infiltration of cervical lymph nodes, abdominal lymph nodes, and spleen. (B) Semiautomatic quantification reveals semiautomatic wbMTV of 548 and semiautomatic wbTLG of 5,238; time spent calculating was 15 min. (C) CNN whole-body tumor burden quantification demonstrates similar metrics: CNN wbMTV of 570 and CNN wbTLG of 5,213, but time spent calculating was significantly less (14 s). CNN software excludes focal areas of physiologic uptake such as right ureter and includes areas of mild uptake such as left hilar lymph node.

FIGURE 5.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 5.

18F-FDG PET/CT of patient with Hodgkin lymphoma. (A) Maximum-intensity projection reveals mediastinal hypermetabolic bulky mass and cervical, axillary, and inguinal nodes. (B) Semiautomatic VB20 whole-body tumor burden quantification reveals MTV of 194 and TLG of 1,007; time spent calculating these metrics was 30 min because of extent of lesions and need to exclude multiple areas of physiologic uptake. (C) CNN whole-body tumor burden quantification demonstrates similar metrics: MTV of 200 and TLG of 968. However, time spent calculating was significantly less (36 s). CNN software excludes physiologic areas with high uptake such as heart and includes lymph nodes with less uptake adjacent to heart.

However, there were some limitations. It was not possible to show whether the measurements predicted by the CNN-based software could be applied to our patient cohort to predict prognosis and response evaluation. Most (78.4%) of the patients had Hodgkin lymphoma, and there were only 2 deaths; therefore, it was not possible to determine overall survival. A larger number of patients with events are required to determine whether the measurements predicted by CNN-based software can predict prognosis. Another limitation is that 25% of the patients were excluded from analyses because the CNN-based software could not recognize areas of metabolically active disease and could not perform calculation. In such situations, these patients had to be excluded because there was no ability to compare CNN quantification with manual or semiautomatic quantification. The CNN software we tested was not initially designed or validated to quantify specifically pediatric patients but, even so, performed quite well. These exclusions were caused by either the wrong lesion being segmented or lesions being missed. For example, small lymph nodes with mild 18F-FDG uptake were excluded; extensive brown fat was erroneously included as lymphomatous infiltration; extensive diffuse bone marrow infiltration (5/12 patients) was missed; and radiopharmaceutical extravasation sites and bladder catheter were erroneously included. Most likely, with further CNN and deep-learning development and specific training in pediatric patients regarding differentiation of normal biodistribution from cancer tissue, failure rates will decrease.

CNN-based software with CNN and deep learning still requires the input of the observer (26–28). In 25% of the patients, CNN could not depict the correct neoplastic tissue or added nonneoplastic tissue; thus, quantification had to be excluded because the software was not performing the calculations. Therefore, errors and failure to detect proper tissue will occur even in CNN and DL software, arguing in favor of the observer input. Most likely, the largest errors may be associated with unsupervised quantification.

CONCLUSION

CNN-based quantification of whole-body tumor burden in pediatric lymphoma patients is an emerging field. Determination of whole-body tumor burden using CNN-based software is extremely fast and feasible in clinical practice in pediatric lymphoma patients. CNN-based software requires CNN and deep-learning development and specific training in pediatric patients, as well as the input of the observer to minimize failure rates. Tumor burden should be evaluated in most if not all tumors and age groups for therapy purposes.

DISCLOSURE

The whole-body metrics were calculated using a loaned Siemens device equipped with a software based on deep CNN (Syngovia VB50).

KEY POINTS

QUESTION: Will the use of CNN promote fast and reliable quantification data regarding whole-body metabolic tumor burden in 18F-FDG PET/CT pediatric lymphoma patients?

PERTINENT FINDINGS: Quantification of whole-body metabolic tumor burden using CNN correlates strongly with semiautomatic quantification (ICC, 0.993; 95% CI, 0.989 − 0.996; P < 0.0001).

IMPLICATIONS FOR PATIENT CARE: In addition to reliable data, implementation of CNN quantification tools in clinical practice may be able to quickly and accurately deliver prognostic information for better patient management.

ACKNOWLEDGMENT

We thank Cleide Silva from the Statistics Research Department of the University of Campinas for her invaluable help.

Footnotes

  • Published online Apr. 19, 2022.

REFERENCES

  1. 1.↵
    1. Ansell SM,
    2. Armitage JO
    . Positron emission tomographic scans in lymphoma: convention and controversy. Mayo Clin Proc. 2012;87:571–580.
    OpenUrlCrossRefPubMed
  2. 2.
    1. Cheson BD
    . PET/CT in lymphoma: current overview and future directions. Semin Nucl Med. 2018;48:76–81.
    OpenUrl
  3. 3.
    1. Kobe C,
    2. Dietlein M,
    3. Hellwig D
    . PET/CT for lymphoma post-therapy response assessment in Hodgkin lymphoma and diffuse large B-cell lymphoma. Semin Nucl Med. 2018;48:28–36.
    OpenUrl
  4. 4.
    1. Gillman J,
    2. States LJ,
    3. Servaes S
    . PET in pediatric lymphoma. PET Clin. 2020;15:299–307.
    OpenUrl
  5. 5.
    1. D’souza MM,
    2. Jaimini A,
    3. Bansal A,
    4. et al
    . FDG-PET/CT in lymphoma. Indian J Radiol Imaging. 2013;23:354–365.
    OpenUrl
  6. 6.
    1. Cronin CG,
    2. Swords R,
    3. Truong MT,
    4. et al
    . Clinical utility of PET/CT in lymphoma. AJR. 2010;194:W91–W103.
    OpenUrl
  7. 7.↵
    1. London K,
    2. Cross S,
    3. Onikul E,
    4. Dalla-Pozza L,
    5. Howman-Giles R
    . 18F-FDG PET/CT in paediatric lymphoma: comparison with conventional imaging. Eur J Nucl Med Mol Imaging. 2011;38:274–284.
    OpenUrlCrossRefPubMed
  8. 8.↵
    1. Lin C,
    2. Itti E,
    3. Haioun C,
    4. et al
    . Early 18F-FDG PET for prediction of prognosis in patients with diffuse large b-cell lymphoma: SUV-based assessment versus visual analysis. J Nucl Med. 2007;48:1626–1632.
    OpenUrlAbstract/FREE Full Text
  9. 9.↵
    1. Jhanwar YS,
    2. Straus DJ
    . The role of PET in lymphoma. J Nucl Med. 2006;47:1326–1334.
    OpenUrlAbstract/FREE Full Text
  10. 10.↵
    1. Yang J,
    2. Zhu S,
    3. Pang F,
    4. et al
    . Functional parameters of 18F-FDG PET/CT in patients with primary testicular diffuse large B-cell lymphoma. Contrast Media Mol Imaging. 2018;2018:8659826.
    OpenUrl
  11. 11.
    1. Jung S-H,
    2. Ahn J-S,
    3. Kim Y-K,
    4. et al
    . Prognostic significance of interim PET/CT based on visual, SUV-based, and MTV-based assessment in the treatment of peripheral T-cell lymphoma. BMC Cancer. 2015;15:198.
    OpenUrl
  12. 12.
    1. Albano D,
    2. Camoni L,
    3. Giubbini R,
    4. Bertagna F
    . Prognostic value of 18F-FDG PET/CT metabolic parameters in splenic marginal zone lymphoma. Clin Lymphoma Myeloma Leuk. 2020;20:e897–e904.
    OpenUrl
  13. 13.↵
    1. Wang X-Y,
    2. Zhao Y-F,
    3. Liu Y,
    4. Yang Y-K,
    5. Wu N
    . Prognostic value of metabolic variables of 18F-FDG PET/CT in surgically resected stage I lung adenocarcinoma. Medicine (Baltimore). 2017;96:e7941.
    OpenUrl
  14. 14.↵
    1. Salavati A,
    2. Duan F,
    3. Snyder BS,
    4. et al
    . Optimal FDG PET/CT volumetric parameters for risk stratification in patients with locally advanced non-small cell lung cancer: results from the ACRIN 6668/RTOG 0235 trial. Eur J Nucl Med Mol Imaging. 2017;44:1969–1983.
    OpenUrl
  15. 15.↵
    1. Wang L,
    2. Bai J,
    3. Duan P
    . Prognostic value of 18F-FDG PET/CT functional parameters in patients with head and neck cancer: a meta-analysis. Nucl Med Commun. 2019;40:361–369.
    OpenUrl
  16. 16.
    1. Brito AE,
    2. Mourato F,
    3. Santos A,
    4. Mosci C,
    5. Ramos C,
    6. Etchebehere E
    . Validation of the semiautomatic quantification of 18F-fluoride PET/CT whole-body skeletal tumor burden. J Nucl Med Technol. 2018;46:378–383.
    OpenUrlAbstract/FREE Full Text
  17. 17.↵
    1. Im H-J,
    2. Bradshaw T,
    3. Solaiyappan M,
    4. Cho SY
    . Current methods to define metabolic tumor volume in positron emission tomography: which one is better? Nucl Med Mol Imaging. 2018;52:5–15.
    OpenUrl
  18. 18.↵
    1. Han D,
    2. Bayouth J,
    3. Song Q,
    4. et al
    . Globally optimal tumor segmentation in PET-CT images: a graph-based co-segmentation method. Inf Process Med Imaging. 2011;22:245–256.
    OpenUrlPubMed
  19. 19.↵
    1. Camacho MR,
    2. Etchebehere E,
    3. Tardelli N,
    4. et al
    . Validation of a multifocal segmentation method for measuring metabolic tumor volume in Hodgkin lymphoma. J Nucl Med Technol. 2020;48:30–35.
    OpenUrlAbstract/FREE Full Text
  20. 20.↵
    1. Davenport T,
    2. Kalakota R
    . The potential for artificial intelligence in healthcare. Future Healthc J. 2019;6:94–98.
    OpenUrlPubMed
  21. 21.
    1. Deo RC
    . Machine learning in medicine. Circulation. 2015;132:1920–1930.
    OpenUrlAbstract/FREE Full Text
  22. 22.
    1. Shaw J,
    2. Rudzicz F,
    3. Jamieson T,
    4. Goldfarb A
    . Artificial intelligence and the implementation challenge. J Med Internet Res. 2019;21:e13659.
    OpenUrlCrossRefPubMed
  23. 23.↵
    1. Recht MP,
    2. Dewey M,
    3. Dreyer K,
    4. et al
    . Integrating artificial intelligence into the clinical practice of radiology: challenges and recommendations. Eur Radiol. 2020;30:3576–3584.
    OpenUrlCrossRefPubMed
  24. 24.↵
    1. Sibille L,
    2. Seifert R,
    3. Avramovic N,
    4. et al
    . 18F-FDG PET/CT uptake classification in lymphoma and lung cancer by using deep convolutional neural networks. Radiology. 2020;294:445–452.
    OpenUrl
  25. 25.
    1. Froelich JW,
    2. Salavati A
    . Artificial intelligence in PET/CT is about to make whole-body tumor burden measurements a clinical reality. Radiology. 2020;294:453–454.
    OpenUrlCrossRefPubMed
  26. 26.↵
    1. Currie G,
    2. Hawk EK,
    3. Rohren E,
    4. Vial A,
    5. Klein R
    . Machine learning and deep learning in medical imaging: intelligent imaging. J Med Imaging Radiat Sci. 2019;50:477–487.
    OpenUrl
  27. 27.↵
    1. Currie G
    . Intelligent imaging: anatomy of machine learning. J Nucl Med Technol. 2019;47:273–281.
    OpenUrlAbstract/FREE Full Text
  28. 28.↵
    1. Currie G,
    2. Rohren E
    . Intelligent imaging in nuclear medicine: the principles of artificial intelligence, machine learning and deep learning. Semin Nucl Med. 2021;51:102–111.
    OpenUrl
  29. 29.↵
    1. Jaffe ES,
    2. Barr PM,
    3. Smith SM
    . Understanding the new WHO classification of lymphoid malignancies: why it’s important and how it will affect practice. Am Soc Clin Oncol Educ Book. 2017;37:535–546.
    OpenUrl
  30. 30.↵
    1. Boellaard R,
    2. Delgado-Bolton R,
    3. Oyen WJG,
    4. et al
    . FDG PET/CT: EANM procedure guidelines for tumour imaging—version 2.0. Eur J Nucl Med Mol Imaging. 2015;42:328–354.
    OpenUrlCrossRefPubMed
  • Received for publication July 14, 2021.
  • Accepted for publication February 10, 2022.
PreviousNext
Back to top

In this issue

Journal of Nuclear Medicine Technology: 50 (3)
Journal of Nuclear Medicine Technology
Vol. 50, Issue 3
September 1, 2022
  • Table of Contents
  • About the Cover
  • Index by author
  • Complete Issue (PDF)
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on Journal of Nuclear Medicine Technology.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Validation of Convolutional Neural Networks for Fast Determination of Whole-Body Metabolic Tumor Burden in Pediatric Lymphoma
(Your Name) has sent you a message from Journal of Nuclear Medicine Technology
(Your Name) thought you would like to see the Journal of Nuclear Medicine Technology web site.
Citation Tools
Validation of Convolutional Neural Networks for Fast Determination of Whole-Body Metabolic Tumor Burden in Pediatric Lymphoma
Elba Etchebehere, Rebeca Andrade, Mariana Camacho, Mariana Lima, Anita Brink, Juliano Cerci, Helen Nadel, Chandrasekhar Bal, Venkatesh Rangarajan, Thomas Pfluger, Olga Kagna, Omar Alonso, Fatima K. Begum, Kahkashan Bashir Mir, Vincent Peter Magboo, Leon J. Menezes, Diana Paez, Thomas NB Pascual
Journal of Nuclear Medicine Technology Sep 2022, 50 (3) 256-262; DOI: 10.2967/jnmt.121.262900

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Validation of Convolutional Neural Networks for Fast Determination of Whole-Body Metabolic Tumor Burden in Pediatric Lymphoma
Elba Etchebehere, Rebeca Andrade, Mariana Camacho, Mariana Lima, Anita Brink, Juliano Cerci, Helen Nadel, Chandrasekhar Bal, Venkatesh Rangarajan, Thomas Pfluger, Olga Kagna, Omar Alonso, Fatima K. Begum, Kahkashan Bashir Mir, Vincent Peter Magboo, Leon J. Menezes, Diana Paez, Thomas NB Pascual
Journal of Nuclear Medicine Technology Sep 2022, 50 (3) 256-262; DOI: 10.2967/jnmt.121.262900
Twitter logo Facebook logo LinkedIn logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One
Bookmark this article

Jump to section

  • Article
    • Visual Abstract
    • Abstract
    • MATERIALS AND METHODS
    • RESULTS
    • DISCUSSION
    • CONCLUSION
    • DISCLOSURE
    • ACKNOWLEDGMENT
    • Footnotes
    • REFERENCES
  • Figures & Data
  • Info & Metrics
  • PDF

Related Articles

  • No related articles found.
  • PubMed
  • Google Scholar

Cited By...

  • No citing articles found.
  • Google Scholar

More in this TOC Section

  • National Diagnostic Reference Levels for Nuclear Medicine in Qatar
  • Reducing Radiation Exposure from PET Patients
Show more Basic Science Investigation

Similar Articles

Keywords

  • 18F-FDG PET/CT
  • whole-body tumor burden
  • pediatric
  • lymphoma
SNMMI

© 2025 SNMMI

Powered by HighWire