|Year : 2019 | Volume
| Issue : 5 | Page : 710-715
Validation of a simple computed tomography scoring system to predict the malignant nature of pleural effusion
Rania A Sweed, Ayman I Baess
Department of Chest Diseases, Faculty of Medicine, Alexandria University, Alexandria, Egypt
|Date of Submission||22-May-2019|
|Date of Acceptance||05-Sep-2019|
|Date of Web Publication||21-Jan-2020|
MD, PhD Ayman I Baess
Department of Chest Diseases, Faculty of Medicine, Alexandria University, Alexandria, 21613
Source of Support: None, Conflict of Interest: None
Objective We aimed to validate a computed tomography (CT) scoring system and assess its sensitivity and specificity to predict the malignant nature of pleural effusion that is exudative and of undetermined origin.
Patients and methods This is a retrospective study that enrolled 123 patients who were referred for medical thoracoscopy in the Chest Department, Alexandria Main University Hospital, between 2013 and 2017 for diagnosing exudative pleural effusion of undetermined origin. CT scans were reviewed by a radiologist who was blinded to the final diagnosis. We applied a scoring system that was generated by Porcel et al. Scoring results were then evaluated using the final diagnosis of thoracoscopic pleural biopsies as the reference.
Results The CT score showed a sensitivity and a specificity of 70 and 66.7%, respectively, with an negative predictive value 83% and a positive predictive value 48%, and the area under the receiver operating characteristic curve was 0.745.using a cut-off value of at least 7.
Conclusion The CT scoring system could not predict the malignant nature of exudative effusion with great accuracy.
Keywords: computed tomography scoring system, malignant pleural effusion, predictors of malignancy
|How to cite this article:|
Sweed RA, Baess AI. Validation of a simple computed tomography scoring system to predict the malignant nature of pleural effusion. Egypt J Bronchol 2019;13, Suppl S1:710-5
|How to cite this URL:|
Sweed RA, Baess AI. Validation of a simple computed tomography scoring system to predict the malignant nature of pleural effusion. Egypt J Bronchol [serial online] 2019 [cited 2020 Jul 15];13, Suppl S1:710-5. Available from: http://www.ejbronchology.eg.net/text.asp?2019/13/5/710/276287
| Introduction|| |
Pleural effusion has been known to be a clinical challenge as differentiating benign from malignant effusion is not an easy task ,,. Contrast computed tomography (CT) is an important step in the diagnostic pathway of undiagnosed exudative pleural effusions . Nevertheless, the value of CT in differentiating between benign and malignant causes of pleural disease is undetermined . Few studies have explored the value of CT in predicting the malignant nature of pleural effusions ,,. This study aimed to validate a CT scoring system and assess its sensitivity and specificity to predict the malignant nature of pleural effusion that is exudative and of undetermined origin.
| Patients and methods|| |
This is a retrospective study that enrolled 134 patients who were referred for medical thoracoscopy in the Chest Department, Alexandria Main University Hospital, between 2013 and 2017 for diagnosing exudative pleural effusion after failure to reach a definite diagnosis using noninvasive workup. Patients of both sexes were included, aged 18 years or older, and presenting with exudative undiagnosed pleural effusion either unilateral or bilateral. Patients unfit for medical thoracoscopy, patients suffering from pleural effusion with extensive loculations, patients weighing more than 120 kg, patients whose data were incomplete, and finally patients whose final diagnosis was inconclusive were excluded from our study and the final number of patients who fulfilled our inclusion criteria was 123 patients.
Demographics, clinical data, laboratory investigations, and radiology of all patients were reviewed as well as the final diagnosis on the basis of histopathological and microbiological examination results of pleural biopsies obtained using medical thoracoscopy. The initial workup included plain radiograph of the chest postero-anterior (PA) view, pleural tapping, and analysis of pleural fluid (chemical, bacteriological smears and cultures, and cytopathological examination). CT scans were reviewed by a radiologist who was blinded to the final diagnosis. We applied a scoring system that was generated by Porcel et al.  (score sum ranging from 0 to 20; [Table 1]). Scoring results were then evaluated using the final diagnosis of thoracoscopic pleural biopsies as the reference. The performance parameters of the CT scoring system were evaluated including sensitivity, specificity; positive predictive value (PPV), negative predictive value (NPV), and area under receiver operating characteristic curve.
|Table 1 Computed tomography scan score for predicting the malignant etiology of pleural effusions|
Click here to view
Statistical analysis of the data
Data were fed to the computer and analyzed using the IBM SPSS software package version 20.0. (IBM Corp., Armonk, New York, USA). Qualitative data were described using number and percent. Quantitative data were described using range (minimum and maximum), mean, SD, and median. The significance of the results obtained was judged at the 5% level. The χ2-test was used for categorical variables, to compare between different groups. Fisher’s exact or Monte Carlo correction was used for correction for χ2 when more than 20% of the cells have an expected count less than 5. The Student t-test for normally distributed quantitative variables was used to compare between two studied groups. The Mann–Whitney test was used for abnormally distributed quantitative variables to compare between two studied groups. A receiver operating characteristic curve (ROC) was generated by plotting sensitivity (TP) on the y-axis versus 1−specificity (FP) on the x-axis at different cut-off values. The area under the ROC curve denotes the diagnostic performance of the test. Area more than 50% yields acceptable performance and area about 100% is the best performance for the test. The ROC curve also allows a comparison of performance between two tests. Results were judged at a level of significance of 5%.
| Results|| |
We reviewed the data of 134 patients who underwent medical thoracoscopy during the period 2014 and 2018. We enrolled only 123 patients who fulfilled our inclusion criteria. The majority of the patients (70.7%) were finally diagnosed with malignant pleural effusion ([Figure 1]). Demographic and clinical data of the patients studied are shown in [Table 2]. Patients with malignant disease were older than those with benign disease. Patients with malignant pleural effusion experienced cough, chest pain, and weight loss more significantly compared with patients with pleural effusion of benign nature. However, patients with benign pleural effusions suffered from fever more significantly than patients with malignant pleural effusion. The CT findings were compared between benign and malignant groups ([Table 3]). The presence of pleural thickening, pleural nodules, pleural masses, lung parenchymal nodules, or masses, in addition to isolated mediastinal pleural thickening, were significantly more common in the malignant group, whereas the presence of parenchymal consolidation was in favor of benign disease. The comparison between the CT score sum in the benign versus the malignant group is presented in [Figure 2]. The performance of the CT score in predicting the malignant nature of the pleural effusion was assessed in terms of sensitivity, specificity, PPV, NPV, and area under the ROC curve ([Table 4] and [Figure 3]). The CT score showed a sensitivity and a specificity of 70 and 66.7%, respectively, with an NPV 83% and a PPV of 48%, and the area under the ROC curve was 0.745 and the 95% confidence interval was between 0.650 and 0.839 (P<0.001) using a cut-off value of at least 7. Use of higher cut-off values resulted in reduced sensitivity and higher specificity.
|Figure 1 Distribution of the studied cases according to the final diagnosis.|
Click here to view
|Table 2 Comparison between the two groups studied according to demographic and clinical data|
Click here to view
|Table 3 Comparison between the two groups studied according to computed tomography findings|
Click here to view
|Figure 2 Comparison between the two groups studied according to computed tomography scoring.|
Click here to view
|Table 4 Agreement (sensitivity, specificity, positive predictive value, and negative predictive value) for computed tomography scoring as a predictor for malignancy|
Click here to view
|Figure 3 Receiver operating characteristic curve for computed tomography scoring as a predictor for malignancy.|
Click here to view
| Discussion|| |
Of 123 (71%) patients enrolled in this study, the majority of the patients were finally diagnosed with malignant effusion. We attribute this high prevalence of malignancy among our studied patients to the fact that the study was carried out in a tertiary care hospital; moreover, only patients who underwent medical thoracoscopy were enrolled, which might reflect indirect suspicion of malignancy from the clinician point of view in addition to the fact that 8% of our studied patients reported heavy occupational exposure to asbestos. Other studies showed a lower prevalence of malignancy of about 25% ,.
We compared benign and malignant patient groups in terms of the individual parameters used in the CT scoring system and other CT findings ([Table 2]). Some parameters such as pleural thickening, pleural nodules, pleural masses, lung parenchymal nodules, and lung masses were seen significantly more frequently in the malignant group of patients in comparison with the benign group (P<0.05). However, other parameters of the cardiac silhouette did not show any significant difference between both groups. The presence of isolated mediastinal pleural lesion, although not included in this score, was significantly more frequent in patients with malignant effusion. The addition of this parameter might improve the performance of this CT scoring system. A number of previous studies found that CT findings of pleural nodularity, thickening of mediastinal pleura, and thickening of parietal pleural more than 1 cm and circumferential pleural thickening could predict the malignant cause of pleural effusion, with specificities ranging from 90 to 100% and sensitivities of 40–60% ,,. Another study investigated the sensitivity and specificity of CT in detecting the malignant cause of pleural effusion according to the radiologist impression before pathology results of thoracoscopic pleural biopsies, yielding a sensitivity of 68% and a specificity of 78% .
The score that we used in this study was derived and validated by Porcel et al.  Their study reported that this CT score using a sum score of 7 or more as a cut-off value yielded a sensitivity of 88%, a specificity of 94% [95% confidence interval (CI): 83–98%], and an area under the receiver operating characteristics curve of 0.919 (95% CI: 0.849–0.990). In contrast, in our study, using this cut-off value, this score showed lower performance as the sensitivity and specificity were 70 and 66.7%, respectively, with an NPV of 83% and a PPV of 48%, and the area under the ROC curve was 0.745. It is worth noting that unlike Porcel et al. , who enrolled only patients with unilateral effusion, in this study, we enrolled patients with both unilateral and bilateral effusion.
The results of this study showed that a simple score on the basis of CT findings is not very accurate or reliable. Use of special techniques might improve the performance of a CT-based score. A recent study reported that pleural attenuation is more evident for the delayed phase in comparison with the early phase of contrast-enhanced CT chest . Another study validated a simple PET-CT score and showed that it can be useful to differentiate malignant from benign causes of pleural disease . In this study, five PET-CT parameters proved to be predictive of malignancy. These were unilateral lung nodules and/or masses with increased 18F-FDG uptake; extrapulmonary malignancies; pleural thickening with increased 18Flourine-FluoroDeoxyGlucose (18F-FDG) uptake; multiple nodules or masses in one or both lungs with increased 18F-FDG uptake; and increased pleural effusion 18F-FDG uptake. No single individual CT-PET parameter was predictive of malignancy, but was useful when combining more than one parameter together. A score of 4 or greater produced area under the curve, sensitivity, and specificity of 0.949, 83.3, and 92.2%, respectively, which is much higher than the AUC, sensitivity, and specificity in our study. However, a meta-analysis of 14 studies reported that PET imaging showed a significantly lower sensitivity for diagnosing malignant effusions than visual assessments (82 vs. 91%; P=0.026). Semiquantitative interpretations for identifying malignant effusions showed a sensitivity of 81%, a specificity of 74%, and area under the curve of 0.838, concluding that the moderate accuracy of the technique using 18-fluorodeoxyglucose is against its routine use to differentiate malignant from benign pleural effusions . The same author developed and validated a CT scoring system for adults with parapneumonic pleural effusion that may allow clinicians to predict the need for chest tube drainage with good accuracy .
A large proportion of patients investigated for suspected malignant disease will show final results of malignancy irrespective of CT report impression; hence, the CT solely should not direct whether patients with pleural effusion should undergo further invasive pleural biopsies or not. This is in agreement with a retrospective series that suggests that approximately one-third of the patients with pleural malignancy may not show evident features of cancer on CT . Moreover, in the study of Safwat et al. , although a sensitivity of 70% was found for CT chest to detect primary pleural tumors as ‘high’, CT chest failed to define parietal pleural invasion in 30%, visceral pleural involvement in 60%, and fibrinous septations in 10% of their enrolled patients.
Whether CT could save fragile patients, a more invasive procedure was an important consideration, if combined with close follow-up and observation. Adding mediastinal pleural lesion to CT parameters may improve the performance of this score in addition to considering other factors such as patient age, which was significantly higher in the malignant group of patients; in addition, important clinical data such as cough, chest pain, and significant weight loss were significantly more frequently reported also by the malignant group of patients, whereas the presence of fever was in favor of benign rather than malignant effusion.
In our opinion, creating a score that combines CT parameters with age and clinical data may be more informative and predictive of the final patient diagnosis than an isolated score based merely on CT. All the studies that discussed CT scores as predictors of malignancy showed low sensitivity even if the specificity was high. This is not accepted in a disease such as pleural effusion that is known that the majority of its patients will eventually turn out to be malignant.The strengths of our study were the fact that thoracoscopic pleural biopsy was considered the reference standard for the final diagnosis as well as the relatively large number of patients studied. The limitations of the current study are as follows: patients who were unfit or refused medical thoracoscopy were not included. Patients with extensive adhesions were also excluded as this was a contraindication for medical thoracoscopy. Morbidly obese patients whose weight exceeded that allowed to lay supine on CT table were also excluded (>120 kg). Furthermore, we only considered exudative pleural effusions, whereas malignancy can be associated with transudative effusion ,,.
| Conclusion|| |
CT-based scoring system cannot predict the malignant nature of exudative effusion with high accuracy; neither can it help taking the decision to continue or stop further investigations.
Financial support and sponsorship
Conflicts of interest
There are no conflicts of interest.
| References|| |
Porcel JM, Esquerda A, Vives M, Bielsa S. Etiology of pleural effusions: analysis of more than 3,000 consecutive thoracenteses. Arch Bronconeumol
Gunnels J. Perplexing pleural effusions. Chest
Rubins JB, Colice GL. Evaluating pleural effusions. Postgrad Med J
Hooper C, Lee YC, Maskell N. Investigation of a unilateral pleural effusion in adults: British Thoracic Society pleural disease guideline2010. Thorax
Clive AO, Kahan BC, Hooper CE, Bhatnagar R, Morley AJ, Zahan Evan N et al.
Predicting survival in malignant pleural effusion: development and validation of the LENT prognostic score. Thorax
Traill ZC, Davies RJ, Gleeson FV. Thoracic computed tomography in patients with suspected malignant pleural effusions. Clin Radiol
Hallifax RJ, Haris M, Corcoran JP, Leyakathalikhan S, Brown E, Srikantharaja D et al.
Role of CT in assessing pleural malignancy prior to thoracoscopy. Thorax
Porcel JM, Pardina M, Bielsa S, González A, Light RW. Derivation and validation of a CT scan scoring system for discriminating malignant from benign pleural effusions. Chest
Marel M, Zrustova M, Stasny B, Light RW. The incidence of pleural effusion in a well-defined region. Epidemiologic study in central Bohemia. Chest
Leung AN, Müller NL, Miller RR. CT in differential diagnosis of diffuse pleural disease. Am J Roentgenol
Scott EM, Marshall TJ, Flower CD, Stewart S. Diffuse pleural thickening: percutaneous CT-guided cutting needle biopsy. Radiology
Davies HE, Nicholson JE, Rahman NM, Wilkinson EM, Davies RJ, Lee YC. Outcome of patients with nonspecific pleuritis/fibrosis on thoracoscopic pleural biopsies. Eur J Cardiothorac Surg
Arenas-Jiménez JJ, García-Garrigós E, Escudero-Fresneda C, Sirera-Matilla M, García-Pastor I et al.
Early and delayed phases of contrast-enhanced CT for evaluating patients with malignant pleural effusion. Results of pairwise comparison by multiple observers. Br J Radiol
Yang MF, Tong ZH, Wang Z, Yang MF, Tong ZH, Wang Z et al.
Development and validation of the PET-CT score for diagnosis of malignant pleural effusion. Eur J Nucl Med Mol Imaging
Porcel JM, Hernandez P, Martinez-Alonso M, Bielsa S, Salud A. Accuracy of fluorodeoxyglucose-PET imaging for differentiating benign from malignant pleural effusions: a meta-analysis. Chest
Porcel JM, Parinda M, Aleman C, Pallisa E, Light RW, Bielsa S. Computed tomography scoring system for discriminating between parapneumonic effusions eventually drained and those cured only with antibiotics. Respirology
Tsim S, Stobo DB, Alexander L, Kelly C, Blyth KG. The diagnostic performance of routinely acquired and reported computed tomography imaging in patients presenting with suspected pleural malignancy. Lung Cancer
Safwat T, Sharkawy S, Shoukri A, Mohamed S. Correlation between computed tomography of the chest and medical thoracoscopic findings in primary pleural tumors. Egypt J Bronchol
Walker S, Maskell N. Identification and management of pleural effusions of multiple aetiologies. Curr Opin Pulm Med
Gonlugur TE, Gonlugur U. Transudates in malignancy: still a role for pleural fluid. Ann Acad Med Singapore
Bintcliffe OJ, Hooper CE, Rider IJ, Finn RS, Morley AJ, Zahan E et al.
Unilateral pleural effusions with more than one apparent etiology. A prospective observational study. Ann Am Thorac Soc
[Figure 1], [Figure 2], [Figure 3]
[Table 1], [Table 2], [Table 3], [Table 4]