Int J Med Sci 2020; 17(12):1704-1712. doi:10.7150/ijms.47073 This issue
Department of Biliary Surgery, West China Hospital, Sichuan University, Chengdu 610041, Sichuan Province, China.
Background: Gallbladder cancer (GBC) is the most common malignancy of the biliary system. Early T stage GBC patients with distant metastasis are proven to have a worse prognosis. In this study, our aim was to construct and validate a novel nomogram for predicting distant metastasis in T1 and T2 GBC.
Methods: Between 2004 and 2014, patients with T1 and T2 GBC were identified in the Surveillance, Epidemiology, and End Results (SEER) database. All of the eligible patients were randomly divided into training and validation cohorts. Univariate and multivariate analyses were used to assess significant predictive factors associated with distant metastasis. A nomogram was developed and validated by a calibration curve and receptor operating characteristic curve (ROC) analysis.
Results: According to the inclusion and exclusion criteria, 3013 patients with historically confirmed AJCC stage T1 and T2 GBC were enrolled. Younger age, high pathological grade, nonadenocarcinoma, T1, N1 and larger tumor size correlated positively with the risk of distant metastasis. A novel nomogram was established to predict distant metastasis in early T stage GBC patients. Internal validation with a calibration plot in the training cohort showed that this nomogram was well calibrated. Through ROC curve analysis, the areas under the ROC curves in the training and validation cohorts were 0.723 and 0.679, respectively.
Conclusions: Although some limitations exist in this predictive model, the nomogram revealed the relationship between the clinicopathological characteristics of T1 and T2 GBC patients and the risk of distant metastasis. The novel nomogram will assist in patient counseling and guide treatment decision making for T1 and T2 GBC patients.
Keywords: Nomogram, gallbladder cancer, SEER.
Gallbladder cancer (GBC) is the most common malignancy of the biliary system, representing 80-95% of all biliary tract cancers worldwide . Despite the development of diagnosis, surgery, and chemotherapy during the last decade, GBC remains an aggressive cancer with an overall dismal outcome . One reason for the unsatisfactory prognosis is the lack of effective screening and early symptoms, which contribute to the relatively delayed presentation of the disease. Nonetheless, GBC itself is a highly malignant tumor; thus, early distant metastasis usually occurs. For patients with resected T2 lesions, 16% have been found to have distant metastasis . Distant metastasis is most often found in the liver, lung, and peritoneum; the liver, an adjacent organ, is the leading metastatic site, accounting for over 50% of GBC patients with metastasis .
According to the American Joint Committee on Cancer (AJCC) staging system, distant metastasis (M1) with any T or any N stage is defined as Stage IV . The 5-year survival rate of Stage IV patients is only 1% . This trend suggests that distant metastasis often has a worse prognosis. Particularly for early T stage patients, such as T1 and T2, oncologists or hepatobiliary surgeons may overlook the possibility of distant metastasis, resulting in insufficient preoperative diagnostic examinations, follow-up, and postoperative comprehensive treatment. However, few studies to date have evaluated the risk factors or a predictive model of distant metastasis in GBC. A recent 10-institution study from America showed that advanced T-stage, grade, and presence of lymphovascular and perineural invasion were all associated with increased rates of distant metastasis . It is worth noting that substantial heterogeneity exists among GBC patients in terms of demographic and clinicopathological information, such as age, sex, pathological type, and tumor size. Therefore, a well-designed predictive model of distant metastasis in T1 and T2 GBC patients that covers all factors is needed.
A nomogram is a very useful tool and popular visual plot to display the predicted probabilities of an event for decision support. Therefore, in this study, our aim was to construct and validate a novel nomogram for predicting distant metastasis in T1 and T2 GBC patients using a cohort from the Surveillance, Epidemiology, and End Results (SEER) database.
Gallbladder cancer patient data between 2004 and 2014 were extracted from the SEER registry program of the National Cancer Institute. The SEER database consists of 18 population-based cancer registries among 14 states across the US, including nearly 28% of the US population. The AJCC staging system (6th edition) definitions are as follows: T1 is defined as a tumor invading the lamina propria or muscle layer; T2 is defined as a tumor invading the perimuscular connective tissue, with no extension beyond the serosa or into the liver; N0 means no regional lymph node metastasis; N1 means regional lymph node metastasis; M0 means no distant metastasis; and M1 means distant metastasis.
The inclusion criteria for selection data in this study were as follows: 1) AJCC (6th edition) stage T1 and T2; 2) age >18 years old; 3) diagnosis confirmed by positive histology; and 4) only one primary tumor. The exclusion criteria included the following: 1) data, such as age, sex, T stage and M stage, missing or incomplete; 2) diagnosis before 2004 because the AJCC (6th edition) stage status was not included in the database.
The demographic variables of marital status at diagnosis, age at diagnosis, race, sex, and tumor characteristics of differentiation grade, histological type, T stage, N stage, M stage, and tumor size were collected from the SEER database using SEER-stat software. Because the histological type is mostly adenocarcinoma, the subhistological subtype was classified as adenocarcinoma and others. The SEER database is freely available and has patient anonymization; thus, approval from the ethics committee is not required.
All of the eligible T1 and T2 patients extracted from the SEER database were randomly divided into training (60%) and validation (40%) cohorts to establish and validate the nomogram. Furthermore, these two cohorts were divided into two groups according to M stage.
Though univariate analysis, we identified statistically significant variables by screening the clinical characteristics associated with M status. Then, multivariate analysis was used to determine the significant predictive factors among those variables. Finally, on the basis of the analysis results, we used the software R (version 3.6.1) to formulate the nomogram with several packages. To validate the nomogram, a calibration curve with 1000 bootstrap resamples was used in the training set, reflecting the association between the actual probability and predicted probability of positive distant metastasis . Moreover, in both the training and validation cohorts, the sensitivity and specificity of the nomogram for predicting distant metastasis were assessed by receiver operating characteristic (ROC) curves and the area under the curve (AUC) value.
SPSS 21.0 statistical software was used for analysis. The method of univariate analysis used was the chi-square test because the data involved in this study are dichotomous variables. Multivariate analysis was carried out by logistic regression, and odds ratios (ORs) and 95% confidence intervals (CIs) were calculated. A p value of less than 0.05 was considered significant.
Nomograms from multivariable logistic models are a popular visual plot to display the predicted probabilities of an event for decision support . To formulate a nomogram to display the prediction of distant metastasis in early gallbladder carcinoma, the software R 3.6.1 was utilized. The SAS code used in R is according to Lassos A's report . Several R packages, including rms, Hmisc, lattice, survival, Formula, and ggplot2, were used to establish the nomogram (available at URL: http://cran.r-project.org/web/packages/).
From 2004 to 2014, 11,061 patients diagnosed with gallbladder cancer were found through the SEER*Stat client-server system. A total of 4619 patients with AJCC stage T0 (n =24), T3 (n =3154), T4 (n =466) and TX (n =812, T status data were missing) were excluded; an additional 60 patients with missing M status data were excluded. The flow diagram for the patient selection is presented in Figure 1. Ultimately, 3013 patients with historically confirmed AJCC stage T1 and T2 were identified. Among them, 538 patients (17.9%) were positive for distant metastasis. Eligible patients were randomized and divided into training (n = 1808, 60%) and validation (n= 1205, 40%) cohorts to formulate and validate the nomogram.
The demographics and clinicopathological characteristics assessed in the three cohorts are summarized in Table 1. The following data were extracted from the SEER database: age, sex, race, marital status, grade, histology, T stage, N stage, M stage and tumor size. In general, the majority of cases were female (2164, 71.8%) and white (2286, 73,7%). Most of the patients had adenocarcinoma (2701, 89.5%). Grade II (1244, 41.2%), T2 (1920, 63.7%), N0 (2261, 75.0%) and larger tumor size (≥ 2, 1517, 50.3%) were more common. The baseline characteristics were balanced between the training and validation cohorts.
The flow diagram of patient selection.
The results of univariate analysis in the training cohort are listed in Table 2. Age, grade, histological type, T stage, N stage and tumor size were identified as being significantly (p < 0.05) associated with M1. All significant factors in the univariate analysis were included in multivariate logistic regression analysis (Table 2), which indicated that younger patients were more likely than older patients to have distant metastasis (age ≤ 70 vs > 70, OR= 0.591, P= 0.001). Grade I patients had the lowest risk of M1 (I vs II, III, IV, OR= 2.988, 4.800, 5.573, P< 0.001). The risk of M1 in patients with adenocarcinoma was lower than that in patients with other histological types (adenocarcinoma vs others, OR= 1.521, P= 0.023). Regarding T and N stage, T1 and N1 were associated with a higher risk of M1 (T1 vs T2, OR= 0.747, P= 0.04; N0 vs N1, OR= 3.024, P< 0.001). Finally, a larger tumor indicated a higher risk of M1 (<2 vs ≥ 2 cm, OR= 1.578, P= 0.004). All the above variables showed a statistically significant predictive capability for M1. After excluding unknown data on grade and tumor size, the remaining factors were selected for building the nomogram.
Demographics and clinical characteristics of the whole, training and validation cohorts.
|Variables||Whole cohort (n = 3013)||Training cohort (n = 1808)||Validation cohort (n = 1205)|
|M0 (n = 2475)||M1 (n = 538)||M0 (n = 1458)||M1 (n = 350)||M0 (n = 1017)||M1 (n = 188)|
|≤ 70||1185 (47.8%)||300 (55.7%)||709 (48.6%)||202 (57.7%)||476 (46.8%)||98 (52.1%)|
|> 70||1290 (52.2%)||238 (44.3%)||749 (51.4%)||148 (42.3%)||541 (53.2%)||90 (48.9%)|
|Male||699 (28.2%)||150 (27.9%)||402 (27.6%)||91 (26.0%)||297 (29.2%)||59 (31.4%)|
|Female||1776 (71.8%)||388 (72.1%)||1056 (72.4%)||259 (74.0%)||720 (70.8%)||129 (68.6%)|
|White||1883 (76.1%)||403 (74.9%)||1126 (77.3%)||254 (72.6%)||757 (74.4%)||149 (79.3%)|
|Black||293 (11.8%)||73 (13.6%)||161 (11.0%)||53 (15.1%)||132 (13.0%)||20 (10.6%)|
|Othersa||299 (12.1%)||62 (11.5%)||171 (11.7%)||43 (12.3%)||128 (12.6%)||19 (10.1%)|
|Married||1217 (49.1%)||280 (52.0%)||725 (49.7%)||167 (47.7%)||492 (48.3%)||113 (60.1%)|
|Unmarriedb||1258 (50.9%)||258 (48.0%)||733 (50.3%)||183 (52.3%)||525 (51.7%)||75 (39.9%)|
|I||516 (20.8%)||31 (5.8%)||279 (19.1%)||14 (4.0%)||237 (23.3%)||17 (9.0%)|
|II||1074 (43.4%)||170 (31.6%)||632 (43.3%)||108 (30.8%)||442 (43.5%)||62 (33.0%)|
|III||626 (25.3%)||186 (34.6%)||391 (26.9%)||127 (36.3%)||235 (23.1%)||59 (31.4%)|
|IV||34 (1.4%)||15 (2.8%)||20 (1.4%)||8 (2.3%)||14 (1.4%)||7 (3.7%)|
|Unknow||225 (9.1%)||136 (25.2%)||136 (9.3%)||93 (26.6%)||89 (8.7%)||43 (22.9%)|
|Adenocarcinoma||2264 (91.5%)||437 (81.2%)||1330 (91.2%)||285 (81.4%)||934 (91.8%)||152 (80.9%)|
|Othersc||211 (8.5%)||101 (18.8%)||128 (8.8%)||65 (18.6%)||83 (8.2%)||36 (19.1%)|
|T1||863 (34.9%)||230 (42.8%)||510 (35.0%)||153 (43.7%)||353 (34.7%)||77 (40.9%)|
|T2||1612 (65.1%)||308 (57.2%)||948 (65.0%)||197 (56.3%)||664 (65.3%)||111 (59.1%)|
|N0||1957 (79.0%)||304 (56.5%)||1149 (78.8%)||183 (52.3%)||808 (79.4%)||121 (64.4%)|
|N1||518 (11.0%)||234 (43.5%)||309 (11.2%)||167 (47.7%)||209 (10.6%)||67 (35.6%)|
|< 2||800 (32.3%)||116 (21.6%)||484 (33.2%)||78 (22.3%)||316 (31.1%)||38 (20.2%)|
|≥ 2||1217 (49.2%)||300 (55.8%)||706 (48.4%)||200 (57.1%)||511 (50.2%)||100 (53.2%)|
|Unknow||458 (18.5%)||122 (22.6%)||268 (18.4%)||72 (20.6%)||190 (18.7%)||50 (26.6%)|
Data expressed as a number (%). aIncludes: American Indian/native Alaskan and Asian/Pacific Islander; bIncludes: divorced, separated, single, domestic partner and widowed; cIncludes: epithelial neoplasms, cystic, mucinous and serous neoplasms, squamous cell neoplasms.
Nomogram predicting the probability of distant metastasis.
Univariate and multivariate analysis in the training cohort.
|Variables||Univariate analysis p value||Multivariate analysis||Selected factors for building nomogram|
|P||OR||95% CI||P||OR||95% CI||P|
|≤ 70||1 (reference)||1 (reference)|
|II||2.988||1.669-5.348||< 0.001||2.988||1.669-5.348||< 0.001|
|III||4.800||2.655-8.646||< 0.001||4.800||2.655-8.646||< 0.001|
|Unknow||9.562||136 (59.4%)||< 0.001|
|N stage||< 0.001|
|N1||3.024||2.323-3.938||< 0.001||3.024||2.323-3.938||< 0.001|
|Tumor size||< 0.001|
|< 2||1 (reference)|
Data expressed as a number (%). aIncludes: American Indian/native Alaskan and Asian/Pacific Islander; bIncludes: divorced, separated, single, domestic partner and widowed; cIncludes: epithelial neoplasms, cystic, mucinous and serous neoplasms, squamous cell neoplasms.
Calibration plot of the nomogram for the probability of distant metastasis (bootstrap 1000 repetitions).
Significant independent factors, including age, differentiation grade, histological type, T stage, N stage and tumor size, were incorporated to establish the nomogram (Figure 2). As shown, each factor within these variables was assigned a score on the point of the scale. An age ≤ 70 years old was scored as 30; an age > 70 years old was scored as 0. Differentiation grades I, II, III, and IV were scored as 0, 33.3, 66.7 and 100, respectively. Adenocarcinoma was scored as 0, and others were scored as 15. T1 was scored as 5, and T2 was scored as 0. N1 was scored 45 and N0 0. A tumor size ≥ 2 cm was scored as 25, and a tumor size less than 2 cm was scored as 0. By summing the scores for each variable, we can predict the probability of M1 in a specific patient. For example, a younger patient with nonadenocarcinoma of grade IV, T1, and N1 and larger tumor size (score: 220) had a higher risk of M1. However, a younger adenocarcinoma patient with grade II, T2, and N0 and a smaller tumor (score: 63.3) had a lower risk of M1. The risk of M1 based on our nomogram ranged from 0.05 to 0.7.
Validation of the nomogram. (A) the training cohort; (B) the validation cohort.
To test the performance of the nomogram, it was subjected to 1000 bootstrap resamples for internal validation with a calibration plot in the training cohort (Figure 3). The results showed that this nomogram was well calibrated. Moreover, by using ROC curves, we evaluated the effectiveness of the nomogram in predicting distant metastasis in both the training and validation cohorts (Figure 4A, 4B). In the training cohort, the AUC was 0.723 (95%CI: 0.6865-0.7586, sensitivity: 0.6502, specificity: 0.7009). In the validation cohort, the AUC was 0.679 (95%CI: 0.624-0.7341, sensitivity: 0.5234, specificity: 0.7631). The results further confirmed the effectiveness of the nomogram in predicting M status.
GBC is a dreadful disease because approximately 70% of cases are diagnosed at the regional or distant stage. Most cases at early stages are found incidentally in patients undergoing either laparoscopic or open exploration for cholelithiasis and cholecystitis . Although these fortunate patients can be cured by appropriate surgical therapy, some eventually develop distant metastasis. In the present study, 17.9% of early T stage patients (T1 and T2) identified in the SEER database were positive for distant metastasis. This ratio is much higher than expected. Wang et al reported that approximately 9.5% of T1b GBC cases were associated with M1, but they only included adenocarcinomas . Cecillia G et al studied incidental GBC and found distant metastasis in 17% of patients . These data, including those from the current study, reveal that one of the biological characteristics of GBC is a tendency toward distant metastasis. Therefore, we developed a predictive nomogram to evaluate the probability of distant metastasis in patients with T1/T2 GBC based on the clinical and pathologic characteristics of the primary tumors.
Based on the statistical analysis, the following six factors were found to be independently associated with M1 risk: age, histological grade, histological subtype, T stage, N stage and tumor size. All these factors were included in this novel nomogram. Regarding the performance of the nomogram, the results of the calibration plot and ROC curves showed satisfactory outcomes. Previous studies have reported that biomarkers with AUCs between 0.7 and 0.9 have superior accuracy, indicating acceptable discrimination [13, 14]. In this study, the AUCs in the training and validating cohorts were 0.723 and 0.679, respectively. Therefore, this novel nomogram has moderately accuracy in predicting distant metastasis. Nonetheless, this novel nomogram will help surgeons and oncologists understand the contribution weight of each level of each risk factor for early T stage GBC patients with respect to distant metastasis. Moreover, this model may allow clinicians to screen patients at a higher risk of distant metastasis for closer follow-up and adjuvant treatment.
Regarding the six parameters included in this novel nomogram, histological grade had the highest discriminating power. A poor histological grade usually indicates a higher degree of malignancy, stronger invasive ability, wider range of infiltration, and higher probability of metastasis . Our findings support this theory and are consistent with an earlier series from Butte and colleagues, which reported that a poor grade was the strongest predictor of distant metastasis at the time of reresection . For differentiation grade, the nomogram demonstrated that N stage was a strong risk factor for M1. Reginal lymph node metastasis (N1) always indicates a worse prognosis among GBC patients [17, 18], and several studies claim that N1 patterns are significant predictors of distant metastasis [19, 20]. Our study further confirmed this finding, even among early stages of GBC. In addition, tumor size ≥ 2 cm was significantly associated with an increased risk of distant metastasis. The same pattern was observed in a previous study showing that tumor size > 3 cm indicated worse 1-year and 3-year cancer-specific survival . According to this nomogram, patients with age ≤ 70 had a higher probability of distant metastasis. Similar results have been found in breast cancer patients. E Colzani et al suggested that breast cancer patients younger than 50 years at diagnosis had a higher risk of distant metastasis . However, among patients with squamous cell cancer of the head and neck, Kuperman et al reported that advanced age was associated with an increased risk of distant metastasis.The inconsistent results in head and neck tumors indicate that younger patients have a higher risk of distant metastasis is a characteristic of GBC and breast cancer. In addition, the study of Somasundar et al reported that young age (under 50 years) is a poor prognostic factor in gallbladder cancer . This research supports that our results are convincing and shows one characteristic of gallbladder cancer. With regard to histological type, our study found that nonadenocarcinoma was associated with an increased likelihood of distant metastasis. Nonadenocarcinoma is rare among GBC patients, and most of the studies to date are case reports. Samuel et al performed a study on the clinicopathological characteristics and outcomes of rare histologic variants of gallbladder cancer and reported that adenosquamous/squamous GBC had worse survival outcomes than gallbladder adenocarcinoma . Furthermore, the analysis of 34 adenosquamous/squamous GBC cases and comparison of clinicopathologic features and surgical outcomes with adenocarcinoma by Wang et al showed that adenosquamous/squamous GBC tended to be associated with more infiltration of multiple adjacent organs and lymphatic metastasis . Our research is consistent with the above studies. Finally, an interesting finding was that stage T1 patients had a higher risk of M1 than stage T2 patients. This was inconsistent with previous research [7, 16]. In our view, this is because we excluded patients without a histological diagnosis. T1 patients can undergo surgery, and distant metastasis is incidentally found; T2 patients with distant metastasis might not have the chance to receive surgery and obtain a histological diagnosis, and they would have been excluded from this study. Furthermore, we performed subgroup analysis between T1 and T2 patients without histologic confirmation and found no significant difference in distant metastasis, supporting our explanation. Moreover, T stage had the lowest discriminating power in this nomogram, with little impact on the final nomogram results.
With regard to the clinical utility of our nomogram, the unique visual effect of this predictive model will help surgeons intuitively understand the risk level of the above factors regarding distant metastasis. After the diagnosis of GBC has been confirmed by pathologic examination, guidelines highly recommend that appropriate staging be performed prior to initiating treatment . PET scans may alter the management of 23% of patients with GBC , and 20% of patients who underwent staging laparoscopy prior to laparotomy had distant disease . Thus, PET-CT or staging laparoscopy may be considered for patients at higher risk of M1 based on our nomogram. On the other hand, disease recurrences, such as distant metastasis, often occur after resection, which highlights the systemic nature of GBC and the need for multimodality therapy . Although an ideal regimen of adjuvant therapy has not been developed, recent clinical trials and studies have shown that the use of postoperative chemoradiotherapy can improve oncologic outcomes. Indeed, one population-based study that analyzed 18,124 cases from 1973 to 2009 concluded that the highest survival was associated with receiving both surgery and radiation . The BILCAP (Biliary Capecitabine) randomized controlled trial involving 447 patients with resected biliary tract malignancies reported that 6 months of adjuvant capecitabine improved overall survival compared to placebo . A phase II trial reported a well-tolerated adjuvant regimen of gemcitabine and capecitabine with radiotherapy and showed a 2-year overall survival of 67% and a median overall survival of 35 months . Through this predictive model, surgeons and oncologists will be able to estimate the possibility of distant metastasis in early T stage GBC patients. Thus, we believe that postoperative chemoradiotherapy should be considered for patients with a higher possibility of distant metastasis, or at least a much closer follow-up should be considered.
Several limitations exist in our study. First, the SEER database did not include records of lymphovascular (LVI) and perineural (PNI) invasion. As LVI and PNI are associated with increased rates of distant metastasis , including these two predictive factors may improve the sensitivity and specificity of our nomogram. Second, this study was a retrospective study, which is associated with inevitable selection bias and information bias. Third, we evaluated GBC patients between 2004 and 2014 to develop the nomogram; thus, the staging system used in this nomogram is the AJCC 6th edition provided by the SEER database (N stage only included N0 and N1). The latest edition is 8th, which has changed the definition of N stage based on the number of regional lymph node metastases. This difference may influence the accuracy of the nomogram. Fourth, the AUC from the validation cohort was below 0.7 (0.679), which revealed that the novel nomogram only has moderately accuracy in predicting distant metastasis. Because the accuracy was not strong enough, doctors should pay attention to its limitations when using the nomogram. Finally, although this novel predictive model was established by a large cohort and validated in a split subgroup of patients, external validation of the nomogram is still necessary.
In conclusion, through retrospective analysis of 3013 patients with T1/T2 GBC, this study established a novel nomogram based on six independent risk factors to predict distant metastasis. The validation of the model proved its satisfactory performance. Although some limitations exist in this predictive model, the nomogram revealed the relationship between the clinicopathological characteristics of T1 and T2 GBC patients and the risk of distant metastasis. This tool will assist in patient counseling and guide treatment decision making for T1 and T2 GBC patients. In the future, more randomized controlled trials are needed to provide accurate data to improve and update this nomogram.
GBC: Gallbladder cancer; SEER: Surveillance, Epidemiology, and End Results database; ROC: receptor operating characteristic curve.
We would like to acknowledge the support of the Department of Biliary Surgery, West China Hospital, Sichuan University, China.
This research was supported by Sichuan Science and Technology Program (No.2020YFS0098); 1.3.5 project for disciplines of excellence, West China Hospital, Sichuan University.
The authors have declared that no competing interest exists.
1. Ertel AE, Bentrem D, Abbott DE. Gall Bladder Cancer. Cancer Treat Res. 2016;168:101-20
2. Rahman R, Simoes EJ, Schmaltz C, Jackson CS, Ibdah JA. Trend analysis and survival of primary gallbladder cancer in the United States: a 1973-2009 population-based study. Cancer Med. 2017;6:874-80
3. Fong Y, Jarnagin W, Blumgart LH. Gallbladder cancer: comparison of patients presenting initially for definitive operation with those presenting after prior noncurative intervention. Ann Surg. 2000;232:557-69
4. Wang X, Yu GY, Chen M, Wei R, Chen J, Wang Z. Pattern of distant metastases in primary extrahepatic bile-duct cancer: A SEER-based study. Cancer Med. 2018;7:5006-14
5. Benson AB, D'Angelica MI, Abbott DE, Abrams TA, Alberts SR, Anaya DA. et al. Guidelines Insights: Hepatobiliary Cancers, Version 2.2019. J Natl Compr Canc Netw. 2019;17:302-10
6. Donohue JH, Stewart AK, Menck HR. The National Cancer Data Base report on carcinoma of the gallbladder, 1989-1995. Cancer. 1998;83:2618-28
7. Ethun CG, Postlewait LM, Le N, Pawlik TM, Buettner S, Poultsides G. et al. A Novel Pathology-Based Preoperative Risk Score to Predict Locoregional Residual and Distant Disease and Survival for Incidental Gallbladder Cancer: A 10-Institution Study from the U.S. Extrahepatic Biliary Malignancy Consortium. Ann Surg Oncol. 2017;24:1343-50
8. Steyerberg EW, Harrell FE Jr, Borsboom GJ, Eijkemans MJ, Vergouwe Y, Habbema JD. Internal validation of predictive models: efficiency of some procedures for logistic regression analysis. J Clin Epidemiol. 2001;54:774-81
9. Eastham JA, Kattan MW, Scardino PT. Nomograms as predictive models. Semin Urol Oncol. 2002;20:108-15
10. Iasonos A, Schrag D, Raj GV, Panageas KS. How to build and interpret a nomogram for cancer prognosis. J Clin Oncol. 2008;26:1364-70
11. Xu XQ, Liu W, Li BL, Hong T, Zheng CJ, Wang C. et al. Unsuspected gallbladder cancer during or after laparoscopic cholecystectomy. Chin Med Sci J. 2013;28:102-6
12. Wang Z, Li Y, Jiang W, Yan J, Dai J, Jiao B. et al. Simple Cholecystectomy Is Adequate for Patients With T1b Gallbladder Adenocarcinoma < 1 cm in Diameter. Front Oncol. 2019;9:409
13. Qiu PF, Liu JJ, Wang YS, Yang GR, Liu YB, Sun X. et al. Risk factors for sentinel lymph node metastasis and validation study of the MSKCC nomogram in breast cancer patients. Jpn J Clin Oncol. 2012;42:1002-7
14. Koca B, Kuru B, Ozen N, Yoruker S, Bek Y. A breast cancer nomogram for prediction of non-sentinel node metastasis - validation of fourteen existing models. Asian Pac J Cancer Prev. 2014;15:1481-8
15. Wu K, Yang X, Li L, Ruan M, Liu W, Lu W. et al. Neurovascular Invasion and Histological Grade Serve as the Risk Factors of Cervical Lymph Node Metastases in Early Tongue Squamous Cell Carcinoma. Mol Neurobiol. 2016;53:2920-6
16. Butte JM, Gonen M, Allen PJ, D'Angelica MI, Kingham TP, Fong Y. et al. The role of laparoscopic staging in patients with incidental gallbladder cancer. HPB (Oxford). 2011;13:463-72
17. Zhang W, Hong HJ, Chen YL. Establishment of a Gallbladder Cancer-Specific Survival Model to Predict Prognosis in Non-metastatic Gallbladder Cancer Patients After Surgical Resection. Dig Dis Sci. 2018;63:2251-8
18. Cai ZQ, Guo P, Si SB, Geng ZM, Chen C, Cong LL. Analysis of prognostic factors for survival after surgery for gallbladder cancer based on a Bayesian network. Sci Rep. 2017;7:293
19. Nagakura S, Shirai Y, Yokoyama N, Hatakeyama K. Clinical significance of lymph node micrometastasis in gallbladder carcinoma. Surgery. 2001;129:704-13
20. Endo I, Shimada H. [Modes of metastasis in gallbladder cancer]. Nihon Rinsho. 2006;64(Suppl 1):366-9
21. Colzani E, Johansson AL, Liljegren A, Foukakis T, Clements M, Adolfsson J. et al. Time-dependent risk of developing distant metastasis in breast cancer patients according to treatment, age and tumour characteristics. Br J Cancer. 2014;110:1378-84
22. Kuperman DI, Auethavekiat V, Adkins DR, Nussenbaum B, Collins S, Boonchalermvichian C. et al. Squamous cell cancer of the head and neck with distant metastasis at presentation. Head Neck. 2011;33:714-8
23. Boutros C, Gary M, Baldwin K, Somasundar P. Gallbladder cancer: past, present and an uncertain future. Surg Oncol. 2012;21:e183-91
24. Samuel S, Mukherjee S, Ammannagari N, Pokuri VK, Kuvshinoff B, Groman A. et al. Clinicopathological characteristics and outcomes of rare histologic subtypes of gallbladder cancer over two decades: A population-based study. PLoS One. 2018;13:e0198809
25. Song HW, Chen C, Shen HX, Ma L, Zhao YL, Zhang GJ. et al. Squamous/adenosquamous carcinoma of the gallbladder: Analysis of 34 cases and comparison of clinicopathologic features and surgical outcomes with adenocarcinoma. J Surg Oncol. 2015;112:677-80
26. Miyazaki M, Yoshitomi H, Miyakawa S, Uesaka K, Unno M, Endo I. et al. Clinical practice guidelines for the management of biliary tract cancers 2015: the 2nd English edition. J Hepatobiliary Pancreat Sci. 2015;22:249-73
27. Corvera CU, Blumgart LH, Akhurst T, DeMatteo RP, D'Angelica M, Fong Y. et al. 18F-fluorodeoxyglucose positron emission tomography influences management decisions in patients with biliary cancer. J Am Coll Surg. 2008;206:57-65
28. Patkar S, Ostwal V, Ramaswamy A, Engineer R, Chopra S, Shetty N. et al. Emerging role of multimodality treatment in gall bladder cancer: Outcomes following 510 consecutive resections in a tertiary referral center. J Surg Oncol. 2018;117:372-9
29. Primrose JN, Fox RP, Palmer DH, Malik HZ, Prasad R, Mirza D. et al. Capecitabine compared with observation in resected biliary tract cancer (BILCAP): a randomised, controlled, multicentre, phase 3 study. Lancet Oncol. 2019;20:663-73
30. Ben-Josef E, Guthrie KA, El-Khoueiry AB, Corless CL, Zalupski MM, Lowy AM. et al. SWOG S0809: A Phase II Intergroup Trial of Adjuvant Capecitabine and Gemcitabine Followed by Radiotherapy and Concurrent Capecitabine in Extrahepatic Cholangiocarcinoma and Gallbladder Carcinoma. J Clin Oncol. 2015;33:2617-22
Corresponding author: Nan-sheng Cheng, MD, Professor, Department of Biliary Surgery, West China Hospital, Sichuan University, No. 37 Guo Xue Xiang, Chengdu 610041, Sichuan Province, China. Tel: +862885422461; fax: +862885422462; E-mail: nanshengcheng2012com