Advertisement
Selected Topics: Oncologic Emergencies| Volume 58, ISSUE 6, P932-941, June 2020

Clinical and Cancer-Related Predictors for Venous Thromboembolism in Cancer Patients Presenting to the Emergency Department

Open AccessPublished:May 03, 2020DOI:https://doi.org/10.1016/j.jemermed.2020.03.039

      Abstract

      Background

      The accurate detection of cancer-associated venous thromboembolism (VTE) can avoid unnecessary diagnostic imaging or laboratory tests.

      Objective

      We sought to determine clinical and cancer-related risk factors of VTE that can be used as predictors for oncology patients presenting to the emergency department (ED) with suspected VTE.

      Methods

      We retrospectively analyzed all consecutive patients who presented with suspicion of VTE to The University of Texas MD Anderson Cancer Center ED between January 1, 2009, and January 1, 2013. Logistic regression models were used to identify risk factors that were associated with VTE. The ability of these factors to predict VTE was externally validated using a second cohort of patients who presented to King Hussein Cancer Center ED between January 1, 2009, and January 1, 2016.

      Results

      Cancer-related covariates associated with the occurrence of VTE were high-risk cancer type (odds ratio [OR] 3.64 [95% confidence interval {CI} 2.37–5.60], p < 0.001), presentation within 6 months of the cancer diagnosis (OR 1.92 [95% CI 1.62–2.28], p < 0.001), active cancer (OR 1.35 [95% CI 1.10–1.65], p = 0.003), advanced stage (OR 1.40 [95% CI 1.01–1.94], p = 0.044), and the presence of brain metastasis (OR 1.73 [95% CI 1.32–2.27], p < 0.001). When combined, these factors along with other clinical factors showed high prediction performance for VTE in the external validation cohort.

      Conclusions

      Cancer risk group, presentation within 6 months of cancer diagnosis, active and advanced cancer, and the presence of brain metastases along with other related clinical factors can be used to predict VTE in patients with cancer presenting to the ED.

      Keywords

      Introduction

      Cancer-associated venous thromboembolism (VTE) has an annual incidence of 1 in 200 (
      • Lee A.Y.
      • Levine M.N.
      Venous thromboembolism and cancer: risks and outcomes.
      ). The high mortality rate of VTE makes it a leading cause of death among patients with cancer, and its high morbidity rate causes consequential economic burden (
      • Chew H.K.
      • Wun T.
      • Harvey D.
      • Zhou H.
      • White R.H.
      Incidence of venous thromboembolism and its effect on survival among patients with common cancers.
      ,
      • Cohoon K.P.
      • Ransom J.E.
      • Leibson C.L.
      • et al.
      Direct medical costs attributable to cancer-associated venous thromboembolism: a population-based longitudinal study.
      ,
      • Elting L.S.
      • Escalante C.P.
      • Cooksley C.
      • et al.
      Outcomes and cost of deep venous thrombosis among patients with cancer.
      ). VTE events may be related to the cancer, a side effect of cancer therapy, or associated with other comorbidities. Many cancer patients with VTE present to the emergency department (ED) for care. Therefore, timely and accurate detection of VTE in the ED has enormous clinical significance and may improve patient management and clinical outcomes.
      Studies have shown an increased risk for VTE in patients with various types of cancer (
      • Khorana A.A.
      • Francis C.W.
      • Culakova E.
      • Kuderer N.M.
      • Lyman G.H.
      Frequency, risk factors, and trends for venous thromboembolism among hospitalized cancer patients.
      ,
      • Stein P.D.
      • Beemath A.
      • Meyers F.A.
      • Skaf E.
      • Sanchez J.
      • Olson R.E.
      Incidence of venous thromboembolism in patients hospitalized with cancer.
      ). Several scoring systems for the evaluation of suspected VTE have already been established for patients in the general population. This includes the Wells score, the Geneva score, and the revised Geneva score. In addition, guidelines including the American College of Physicians guideline use these validated scores in combination with other tools, such as the PE Rule Out Criteria and D-dimer as a risk stratification tool in the evaluation of pulmonary embolism (PE) (
      • Wells P.S.
      • Anderson D.R.
      • Rodger M.
      • et al.
      Derivation of a simple clinical model to categorize patients probability of pulmonary embolism: increasing the models utility with the SimpliRED D-dimer.
      ,
      • Le Gal G.
      • Righini M.
      • Roy P.M.
      • et al.
      Prediction of pulmonary embolism in the emergency department: the revised Geneva score.
      ,
      • Wells P.S.
      • Hirsh J.
      • Anderson D.R.
      • et al.
      Accuracy of clinical assessment of deep-vein thrombosis.
      ,
      • Wells P.S.
      • Ginsberg J.S.
      • Anderson D.R.
      • et al.
      Use of a clinical model for safe management of patients with suspected pulmonary embolism.
      ,
      • Qdaisat A.
      • Yeung S.J.
      • Variyam D.E.
      • et al.
      Evaluation of cancer patients with suspected pulmonary embolism: performance of the American College of Physicians Guideline.
      ). Others, including the Khorana scoring system, assessed clinical and laboratory parameters and built predictive models to identify cancer patients who have an increased risk for developing VTE (
      • Ay C.
      • Dunkler D.
      • Marosi C.
      • et al.
      Prediction of venous thromboembolism in cancer patients.
      ,
      • Khorana A.A.
      • Kuderer N.M.
      • Culakova E.
      • Lyman G.H.
      • Francis C.W.
      Development and validation of a predictive model for chemotherapy-associated thrombosis.
      ,
      • Verso M.
      • Agnelli G.
      • Barni S.
      • Gasparini G.
      • LaBianca R.
      A modified Khorana risk assessment score for venous thromboembolism in cancer patients receiving chemotherapy: the Protecht score.
      ,
      • Gerotziafas G.T.
      • Taher A.
      • Abdel-Razeq H.
      • et al.
      A predictive score for thrombosis associated with breast, colorectal, lung, or ovarian cancer: the prospective COMPASS-Cancer-Associated Thrombosis Study.
      ).
      Because VTE occurs more often in patients with cancer than in those without an underlying malignancy, patients with cancer have a higher pretest probability for VTE than do patients without cancer; in addition, the diagnostic strategy used for cancer patients is different (
      • Lee A.Y.
      • Levine M.N.
      Venous thromboembolism and cancer: risks and outcomes.
      ,
      • Lee A.Y.
      • Julian J.A.
      • Levine M.N.
      • et al.
      Clinical utility of a rapid whole-blood D-dimer assay in patients with cancer who present with suspected acute deep venous thrombosis.
      ). D-dimer has lower predictive values in patients with cancer, especially among patients with leukemia and lymphoma (
      • Lee A.Y.
      • Julian J.A.
      • Levine M.N.
      • et al.
      Clinical utility of a rapid whole-blood D-dimer assay in patients with cancer who present with suspected acute deep venous thrombosis.
      ,
      • Qdaisat A.
      • Soud R.A.
      • Wu C.C.
      • et al.
      Poor performance of D-dimer in excluding venous thromboembolism among patients with lymphoma and leukemia.
      ,
      • Qdaisat A.
      • Wu C.C.
      • Yeung S.J.
      Normal D-dimer levels in cancer patients with radiologic evidence of pulmonary embolism.
      ). Furthermore, the ability of this clotting biomarker to detect VTEs in cancer patients varies significantly among different cancer types (
      • Qdaisat A.
      • Soud R.A.
      • Wu C.C.
      • et al.
      Poor performance of D-dimer in excluding venous thromboembolism among patients with lymphoma and leukemia.
      ). Therefore, predictors that help diagnose VTEs in patients with cancer in an urgent/emergent care setting are needed to guide the optimal use of diagnostic laboratory and imaging studies.
      In the current study, we analyzed and identified predictive clinical and cancer-related factors in patients with cancer who were suspected to have VTE who visited our ED. We then validated these predictors in a different cohort of patients with cancer from another institution.

      Materials and Methods

      Study Participants and Data Collection

      Two cancer patient cohorts were investigated. For the first, all consecutive patients who visited the ED of The University of Texas MD Anderson Cancer Center in Houston, Texas, USA, between January 1, 2009, and January 1, 2013, and who had D-dimer laboratory results, were identified by querying billing and laboratory databases. This patient cohort was used to identify VTE predictive factors. In the same way, we identified a second cohort of consecutive patients with cancer who visited the ED of King Hussein Cancer Center in Amman, Jordan, between January 1, 2009, and January 1, 2016. This patient cohort was used to externally validate the VTE predictors determined from the MD Anderson cohort. Exclusion criteria for both cohorts were 1) age <18 years; 2) no cancer diagnosis; 3) no follow-up records during the ED visit or within 30 days of the visit; 4) missing emergency physician notes; and 5) arterial thrombosis or VTE other than lower limb deep venous thrombosis and PE.
      At MD Anderson, potential participants were identified using the electronic medical record system. Patient demographics, cancer information, morbidities, vital signs, and clinical variables that are known to be associated with thrombosis (including a history of VTE, immobilization, surgery or fractures within 30 days before presentation) were collected. The presence or absence of VTE was determined by reviewing the imaging reports. The presence of VTE as the outcome of interest was defined as an incidence of acute lower limb deep venous thrombosis or acute PE during the ED visit (i.e., ≤72 h before or after presentation) or within the 30-day follow-up period, found on an appropriate diagnostic imaging study (lower extremity Doppler ultrasound, chest computed tomography with intravenous contrast, or radionuclide ventilation/perfusion scans). Questionable radiologic results were further reviewed by a board-certified thoracic radiologist and classified as either positive or negative. Collaborators at King Hussein cancer center used a similar workflow.
      This study was approved by the institutional review boards of MD Anderson and King Hussein cancer centers; both granted waivers of informed consent.

      Predictor Derivation and Validation

      We identified VTE predictors using the MD Anderson cohort. Variables included in the development phase were clinical variables that have been previously shown to be associated with VTE, as well as other cancer-related clinical factors. Immobility was defined as motionlessness for ≥3 days within the 4 weeks preceding ED presentation. Body mass index (BMI) was calculated as weight in kilograms divided by height in meters squared (kg/m2). Hypoxemia was defined as partial pressure of oxygen <60 mm Hg with arterial blood gas or oxygen saturation <95%. Advanced cancer stage was defined as solid tumors with American Joint Committee on Cancer anatomic stage/prognostic groups of stage IV, brain and spinal cord tumors with World Health Organization grade IV, or hematologic malignancies in relapsed or refractory phases. Time from cancer diagnosis was calculated from the time of confirmed pathologic diagnosis to the time of ED presentation.
      Univariate analysis was performed to determine the association between each variable and VTE. Significance was appraised using the χ2 test for categorical variables and the Student t or Wilcoxon-Mann-Whitney tests for continuous variables where appropriate. Cancer types were analyzed using multiple logistic regression controlled for cancer stage and were simplified by combining groups with similar adjusted odds ratios (AORs). Race/ethnicity was analyzed using multiple logistic regression controlling for cancer type, stratifying the race groups according to their AORs. Continuous variables were categorized using a cutoff point according to levels previously used in patients with cancer (
      • Blom J.W.
      • Doggen C.J.
      • Osanto S.
      • Rosendaal F.R.
      Malignancies, prothrombotic mutations, and the risk of venous thrombosis.
      ,
      • Khorana A.A.
      • Francis C.W.
      • Culakova E.
      • Lyman G.H.
      Risk factors for chemotherapy-associated venous thromboembolism in a prospective observational study.
      ). Statistically significant clinical variables from the univariate analyses were further analyzed using a multiple logistic regression model. The Hosmer-Lemeshow goodness-of-fit statistic was used to evaluate the calibration of the model. The prediction performance of the model was assessed using receiver operating characteristic analysis calculating the area under the curve. External validation of the performance of the predictive factors was done using the King Hussein cohort. Receiver operating characteristic/area under the curve analysis followed by the DeLong test were used to identify statistically significant differences between the derivation (MD Anderson) cohort and the external validation (King Hussein) cohort. Two-tailed p values < 0.05 were considered statistically significant.
      All statistical analyses were performed using R software (v 3.5.1; The R Foundation, http://www.r-project.org).

      Results

      Patient Characteristics and VTE Prevalence

      Of the eligible patients initially identified in the MD Anderson cohort (4432 patients) and the King Hussein cohort (551 patients), 4145 patients and 508 patients, respectively, were included in the analysis once exclusion criteria were applied (Figure 1). Table 1 shows the general characteristics of the patients in each cohort. The prevalence of VTE was 23.1% (958/4145 patients) in the MD Anderson cohort and 21.7% (110/508 patients) in the King Hussein cohort cohort. Of the patients with VTE in the MD Anderson cohort, 47.3% (453/958) had a PE, 32.2% (308/958) had lower limb deep venous thrombosis, and 20.6% (197/958) had both (Figure 1).
      Figure thumbnail gr1
      Figure 1Exclusion criteria used to determine study eligibility for MD Anderson and King Hussein cohorts. DVT = deep venous thrombosis; VTE = venous thromboembolism.
      Table 1Characteristics of the Patients Included in Each Cohort
      CharacteristicPatients
      MD AndersonKing Hussein
      No VTEVTEp ValueNo VTEVTEp Value
      Total, n3187958398110
      Median age, years (range)60 (18–101)61 (18–92)0.12854 (19–88)58 (18–84)0.035
      Statistically significant (p < 0.05).
      Sex, n (%)
       Female1660 (52.1)462 (48.2)0.036
      Statistically significant (p < 0.05).
      203 (51.0)64 (58.2)0.182
       Male1527 (47.9)496 (51.8)195 (49.0)46 (41.8)
      Race/ethnicity, n (%)
       White2026 (63.6)641 (66.9)0.208398 (100.0)110 (100.0)N/A
       Black524 (16.4)153 (16.0)0 (0.0)0 (0.0)
       Hispanic425 (13.3)112 (11.7)0 (0.0)0 (0.0)
       Asian133 (4.2)28 (2.9)0 (0.0)0 (0.0)
       Other79 (2.5)24 (2.5)0 (0.0)0 (0.0)
      Median CCI (range)6 (2–16)6 (2–14)0.004
      Statistically significant (p < 0.05).
      8 (2–19)8 (2–15)0.068
      Cancer stage, n (%)
       Undetermined20 (0.6)7 (0.7)<0.001
      Statistically significant (p < 0.05).
      43 (10.8)10 (9.1)0.104
       I170 (5.3)36 (3.8)21 (5.3)8 (7.3)
       II234 (7.3)44 (4.6)18 (4.5)5 (4.5)
       III340 (10.7)100 (10.4)14 (3.5)7 (6.4)
       IV1689 (53.0)583 (60.9)196 (49.2)64 (58.2)
       Nonsolid734 (23.0)188 (19.6)106 (26.6)16 (14.5)
      Cancer type, n (%)
       Gastrointestinal344 (10.8)148 (15.4)<0.001
      Statistically significant (p < 0.05).
      74 (18.6)30 (27.3)<0.001
      Statistically significant (p < 0.05).
       Chest717 (22.5)218 (22.8)36 (9.0)15 (13.6)
       Hematologic738 (23.2)189 (19.7)115 (28.9)16 (14.5)
       Genitourinary333 (10.4)125 (13.0)53 (13.3)18 (16.4)
       Brain and spinal cord31 (1.0)31 (3.2)7 (1.8)10 (9.1)
       Other1024 (32.1)247 (25.8)113 (28.4)21 (19.1)
      CCI = Charlson comorbidity index; N/A = not applicable; VTE = venous thromboembolism.
      Statistically significant (p < 0.05).

      Clinical and Cancer-Related Predictors for Cancer-Associated VTE

      Cancer types were categorized into 4 risk groups according to their AORs, after controlling for cancer stage: very high risk (AOR >3), high risk (AOR 2–3), intermediate risk (AOR 1–2), and low risk (AOR <1). Brain and spinal cord cancer and gastric cancer represented the very high-risk group, having the highest AORs (4.21 and 3.81, respectively). The high-risk group included pancreatic, urinary bladder, and cervical, ovarian, and other gynecologic (excluding endometrial) cancers; the intermediate-risk group comprised lung, endometrial, esophageal, testicular, prostate, rectal, and hepatobiliary cancers, along with multiple myeloma, sarcoma, melanoma, and metastatic cancer of unknown primary origin; and the low-risk group included kidney, breast, colon, and head and neck cancers, along with lymphoma, mesothelioma, and leukemia (Table 2). As for race/ethnicity, white race had a significantly higher AOR than other races or ethnicities (1.67 [95% confidence interval {CI} 1.11–2.61], p = 0.029) after controlling for cancer type; therefore, race was grouped into white and nonwhite for the multivariable analysis (Supplemental Table S1).
      Table 2Cancer Type Risk Group Stratification for Venous Thromboembolism
      Cancer TypeAdjusted OR
      ORs adjusted for cancer stage.
      (95% CI)
      Final Risk Group
      Brain and spinal cord4.21 (2.25–7.97)Very high
      Gastric3.81 (1.97–7.40)Very high
      Cervical2.73 (1.31–5.60)High
      Pancreatic2.46 (1.36–4.47)High
      Ovarian2.27 (1.28–4.05)High
      Other gynecologic2.26 (0.57–7.74)High
      Bladder2.12 (0.94–4.62)High
      Rectal1.84 (0.84–3.90)Intermediate
      Esophageal1.66 (0.93–2.97)Intermediate
      Metastatic of unknown primary1.53 (0.77–2.97)Intermediate
      Testicular1.47 (0.39–4.57)Intermediate
      Endometrial1.37 (0.67–2.73)Intermediate
      Lung1.26 (0.84–1.93)Intermediate
      Prostate1.22 (0.63–2.30)Intermediate
      Sarcoma1.22 (0.76–2.00)Intermediate
      Skin melanoma1.19 (0.65–2.15)Intermediate
      Hepatobiliary1.17 (0.56–2.35)Intermediate
      Multiple myeloma1.04 (0.05–7.61)Intermediate
      Kidney0.96 (0.51–1.75)Low
      Breast0.93 (0.60–1.46)Low
      Colon0.93 (0.51–1.68)Low
      Lymphoma0.90 (0.04–6.39)Low
      Mesothelioma0.89 (0.34–2.11)Low
      Head and neck0.87 (0.50–1.51)Low
      Leukemia0.80 (0.04–5.80)Low
      CI = confidence interval; OR = odds ratio.
      ORs adjusted for cancer stage.
      Among the other 26 clinical variables screened, 14 variables were associated with the occurrence of VTE in univariate analysis (Table 3). Missing values were rare; time from cancer diagnosis had the most missing values (7/4145, 0.2%). Weight and height were among the variables most significantly associated with VTE, but these variables were excluded from subsequent analysis to prevent multicollinearity with BMI. The remaining 12 significant variables (chest pain, shortness of breath, unilateral limb swelling, unilateral limb pain, hypoxemia, heart rate, systolic blood pressure, BMI, previous VTE, immobility, time from cancer diagnosis, and brain metastasis), along with 5 common clinical variables (age, race, Charlson comorbidity index, cancer stage, and cancer type risk group), were included in the multivariable analysis.
      Table 3Univariate Analysis for the Association of Clinical Risk Factors with Venous Thromboembolism
      Variable NameOR (95% CI)p Value
      Demographics and anthropometrics
       Age, years1.00 (1.00–1.01)0.075
       Race
      NonwhiteReference
      White1.16 (1.00–1.35)0.059
       Sex
      FemaleReference
      Male1.17 (1.01–1.35)0.036
      Statistically significant (p < 0.05).
       Height, cm1.01 (1.01–1.02)<0.001
      Statistically significant (p < 0.05).
       Weight, kg1.01 (1.01–1.01)<0.001
      Statistically significant (p < 0.05).
       BMI, kg/m21.02 (1.01–1.03)<0.001
      Statistically significant (p < 0.05).
       BMI category
      <25 kg/m2Reference
      25–<30 kg/m21.35 (1.16–1.58)<0.001
      Statistically significant (p < 0.05).
      ≥30 kg/m21.59 (1.15–2.18)0.004
      Statistically significant (p < 0.05).
      Vital signs
       Systolic blood pressure, mm Hg0.99 (0.99–1.00)0.003
      Statistically significant (p < 0.05).
       Diastolic blood pressure, mm Hg1.00 (0.99–1.00)0.405
       Heart rate >90 beats/min1.26 (1.08–1.46)0.003
      Statistically significant (p < 0.05).
       Respiratory rate1.02 (0.99–1.04)0.238
       Temperature, C°0.98 (0.88–1.06)0.629
       Hypoxemia1.52 (1.24–1.85)<0.001
      Statistically significant (p < 0.05).
      Signs and symptoms
       Shortness of breath0.91 (0.78–1.05)0.208
       Chest pain0.71 (0.61–0.82)<0.001
      Statistically significant (p < 0.05).
       Hemoptysis0.71 (0.49–1.01)0.062
       Unilateral limb swelling2.95 (2.39–3.63)<0.001
      Statistically significant (p < 0.05).
       Unilateral limb pain2.37 (1.87–2.99)<0.001
      Statistically significant (p < 0.05).
       Bilateral limb swelling1.04 (0.66–1.61)0.852
       Bilateral limb pain0.80 (0.34–1.66)0.583
      Clinical factors
       Previous venous thromboembolism3.94 (3.33–4.65)<0.001
      Statistically significant (p < 0.05).
       Charlson comorbidity index1.05 (1.02–1.08)0.003
      Statistically significant (p < 0.05).
       Immobilization1.77 (1.32–2.34)<0.001
      Statistically significant (p < 0.05).
       Surgery1.10 (0.83–1.43)0.506
       Fractures1.43 (0.50–3.57)0.466
       Atrial fibrillation1.03 (0.80–1.32)0.800
      Cancer-related factors
       Cancer type risk group
      LowReference
      Intermediate1.36 (1.16–1.59)<0.001
      Statistically significant (p < 0.05).
      High2.42 (1.83–3.18)<0.001
      Statistically significant (p < 0.05).
      Very high4.14 (2.82–6.06)<0.001
      Statistically significant (p < 0.05).
       Cancer stage
      LocalReference
      Advanced1.64 (1.29–2.11)<0.001
      Statistically significant (p < 0.05).
      Liquid/hematologic1.25 (0.95–1.66)0.122
       Active cancer1.48 (1.27–1.74)<0.001
      Statistically significant (p < 0.05).
       Time from cancer diagnosis, months1.00 (0.99–1.00)<0.001
      Statistically significant (p < 0.05).
       Brain metastasis1.52 (1.20–1.93)<0.001
      Statistically significant (p < 0.05).
       Lung metastasis0.85 (0.70–1.04)0.113
       Liver metastasis1.13 (0.94–1.36)0.194
      BMI = body mass index; CI = confidence interval; OR = odds ratio.
      Statistically significant (p < 0.05).
      In the multivariable analysis, cancer type risk groups showed good discrimination compared with the reference (low-risk group); the very high-risk group VTE rate was almost fourfold higher than in the low-risk group (AOR 3.64 [95% CI 2.37–5.60], p < 0.001; Table 4). Other cancer-related covariates associated with the occurrence of VTE were presentation within 6 months of the cancer diagnosis (AOR 1.92 [95% CI 1.62–2.28], p < 0.001), active cancer (AOR 1.35 [95% CI 1.10–1.65], p = 0.003), advanced stage (AOR 1.40 [95% CI 1.01–1.94], p = 0.044), and the presence of brain metastasis (AOR 1.73 [95% CI 1.32–2.27], p < 0.001; Table 4). As for clinical factors, previous VTE, higher BMI, immobility, and presenting with tachycardia, hypoxemia, or unilateral lower limb swelling or pain were all predictors of VTE (Table 4).
      Table 4Clinical and Cancer-Related Predictors for Venous Thromboembolism in Patients with Cancer
      VariableAOR (95% CI)p Value
      Age1.00 (1.00–1.01)0.174
      Race
       NonwhiteReference
       White1.18 (0.99–1.4)0.062
      Sex
       FemaleReference
       Male1.12 (0.95–1.33)0.168
      BMI
       <25 kg/m2Reference
       25–<30 kg/m21.36 (1.14–1.61)<0.001
      Statistically significant (p < 0.05).
       ≥30 kg/m21.83 (1.27–2.61)<0.001
      Statistically significant (p < 0.05).
      Systolic blood pressure <90 mm Hg1.13 (0.73–1.71)0.588
      Heart rate >90 beats/min1.38 (1.17–1.64)<0.001
      Statistically significant (p < 0.05).
      Hypoxemia1.42 (1.13–1.78)0.003
      Statistically significant (p < 0.05).
      Chest pain0.89 (0.75–1.05)0.176
      Hemoptysis0.78 (0.52–1.14)0.207
      Unilateral lower limb swelling2.47 (1.90–3.20)<0.001
      Statistically significant (p < 0.05).
      Unilateral lower limb pain1.65 (1.22–2.21)<0.001
      Statistically significant (p < 0.05).
      Previous venous thromboembolism4.33 (3.60–5.20)<0.001
      Statistically significant (p < 0.05).
      Charlson comorbidity index0.97 (0.92–1.02)0.266
      Immobility1.40 (1.01–1.93)0.039
      Statistically significant (p < 0.05).
      Cancer type risk group
       LowReference
       Intermediate1.24 (1.03–1.50)0.027
      Statistically significant (p < 0.05).
       High2.55 (1.86–3.50)<0.001
      Statistically significant (p < 0.05).
       Very high3.64 (2.37–5.60)<0.001
      Statistically significant (p < 0.05).
      Cancer stage
       LocalReference
       Advanced1.40 (1.01–1.94)0.044
      Statistically significant (p < 0.05).
       Liquid/hematologic1.29 (0.93–1.8)0.124
      Active cancer1.35 (1.10–1.65)0.003
      Statistically significant (p < 0.05).
      Time from cancer diagnosis <6 months1.92 (1.62–2.28)<0.001
      Statistically significant (p < 0.05).
      Brain metastasis1.73 (1.32–2.27)<0.001
      Statistically significant (p < 0.05).
      AOR = adjusted odds ratio; BMI = body mass index; CI = confidence interval.
      Statistically significant (p < 0.05).
      The model showed good calibration in the Hosmer-Lemeshow goodness-of-fit test (p = 0.903), indicating no evidence of poor fit. The receiving operating characteristic analysis of the model yielded an area under the curve of 0.74 (95% CI 0.72–0.76). The area under the curve for the King Hussein cohort was 0.78 (95% CI 0.72–0.83), which was not significantly different from the 0.74 area under the curve in the MD Anderson cohort (p = 0.164; Figure 2).
      Figure thumbnail gr2
      Figure 2Receiver operating characteristic analysis. Cancer-related and clinical factors for the prediction of venous thromboembolism did not differ between the MD Anderson and King Hussein cohorts (p = 0.164). AUC = area under the curve; CI = confidence interval.

      Discussion

      Using data from a comprehensive cancer center, we identified cancer-related and clinical risk factors for VTE in patients with cancer presenting to the ED. Specifically, our model showed that cancer type, VTE within 6 months of diagnosis, active and advanced cancer, and the presence of brain metastases can be used to predict VTE in patients with cancer with suspected VTE presenting to the ED. VTE as the outcome of interest was identified by well-established diagnostic criteria and verified by follow-up within 30 days of ED presentation. Having 958 VTE events fulfilled the accepted rule that ≥10 outcome events are included for each predictor in the derivation model. The model showed high prediction performance for VTE and was also validated externally by data from a cancer center in a different country.
      There is currently no validated clinical decision scoring system specific for patients with cancer that can help in the evaluation of these patients for suspected PE. The Wells and Geneva scores are validated clinical decision rules for evaluating patients with suspected PE in emergency/acute care of the general population but are not specifically for patients with cancer. The Khorana score is a helpful tool in patients with cancer, but it is a risk assessment model for identifying patients who are underoing active chemotherapy with a high risk of developing VTE during or after their chemotherapy treatment, to guide the decision for prophylactic anticoagulation. The Khorana score is not for the evaluation of patients with suspected PE, and this score is unsuitable for the ED. Here, we have shown for the first time that cancer-related factors can be combined with clinical factors to predict VTE in patients with cancer who are seeking emergency care. These predictors can be further used in the development of a VTE-predicting scoring system unique for the emergency care cancer population. Such a system could be used in the ED to guide the diagnostic evaluation of VTE, avoiding unnecessary diagnostic imaging studies, laboratory workups, or both.
      It has been known for >150 years that cancer and thrombosis are linked (
      • Trousseau A.
      ). Not only is the risk of thrombosis higher in patients with various malignancies, but unprovoked thrombosis can also be considered an early sign of cancer (
      • Stein P.D.
      • Beemath A.
      • Meyers F.A.
      • Skaf E.
      • Sanchez J.
      • Olson R.E.
      Incidence of venous thromboembolism in patients hospitalized with cancer.
      ,
      • Heit J.A.
      • Silverstein M.D.
      • Mohr D.N.
      • Petterson T.M.
      • O’Fallon W.M.
      • Melton 3rd, L.J.
      Risk factors for deep vein thrombosis and pulmonary embolism: a population-based case-control study.
      ,
      • White R.H.
      • Chew H.K.
      • Zhou H.
      • et al.
      Incidence of venous thromboembolism in the year before the diagnosis of cancer in 528,693 adults.
      ). Several studies have successfully established a correlation between thrombosis and clinical, laboratory, and cancer parameters (
      • Ay C.
      • Dunkler D.
      • Marosi C.
      • et al.
      Prediction of venous thromboembolism in cancer patients.
      ,
      • Khorana A.A.
      • Kuderer N.M.
      • Culakova E.
      • Lyman G.H.
      • Francis C.W.
      Development and validation of a predictive model for chemotherapy-associated thrombosis.
      ,
      • Blom J.W.
      • Doggen C.J.
      • Osanto S.
      • Rosendaal F.R.
      Malignancies, prothrombotic mutations, and the risk of venous thrombosis.
      ,
      • Khorana A.A.
      • Francis C.W.
      • Culakova E.
      • Lyman G.H.
      Risk factors for chemotherapy-associated venous thromboembolism in a prospective observational study.
      ). However, a model that can predict the risk for VTE in patients with any type of cancer is needed. Wells et al. and Le Gal et al. established clinical prediction rules to help with the accurate diagnosis of VTE in the general population; both systems assign points for the existence of active cancer (
      • Wells P.S.
      • Anderson D.R.
      • Rodger M.
      • et al.
      Derivation of a simple clinical model to categorize patients probability of pulmonary embolism: increasing the models utility with the SimpliRED D-dimer.
      ,
      • Le Gal G.
      • Righini M.
      • Roy P.M.
      • et al.
      Prediction of pulmonary embolism in the emergency department: the revised Geneva score.
      ). Several groups, including the Wells et al. group, tested the usefulness of these scores in patients with cancer, with or without the combination of D-dimer levels, and concluded that these scores had a lower clinical utility for excluding VTE in patients with cancer (
      • Carrier M.
      • Lee A.Y.
      • Bates S.M.
      • Anderson D.R.
      • Wells P.S.
      Accuracy and usefulness of a clinical prediction rule and D-dimer testing in excluding deep vein thrombosis in cancer patients.
      ,
      • Douma R.A.
      • van Sluis G.L.
      • Kamphuisen P.W.
      • et al.
      Clinical decision rule and D-dimer have lower clinical utility to exclude pulmonary embolism in cancer patients. Explanations and potential ameliorations.
      ,
      • Di Nisio M.
      • Rutjes A.W.
      • Buller H.R.
      Combined use of clinical pretest probability and D-dimer test in cancer patients with clinically suspected deep venous thrombosis.
      ). This can be explained by the fact that those with active malignant conditions were assigned the same point values for active cancer regardless of the patient's cancer type, stage, or other cancer-related factors. As a result, a significant knowledge gap about the performance of these scores in patients with cancer continues to exist. Using the large MD Anderson cohort, we identified cancer-related and clinical predictors for VTE in patients with cancer, and these factors could be used to develop a more accurate cancer-specific scoring system.
      Malignant cells can produce procoagulant and proinflammatory modulators that activate vascular cells and cause direct adhesion of malignant cells to normal cells, resulting in thrombus formation (
      • Falanga A.
      • Panova-Noeva M.
      • Russo L.
      Procoagulant mechanisms in tumour cells.
      ). These biological factors, along with patient clinical factors, explain why patients with cancer have an increased risk for VTE and highlight the importance of a prediction scoring system solely for the cancer population that incorporates disease-related factors. Among these factors, cancer site, cancer stage, metastatic site, and time from cancer diagnosis were significant cancer-related predictors for VTE in our model. We found that brain and spinal cord cancer and gastric cancer were associated with a very high risk for VTE and that pancreatic, urinary bladder, and gynecologic cancers (excluding endometrial cancer) were associated with a high risk for VTE, corroborating previous reports (
      • Chew H.K.
      • Wun T.
      • Harvey D.
      • Zhou H.
      • White R.H.
      Incidence of venous thromboembolism and its effect on survival among patients with common cancers.
      ,
      • Khorana A.A.
      • Francis C.W.
      • Culakova E.
      • Kuderer N.M.
      • Lyman G.H.
      Frequency, risk factors, and trends for venous thromboembolism among hospitalized cancer patients.
      ,
      • Stein P.D.
      • Beemath A.
      • Meyers F.A.
      • Skaf E.
      • Sanchez J.
      • Olson R.E.
      Incidence of venous thromboembolism in patients hospitalized with cancer.
      ,
      • Blom J.W.
      • Vanderschoot J.P.
      • Oostindier M.J.
      • Osanto S.
      • van der Meer F.J.
      • Rosendaal F.R.
      Incidence of venous thrombosis in a large cohort of 66,329 cancer patients: results of a record linkage study.
      ,
      • Walker A.J.
      • Card T.R.
      • West J.
      • Crooks C.
      • Grainge M.J.
      Incidence of venous thromboembolism in patients with cancer - a cohort study using linked United Kingdom databases.
      ).
      In addition, similar to previous studies, we found that patients with distant metastases or advanced cancer had an increased risk for VTE (
      • Chew H.K.
      • Wun T.
      • Harvey D.
      • Zhou H.
      • White R.H.
      Incidence of venous thromboembolism and its effect on survival among patients with common cancers.
      ,
      • Agnelli G.
      • Bolis G.
      • Capussotti L.
      • et al.
      A clinical outcome-based prospective study on venous thromboembolism after cancer surgery: the @RISTOS project.
      ,
      • Alcalay A.
      • Wun T.
      • Khatri V.
      • et al.
      Venous thromboembolism in patients with colorectal cancer: incidence and effect on survival.
      ). Chew et al. showed that the incidence of VTE is highest within the first year after a cancer diagnosis, especially in patients with advanced cancer, and others have shown that the risk is highest within the first 3–6 months after the diagnosis (
      • Chew H.K.
      • Wun T.
      • Harvey D.
      • Zhou H.
      • White R.H.
      Incidence of venous thromboembolism and its effect on survival among patients with common cancers.
      ,
      • Blom J.W.
      • Doggen C.J.
      • Osanto S.
      • Rosendaal F.R.
      Malignancies, prothrombotic mutations, and the risk of venous thrombosis.
      ,
      • Alcalay A.
      • Wun T.
      • Khatri V.
      • et al.
      Venous thromboembolism in patients with colorectal cancer: incidence and effect on survival.
      ,
      • Chew H.K.
      • Wun T.
      • Harvey D.J.
      • Zhou H.
      • White R.H.
      Incidence of venous thromboembolism and the impact on survival in breast cancer patients.
      ). We found that patients who had their cancer diagnosis ≤6 months before ED presentation had an AOR of 1.92 (p < 0.001), concurring with previous studies. One novel finding in our study was that brain metastasis was associated with a significantly higher risk for VTE compared with other metastatic sites (i.e., lung or liver), suggesting that both primary and metastatic brain tumors are of clinical importance in patients with cancer who are suspected to have VTE.
      Previous VTE, immobility, and obesity are known common risk factors associated with thrombosis, and our study substantiated these factors (
      • Khorana A.A.
      • Kuderer N.M.
      • Culakova E.
      • Lyman G.H.
      • Francis C.W.
      Development and validation of a predictive model for chemotherapy-associated thrombosis.
      ,
      • Agnelli G.
      • Bolis G.
      • Capussotti L.
      • et al.
      A clinical outcome-based prospective study on venous thromboembolism after cancer surgery: the @RISTOS project.
      ,
      • Kroger K.
      • Weiland D.
      • Ose C.
      • et al.
      Risk factors for venous thromboembolic events in cancer patients.
      ). We stratified patients by BMI into <25 kg/m2, 25–30 kg/m2, and ≥30 kg/m2 categories to examine VTE risk. We found that patients with a BMI 25–30 kg/m2 and those with BMI >30 kg/m2 had AORs of 1.36 (95% CI 1.14–1.61) and 1.83 (95% CI 1.27–2.61), respectively, for VTE compared with patients with a BMI <25 kg/m2.
      Racial/ethnic differences in VTE risk have also been reported. Chew et al. showed that racial differences in VTE risk depend mainly on the cancer type, with the lowest risk observed among Asian-Pacific Islanders (
      • Chew H.K.
      • Wun T.
      • Harvey D.
      • Zhou H.
      • White R.H.
      Incidence of venous thromboembolism and its effect on survival among patients with common cancers.
      ). We also found that Asian patients had the lowest risk (and thus used that group as our reference), while white patients were at higher risk than other racial and ethnic categories in our cohort.
      We also found that heart rate and unilateral limb swelling or pain were significant predictors of VTE. This is consistent with the findings of Wells et al. and Le Gal et al. (
      • Wells P.S.
      • Anderson D.R.
      • Rodger M.
      • et al.
      Derivation of a simple clinical model to categorize patients probability of pulmonary embolism: increasing the models utility with the SimpliRED D-dimer.
      ,
      • Le Gal G.
      • Righini M.
      • Roy P.M.
      • et al.
      Prediction of pulmonary embolism in the emergency department: the revised Geneva score.
      ). Hypoxemia, a known sign associated with PE that mainly reflects ventilation-to-perfusion mismatch, also was also a significant predictor of VTE (
      • Stein P.D.
      • Terrin M.L.
      • Hales C.A.
      • et al.
      Clinical, laboratory, roentgenographic, and electrocardiographic findings in patients with acute pulmonary embolism and no pre-existing cardiac or pulmonary disease.
      ).

      Limitations

      Certain biases and limitations accompanied our study. Not all patients presenting to the ED were included in the analysis. Specifically, only those who had D-dimer results were included. Although this is an unavoidable limitation given the retrospective nature of the dataset and may have introduced selection bias, we used this exclusion criterion because D-dimer is on the diagnostic panels for the evaluation of chest pain, shortness of breath, or limb swelling. Most ED patients had D-dimer ordered for the evaluation of these symptoms. Also, this made it possible to include all signs and symptoms in the analysis without preselection using particular signs or symptoms as study inclusion criteria.

      Conclusion

      In summary, we identified cancer-related and clinical predictors of VTE in patients with cancer who presented to the ED. We successfully validated the predictive ability of these variables externally. A future prospective study can be helpful to assess these predictors and combine them in a clinical prediction scoring system, similar to the Wells and Geneva scores, that can be safely used to improve the use of imaging and other work-up of suspected VTE in patients with cancer.

      Acknowledgments

      The University of Texas MD Anderson Cancer Center is supported in part by the National Institutes of Health, United States through Cancer Center, United States Support Grant P30 CA016672. Dr. Yang is supported by Guangzhou First People's Hospital, Guangzhou Medical University, China. Dr. Hu is supported by the China Scholarship Council, China. Dr. Lin is supported by Sun Yat-sen University Cancer Center, China. Dr. Yeung is the principal investigator of an investigator-initiated clinical trial supported by DepoMed and a retrospective clinical study supported by Bristol-Myers Squibb, United States through ARISTA-USA (BMS/Pfizer American Thrombosis Investigator Initiated Research Program). All other authors declare no competing financial or nonfinancial interests. S.J.Y., A.Q., and C.R.G. conceived and designed the study and developed the methods. S.J.Y. and H.A.R. provided study supervision. A.Q., W.W., J.Z.L., Z.Y., Z.H., S.G., X.L., J.S., G.H., J.V.U., K.J., and P.C. acquired data from MDACC. R.A.S., S.A.A., and N.A.H.Q. acquired data from KHCC. C.C.W. reviewed questionable diagnostic images. S.J.Y. supervised statistical analysis. A.Q., J.Z.L., Z.Y., and Z.H. analyzed and interpreted the data. A.Q. created the figures and tables. S.J.Y., A.Q., R.A.S., and M.T.C.C. drafted the manuscript. All authors reviewed and provided final approval of the manuscript. The institutional review boards of The University of Texas MD Anderson Cancer Center and King Hussein Cancer Center both granted waivers of informed consent. We thank Erica Goodoff, ELS, for editorial support.

      Article Summary

        1. Why is this topic important?

      • Accurate and early detection of cancer-associated venous thromboembolism including pulmonary embolisms can avoid unnecessary diagnostic imaging or laboratory tests.

        2. What does this study attempt to show?

      • In this study, we sought to determine cancer-related risk factors of venous thromboembolism in patients with cancer that can be combined with common clinical risk factors and used as predictors for cancer-associated venous thromboembolism.

        3. What are the key findings?

      • Cancer risk group, presentation within 6 months of cancer diagnosis, active and advanced cancer, and the presence of brain metastases along with other related clinical factors can be used to predict venous thromboembolism in cancer patients presenting to the emergency department.

        4. How is patient care impacted?

      • Using both cancer-related and common clinical factors to predict the presence of thrombosis in patients with cancer who present with suspected venous thromboembolism can help in identifying the need for diagnostic imaging or laboratory tests and prompt accurate and early detection of these thrombotic events.

      Supplementary Data

      References

        • Lee A.Y.
        • Levine M.N.
        Venous thromboembolism and cancer: risks and outcomes.
        Circulation. 2003; 107: I17-I21
        • Chew H.K.
        • Wun T.
        • Harvey D.
        • Zhou H.
        • White R.H.
        Incidence of venous thromboembolism and its effect on survival among patients with common cancers.
        Arch Intern Med. 2006; 166: 458-464
        • Cohoon K.P.
        • Ransom J.E.
        • Leibson C.L.
        • et al.
        Direct medical costs attributable to cancer-associated venous thromboembolism: a population-based longitudinal study.
        Am J Med. 2016; 129: 1000.e15-1000.e25
        • Elting L.S.
        • Escalante C.P.
        • Cooksley C.
        • et al.
        Outcomes and cost of deep venous thrombosis among patients with cancer.
        Arch Intern Med. 2004; 164: 1653-1661
        • Khorana A.A.
        • Francis C.W.
        • Culakova E.
        • Kuderer N.M.
        • Lyman G.H.
        Frequency, risk factors, and trends for venous thromboembolism among hospitalized cancer patients.
        Cancer. 2007; 110: 2339-2346
        • Stein P.D.
        • Beemath A.
        • Meyers F.A.
        • Skaf E.
        • Sanchez J.
        • Olson R.E.
        Incidence of venous thromboembolism in patients hospitalized with cancer.
        Am J Med. 2006; 119: 60-68
        • Wells P.S.
        • Anderson D.R.
        • Rodger M.
        • et al.
        Derivation of a simple clinical model to categorize patients probability of pulmonary embolism: increasing the models utility with the SimpliRED D-dimer.
        Thromb Haemost. 2000; 83: 416-420
        • Le Gal G.
        • Righini M.
        • Roy P.M.
        • et al.
        Prediction of pulmonary embolism in the emergency department: the revised Geneva score.
        Ann Intern Med. 2006; 144: 165-171
        • Wells P.S.
        • Hirsh J.
        • Anderson D.R.
        • et al.
        Accuracy of clinical assessment of deep-vein thrombosis.
        Lancet. 1995; 345: 1326-1330
        • Wells P.S.
        • Ginsberg J.S.
        • Anderson D.R.
        • et al.
        Use of a clinical model for safe management of patients with suspected pulmonary embolism.
        Ann Intern Med. 1998; 129: 997-1005
        • Qdaisat A.
        • Yeung S.J.
        • Variyam D.E.
        • et al.
        Evaluation of cancer patients with suspected pulmonary embolism: performance of the American College of Physicians Guideline.
        J Am Coll Radiol. 2020; 17: 22-30
        • Ay C.
        • Dunkler D.
        • Marosi C.
        • et al.
        Prediction of venous thromboembolism in cancer patients.
        Blood. 2010; 116: 5377-5382
        • Khorana A.A.
        • Kuderer N.M.
        • Culakova E.
        • Lyman G.H.
        • Francis C.W.
        Development and validation of a predictive model for chemotherapy-associated thrombosis.
        Blood. 2008; 111: 4902-4907
        • Verso M.
        • Agnelli G.
        • Barni S.
        • Gasparini G.
        • LaBianca R.
        A modified Khorana risk assessment score for venous thromboembolism in cancer patients receiving chemotherapy: the Protecht score.
        Intern Emerg Med. 2012; 7: 291-292
        • Gerotziafas G.T.
        • Taher A.
        • Abdel-Razeq H.
        • et al.
        A predictive score for thrombosis associated with breast, colorectal, lung, or ovarian cancer: the prospective COMPASS-Cancer-Associated Thrombosis Study.
        Oncologist. 2017; 22: 1222-1231
        • Lee A.Y.
        • Julian J.A.
        • Levine M.N.
        • et al.
        Clinical utility of a rapid whole-blood D-dimer assay in patients with cancer who present with suspected acute deep venous thrombosis.
        Ann Intern Med. 1999; 131: 417-423
        • Qdaisat A.
        • Soud R.A.
        • Wu C.C.
        • et al.
        Poor performance of D-dimer in excluding venous thromboembolism among patients with lymphoma and leukemia.
        Haematologica. 2019; 104: e265-e268
        • Qdaisat A.
        • Wu C.C.
        • Yeung S.J.
        Normal D-dimer levels in cancer patients with radiologic evidence of pulmonary embolism.
        J Thromb Thrombolysis. 2019; 48: 174-179
        • Blom J.W.
        • Doggen C.J.
        • Osanto S.
        • Rosendaal F.R.
        Malignancies, prothrombotic mutations, and the risk of venous thrombosis.
        JAMA. 2005; 293: 715-722
        • Khorana A.A.
        • Francis C.W.
        • Culakova E.
        • Lyman G.H.
        Risk factors for chemotherapy-associated venous thromboembolism in a prospective observational study.
        Cancer. 2005; 104: 2822-2829
        • Trousseau A.
        Clinique Medicale de l'Hotel-Dieu. 1865; 3: 654-712
        • Heit J.A.
        • Silverstein M.D.
        • Mohr D.N.
        • Petterson T.M.
        • O’Fallon W.M.
        • Melton 3rd, L.J.
        Risk factors for deep vein thrombosis and pulmonary embolism: a population-based case-control study.
        Arch Intern Med. 2000; 160: 809-815
        • White R.H.
        • Chew H.K.
        • Zhou H.
        • et al.
        Incidence of venous thromboembolism in the year before the diagnosis of cancer in 528,693 adults.
        Arch Intern Med. 2005; 165: 1782-1787
        • Carrier M.
        • Lee A.Y.
        • Bates S.M.
        • Anderson D.R.
        • Wells P.S.
        Accuracy and usefulness of a clinical prediction rule and D-dimer testing in excluding deep vein thrombosis in cancer patients.
        Thromb Res. 2008; 123: 177-183
        • Douma R.A.
        • van Sluis G.L.
        • Kamphuisen P.W.
        • et al.
        Clinical decision rule and D-dimer have lower clinical utility to exclude pulmonary embolism in cancer patients. Explanations and potential ameliorations.
        Thromb Haemost. 2010; 104: 831-836
        • Di Nisio M.
        • Rutjes A.W.
        • Buller H.R.
        Combined use of clinical pretest probability and D-dimer test in cancer patients with clinically suspected deep venous thrombosis.
        J Thromb Haemost. 2006; 4: 52-57
        • Falanga A.
        • Panova-Noeva M.
        • Russo L.
        Procoagulant mechanisms in tumour cells.
        Best Pract Res Clin Haematol. 2009; 22: 49-60
        • Blom J.W.
        • Vanderschoot J.P.
        • Oostindier M.J.
        • Osanto S.
        • van der Meer F.J.
        • Rosendaal F.R.
        Incidence of venous thrombosis in a large cohort of 66,329 cancer patients: results of a record linkage study.
        J Thromb Haemost. 2006; 4: 529-535
        • Walker A.J.
        • Card T.R.
        • West J.
        • Crooks C.
        • Grainge M.J.
        Incidence of venous thromboembolism in patients with cancer - a cohort study using linked United Kingdom databases.
        Eur J Cancer. 2013; 49: 1404-1413
        • Agnelli G.
        • Bolis G.
        • Capussotti L.
        • et al.
        A clinical outcome-based prospective study on venous thromboembolism after cancer surgery: the @RISTOS project.
        Ann Surg. 2006; 243: 89-95
        • Alcalay A.
        • Wun T.
        • Khatri V.
        • et al.
        Venous thromboembolism in patients with colorectal cancer: incidence and effect on survival.
        J Clin Oncol. 2006; 24: 1112-1118
        • Chew H.K.
        • Wun T.
        • Harvey D.J.
        • Zhou H.
        • White R.H.
        Incidence of venous thromboembolism and the impact on survival in breast cancer patients.
        J Clin Oncol. 2007; 25: 70-76
        • Kroger K.
        • Weiland D.
        • Ose C.
        • et al.
        Risk factors for venous thromboembolic events in cancer patients.
        Ann Oncol. 2006; 17: 297-303
        • Stein P.D.
        • Terrin M.L.
        • Hales C.A.
        • et al.
        Clinical, laboratory, roentgenographic, and electrocardiographic findings in patients with acute pulmonary embolism and no pre-existing cardiac or pulmonary disease.
        Chest. 1991; 100: 598-603