Episode 39 – Likelihood Ratios

(ITUNES OR LISTEN HERE)

The Free Open Access Medical Education (FOAM)

We cover Dr. Rory Spiegel’s blog EMNERD, covering an article in Chest 2015 by Pivetta et al, discussing the ways lung ultrasound (US) may be far more helpful than the brain natriuretic peptide (BNP) in determining heart failure in the dyspneic patient.  

  • BNP: + LR 2, – LR 0.2
  • Lung US: + LR 22, – LR 0.03

Core Content – Likelihood Ratios

Likelihood Ratios can help us use diagnostic maneuvers to determine whether a patient has a disease process.  The calculations (as promised on the podcast):

  • + LR = Sensitivity/(1-Specificity)
  • -LR = 1- Sensitivity/(Specificity)

Interpreting LRs really involves only 3 numbers: 1, 10, 0.1. 

The utility of likelihood ratios also depends on our pre-test probability. This is essentially our assessment of a patient. Pretend that a patient comes in and states she’s 18 weeks pregnant and she has an intrauterine pregnancy on bedside ultrasound with a fetal heart rate of 150. Your pretest probability that this patient is pregnant is 100%. As such, no test will really be able to move that needle. Similarly, a male comes in with abdominal pain and a normal genital exam.  What’s your pre-test probability that the patient is pregnant? Somewhere around 0%. Again, a test will not help you here, regardless of the LR of a pregnancy test.  Another 28 year old female patient may come in with abdominal pain and last menstrual cycle 3 weeks ago. What’s your pretest probability that she’s pregnant? Probably in that uncertain but possible range – 20-50%. Here, a test may be useful if it has a good LR.  If the +LR of the HCG is high the patient is very likely pregnant and, conversely a low -LR meaning that if the test is negative, the patient is nearly certainly not pregnant.

LR near 1 is useless.  Using the Fagan nomogram, one can see that if the pre-test probability is in the “I’m not sure range”, a LR near 1 moves the needle slightly up but to the “I’m still not sure range.”  This means that the diagnostic test will not be much help in our post-test probability.

LRs near 1 are useless

-LRs are helpful once they’re in the 0.1 range.  Using this nomogram we can see that in a patient that we’re not sure about, a test with a -LR of 0.1 can reduce the likelihood that the patient has the disease in question to the low single digits (whether or not that’s enough depends on the disease process in question).

Screen Shot 2015-12-08 at 10.35.38 AM
-LRs of 0.1 and below are very useful

+ LRs near 10 are very useful as, if the test is positive, the patient likely has the disease. In a patient that one says “maybe they have X disease?”, a pre-test probability of say, 40%, a positive test with a +LR of 10 means that there’s a 90-something percent probability that the patient does have the disease. We can be much more certain.

 

+LR of 10 very useful

+LRs from 0 to 5 are not very useful. They may shift the probability from a pre-test probability of “maybe?” to a post-test probability of “maybe.”

Screen Shot 2015-12-10 at 6.09.26 AM

 -LRs from 1 to 0.2 are not very useful. They may shift the post-test probability slightly but not much.

+LR 0-5 and -LR 1-0.2 with minimal utility
+LR 0-5 and -LR 1-0.2 with minimal utility

More resources:

Deeks JJ. Diagnostic tests 4: likelihood ratios. BMJ. 329(7458):168-169. 2004. [article]

BoringEM on Likelihood Ratios.

Episode 38 – The Nose

(ITUNES OR LISTEN HERE)

The Free Open Access Medical Education (FOAM)

The FOAM realm has teamed with interest in a randomized trial in the ICU by Semler et al, the FELLOW trial. This trial randomized ICU patients undergoing intubation to receive 15L NC during intubation or usual care. The study found no difference in the primary outcome of the study, the difference between the mean lowest oxygen saturations between the two groups – 92% (IQR 84-99%) in the usual care vs 90% (IQR 80-96%) in the apneic arm (p=0.16). Critiques of this study can be found below:

Concerns echoed by these sources include the clinical importance of the primary outcome (not patient oriented) and that the study may have been underpowered to detect a true difference.

Statistical power – the chance that an experiment will result in a statistically significant. Three main things influence statistical power:

  • The size of the difference you’re looking to find, the smaller the difference, the more numbers one will need.
  • The p value you’re looking to find to label it a “real” effect (although p values themselves may be overrated). A p value of <0.05 will need fewer numbers than a p value of <0.001
  • The frequency of the outcome into consideration. The more infrequent the outcome, the harder it will be able pick up in a small sample.

Also, oxygen saturation, a continuous variable, was appropriately analyzed by non-parametric (non normal distribution) means. Non-parametric means often have less power to detect a difference (aren’t as powerful).  The FELLOW study was powered using parametric means, which is common practice (fewer programs can perform this) but may have also contributed to the studying having insufficient power to achieve the primary outcome.

Screen Shot 2015-11-24 at 8.27.44 AM

Core Content – Epistaxis and Sinusitis

Tintinalli (7e) Chapter 239, “Epistaxis, Nasal Fractures, and Rhinosinusitis.” Rosen’s  (8e) Chapter 75, “Upper Respiratory Infection.”, “Otolaryngology”

Epistaxis

Causes:

  • Traumatic: trauma, digital (nose picking), foreign body, sinus infection, nasogastric tube
  • Environment: dry, cold air, oxygen
  • Inhalants: inhaled steroids/medications, cocaine
  • Coagulopathy: iatrogenic (warfarin, aspirin, platelet inhibitors, etc), familial (hemophilia, von Willebrand’s disease)
  • Vascular abnormalities: aneurysm, AVM, neoplasm

Location: Anterior bleeds most common (Kiesselbach’s plexus). Posterior bleeds (sphenopalantine or carotid artery branches) more dangerous.

Treatment: (note: TXA is not in Rosen’s or Tintinalli, see Zahed and colleagues). Update 2/21/21: New trial shows no benefit of TXA 

Screen Shot 2015-12-02 at 12.07.14 PM

Sinusitis

Symptoms:  mucopurulent nasal discharge,congestion, facial pain or pressure.  Generally last 7-10 days and often viral.   Diagnosis is predominantly clinical and does not routinely require CT scan [3]

Treatment: typically supportive care as most cases are self-limiting [2].  American Academy of Allergy Asthma Immunology Choosing Wisely : “Antibiotics usually do not help sinus problems, Antibiotics cost money. Antibiotics have risks” [4]. Despite these recommendations, provider still routinely prescribe antibiotics inappropriately [5].

Antibiotics (amoxicillin-clavulanate) recommended if:

  • Symptoms persist 10+ days
  • Severe symptoms >3-4 days or get worse after initial symptoms
    • Severe: Temperature 102F or more + purulent nasal discharge or facial pain [2]

Generously Donated Rosh Review Questions 

1.An 18-month-old girl presents to urgent care with profuse mucoid nasal discharge and cough. She has had nasal discharge for the past 2 weeks with no improvement from using a humidifier. She has also had fever for the past four days, with a Tmax of 103°F. She has not been able to attend daycare for the past week due to the fever and persistent symptoms. [polldaddy poll=9196746]

2. A 42-year-old man presents with facial pain. He reports pain over his cheeks and forehead with associated fever for the last 24 hours. On inspection of his nasal passages you not inflamed turbinates with green discharge. He is tender over palpation of the frontal and maxillary sinuses. [polldaddy poll=9196749]

Answers.

1.C. Acute sinusitis is a common illness of childhood, characterized by fever, cough, purulent nasal discharge, and nasal congestion. The most common cause of sinusitis is viral, which is best treated with supportive care. Acute bacterial sinusitis often follows a case of viral sinusitis. In young children, sinusitis may be present in the ethmoidal sinuses. The maxillary sinuses are present at birth, but are not pneumatized until 4 years of age. The sphenoid sinuses are present by age 5, and the frontal sinuses begin development at age 7-8. Due to this child’s persistent symptoms for more than 10-14 days, fever of greater than 102°F, and purulent nasal discharge for more than 3 consecutive days, the most likely diagnosis is acute bacterial sinusitis. The most common bacterial pathogens are Streptococcus pneumoniae (30%), nontypable Haemophilus influenzae (20%), and Moraxella catarrhalis (20%). Less common causes include other strains of streptococci, Staphylococcus aureus, and anaerobic bacteria. Initial treatment consists of low dose amoxicillin, which covers the most common bacterial pathogens. However, some children are at risk for resistant strains of bacterial pathogens, such as children in daycare, those less than 2 years of age, and those who have received antibiotics in the preceding 1-3 months. These children should be given amoxicillin-clavulanate with high dose amoxicillin. Children who fail initial therapy should also be escalated to high dose amoxicillin-clavulanate.Azithromycin (A) is an alternative antibiotic that can be used to treat sinusitis in older children. It would not be the first line therapy in this young child. Ceftriaxone (B) should be used in frontal sinusitis, complicated sinusitis (such as periorbital or orbital cellulitis) or in the setting of intracranial complications (such as epidural abscess, meningitis, or cavernous sinus thrombosis). Low dose amoxicillin (D) is the first line therapy in uncomplicated sinusitis, when the child does not have risk factors for resistant bacterial pathogens.

2. C. This patient has rhinosinusitis. Viral upper respiratory infections and allergic rhinitis are the most common causes of acute rhinosinusitis. Additional risk factors are ciliary immobility or dysfunction, structural abnormalities, immunocompromise, Patients with viral sinusitis are at risk of developing bacterial sinusitis as a consequence of the viral infection. Clinically patients with acute rhonisinusitis develop mucopurulent nasal discharge, facial or sinus pain, and nasal congestion. Symptoms of acute sinusitis typically progress over the first several days and spontaneously resolve after 7 to 10 days. It is difficult to distinguish clinically between viral and bacterial infection in the first several days of illness and antibiotic therapy is not recommended at this time. Management focuses on symptomatic treatment with pain management and decongestant therapy. Antihistamines may provide some benefit for patients with allergic rhinosinusitis. Decongestant therapy is available topically with agents like oxymetazoline. Systemic therapy includes pseudoephedrine. Saline nasal irrigation is beneficial for all forms of acute rhinosinusitis. Topical and systemic steroids are no longer recommended for acute sinusitis.A CT scan of the sinuses (A) is not necessary in this patient. Imaging is indicated when there are concerns for complications of cellulitis (e.g. cavernous sinus thrombosis, abscesses, orbital involvement) or invasive fungal infections. ENT consultation (B) is not necessary for uncomplicated cellulitis. A prescription for amoxicillin/clavulanic acid (D) is not indicated in the first several days of illness because of the likelihood this is viral. Without improvement after symptomatic therapy or progression to chronic sinusitis antibiotics are indicated.

References:

1.Semler MW, Janz DR, Lentz RJ, et al. Randomized Trial of Apneic Oxygenation during Endotracheal Intubation of the Critically Ill. Am J Respir Crit Care Med. 2015:rccm.201507–1294OC.

2. Chow AW, Benninger MS, Brook I et al. Executive Summary: IDSA Clinical Practice Guideline for Acute Bacterial Rhinosinusitis in Children and Adults. Clinical Infectious Diseases. 54(8):1041-1045. 2012

3. “Ten Things Physicians and Patients Should Question.” American Academy of Allergy, Asthma, and Immunology. Released April 4, 2012

4. “Treating Sinusitis.” Choosing Wisely. April 2012.

5. Sharp AL, Klau MH, Keschner JD et al. “Low-Value Care for Acute Sinusitis Encounters: Who’s Choosing Wisely?” Am J Manag Care. 2015;21(7):479-485

FOAMcastini – Kappa

(ITUNES OR LISTEN HERE)

Reading papers is hugely important but learning how to read medical literature is an entirely different realm and many of us have statsphobia.

The Free Open Access Medical Education (FOAM)

Kappa – It’s Greek To Me

The Bread and Butter

Kappa – a coefficient indicating the degree of inter-rater reliability.  How reliability are people getting the same result for a certain test or evaluation?

  • For example, you would want two people looking at the same chest x-ray to agree on the presence or absence of an infiltrate. Sometimes, chance comes into play and kappa tries to account for this.  Similarly, clinical decision aids are often comprised of various historical and physical features.  It would be nice if different clinicians evaluating the same patient would turn up the same results (thereby yielding the decision aid consistent and reliable).

To see how to calculate kappa, check this out.

The value of kappa ranges from -1 (perfect disagreement that is not due to chance) to +1 (perfect agreement that IS due to chance).  A value of 0 means than any agreement is entirely due to chance [1-2].

kappa

People debate over what a “good” kappa is.  Some say 0.6,  some say 0.5 [1-2]. In the PECARN decision aid, for example, the authors only included variables with a kappa of 0.5 [3-4].

Limitations:

  • Prevalence – if prevalence is high, chance agreement is also high.  Kappa takes into account the prevalence index; however, raters may also be predisposed to not diagnose a rare condition, so that the prevalence index provides only an indirect indication of true prevalence, altered by rater behavior [6].
  • The raters – agreement may vary based on rater skill, experience, or education.  For example, when PECARN variables were looked at between nurses and physicians, the overall kappa for “low risk” by PECARN was 0.32, below the acceptable threshold as this number suggests much of the agreement may be due to chance [6].
  • Kappa is based on the assumption that ratings are independent (ie a rater does not know the category assigned by a prior rater).

References
1. Viera AJ, Garrett JM. Understanding interobserver agreement: the kappa statistic. Fam Med. 2005;37:(5)360-3.

2. McGinn T, Wyer PC, Newman TB, et al. Tips for teachers of evidence-based medicine: 3. Understanding and calculating kappa. CMAJ. 2004;171 (11)

3.Kuppermann N, Holmes JF, Dayan PS, et al. Identification of children at very low risk of clinically-important brain injuries after head trauma: a prospective cohort study. Lancet. 2009;374:(9696)1160-70. [pubmed]

4. Gorelick MH, Atabaki SM, Hoyle J, et al. Interobserver agreement in assessment of clinical variables in children with blunt head trauma. Acad Emerg Med. 2008;15:(9)812-8.

5. Nigrovic LE, Schonfeld D, Dayan PS, Fitz BM, Mitchell SR, Kuppermann N. Nurse and Physician Agreement in the Assessment of Minor Blunt Head Trauma. Pediatrics. 2013.

6. de Vet HC, Mokkink LB, Terwee CB, Hoekstra OS, Knol DL.  Clinicians are right not to like Cohen’s κ 2013;346:f2125