Can We Trust Information on YouTube?

Once upon a time, in my academic career, I worried that inaccurate mass media depictions of, say, diabetics would cause people to make bad care choices. If you’re thinking of Julia Roberts in Steel Magnolias right now, trust me: Julia Roberts in Dolly Parton’s hair salon is the tippy-tip of the iceberg. Now I worry more about YouTube, the modern-day Library of Alexandria of instructional videos.

In the past year or so I have watched YouTube videos, off the top of my head, to learn to: change a blinker bulb in my car, fix my thermostat, learn to run specific reports within Quickbooks, refresh my memory on how to do certain math problems for helping with my daughter’s homework, and shut off the “move to wake” feature in my iPhone. And dozens more.

But I’ve also used YouTube in the past to remind myself how to reduce my son’s dislocated elbow (my son’s orthopedic history gets more complex by the year). There’s an old saying in medicine: “see one, do one, teach one.” I needed to “see one” again before I subjected my son to it. The procedure was successful, for what it’s worth. (Being a doctor’s kid is weird. I digress.) Are you scheduled to have your thyroid gland removed? YouTube can show you the procedure. Are you a new type 1 diabetic who wants to practice carbohydrate counting for insulin dosing? Boom. Starting chemotherapy and interested in using cooling therapy to reduce hair loss? Look no further. Recently we talked about the reliability of physician rating sites (spoiler: potentially useful, but with major caveats). How do YouTube videos stack up for general medical information? For the purposes of this post, I’m mostly ignoring obvious conspiracy-mongering about COVID vaccinations, cholesterol medications, and whatnot. Like pornography, I trust that you’ll know those when you see them.

To get an answer on the accuracy and utility of YouTube videos for medical inquiry, I looked not to YouTube, but to PubMed, the search engine of the National Library of Medicine. Here’s what I found:

YouTube contains so much information that investigators tend to categorize it by learner, generally either medical trainees or the general public. Videos for medical trainees seem to be relatively generously reviewed by researchers. Using our example of thyroid surgery from above, one study found that most YouTube thyroid surgery videos were posted by surgeons operating in academic institutions, which they took to mean the intentions of the videos were purely educational and not promotional. But the researchers also noted that surgeons who had no history of traditional academic publications–i.e., not necessarily the most respected people in the field–posted the majority of surgeon-sourced videos. This led the authors to conclude that “Trainees and educators alike should critically analyze the quality of video content,” which is the academic equivalent of throwing shade. A systematic review of studies of YouTube videos aimed at medical learners backed this up, concluding that “While videos authored by academic physicians were of higher quality on average, their quality still varied significantly,” and “Video characteristics and engagement metrics were found to be unreliable surrogate measures of video quality.” That is, a video’s slick production and millions of views did not mean it was accurate.

Videos aimed at the general public tend to be more harshly judged. One study by two emergency room doctors investigating the quality of videos pertaining to the management of low blood sugars went so far as to say that “health videos should only be uploaded by physicians,” a statement hilarious in both its confidence and its wrongness. Surely someone without a medical degree somewhere, at some point, has been filmed saying something accurate and helpful. But, in general, the quality of public-facing YouTube videos does appear to suffer in comparison to professional learner-directed videos. A systematic review from 2015, admittedly ancient history in internet years, concluded that “YouTube contains misleading information, primarily anecdotal, that contradicts the reference standards and the probability of a lay user finding such content is relatively high.” But, on the bright side, they also found that “videos from government organizations and professional associations contained trustworthy and high-quality information.” We at KBGH, who have produced and posted videos of our own, hope that we fall into that category.

Let’s bottom-line what we can take from this research. First, beware of any video that makes claims that seem extraordinary. Someone who says that removing a food from your diet is as powerful as taking cholesterol medications for preventing heart attacks, for example, better have good evidence to back that statement up. Second, pay attention to the source. Videos from academic centers, government agencies, and professional associations appear to be the most reliable. But they’re also, I suspect, the most conservative. Few such organizations are willing to put themselves out on a limb compared to their peers. Finally, beware of using the number of views or shares as a marker of the reliability of a video’s contents. As we’ve discussed before in this very blog, the internet is set up to make sure the most radical statements get the most eyeballs.

As the Medical Director of the Kansas Business Group on Health I’m sometimes asked to weigh in on hot topics that might affect employers or employees. This is a reprint of a blog post from KBGH.

We Need to Support Black Doctors

As the Medical Director of the Kansas Business Group on Health I’m sometimes asked to weigh in on topics that might affect employers or employees. This is a reprint of a blog post from KBGH:

The stark differences in health outcomes

We should never reduce any population of people to a set of statistics. Every one of those “statistics” has a story. But here are a few numbers that should get our attention:

African-Americans have a rate of COVID-19 that is three times higher than the infection rate of the population as a whole. Even worse, the risk of death of an African-American person with COVID-19 far exceeds that of other racial groups. While people of white, Latinx, and Asian descent have death rates that all fall between 20 and 23 deaths per 100,000 people, African-Americans have suffered a death rate more than twice as high: 50.3 deaths per 100,000 people. About one out of every 2,000 black people in America have already died of COVID-19. Let me repeat that: one two-thousandth of African Americans are already dead. From one disease. A similar death rate among white people would have resulted in almost 100,000 deaths just in that ethnic group so far. And sadly, Kansas has the highest racial disparity of any of the 41 states reporting such data.

But the damage is not limited to viral illnesses. Americans in general have lives about three years shorter than citizens of peer countries like those in Western Europe.

Screen Shot 2020-06-12 at 10.05.54 AM.png

African-American men have a life expectancy that is, in turn, almost five years shorter than the American average. This means that an African-American man loses the better part of a decade in life expectancy compared to an average western European citizen.

Screen Shot 2020-06-12 at 10.12.50 AM.png

And almost all of this difference is due to heart disease deaths, the risk of which is readily modifiable with solid, basic medical care.

What are the reasons for this disparity?

The basic medical care of black people is neglected for multiple reasons in our country, including a well-deserved historic lack of trust in the medical system by black people. Remember that in the Tuskegee Syphilis Experiment the U.S. Public Health Service intentionally and secretly withheld treatment from a group of black men with syphilis from 1932 to 1972 to study the “natural history” of the disease, jeopardizing the health of the men and any future partners. 1972!

A second problem is a dearth of black physicians, starting in training. African-Americans are tragically underrepresented in medical school. While African-Americans make up 13.4% of the American population, they make up only 7.3% of medical students. This disparity, while slowly shrinking over time, has real consequences. Patients may do better when cared for by someone who looks like they do. A 2018 randomized trial found that black men had far better outcomes when cared for by black doctors: rates of screening for hypertension, diabetes, high cholesterol, and obesity went up markedly in men with black doctors, by more than 25% in some cases. The difference appeared to be due to improved communication. Patients were simply more likely to bring up other health problems when assigned to a black doctor. Interestingly, uptake of “invasive” screenings—tests involving probing or a blood draw–increased only for the group assigned a black doctor. This would seem to reinforce the idea that trust, long missing with the medical establishment, is a vital part of the doctor-patient relationship. And the cultural knowledge imparted by someone from your own community can be priceless, something we have found in our CDC work on community health workers.

The increased rate of screening demonstrated in this study could have huge health implications. The investigators tried to estimate the effect of having more black doctors in the population as a whole and found that even a modest increase could reduce the black-white gap in heart disease mortality by 19%, and the and the overall black-white gap in male life expectancy by 8%.

Efforts are being made to attack this problem from the start. After all, the lack of black trainees isn’t simply the result of fewer black kids wanting to be doctors. Quite the contrary. Locally, the Medical Society of Sedgwick County sends member physicians every year to talk to high school students about the process of applying for and completing medical training. Nationally, the American Medical Association has a program called “Doctors Back to School” to facilitate physicians of color visiting grade schools to encourage minority students to consider careers in medicine. Kids cannot be what they cannot see, as the platitude goes.

But the real impediment to getting more black doctors probably lies in greater systemic reform of the type that is being aggressively advocated for nationwide. We need to see this as a failure of the system, not a failure of individual people. As you watch protests unfold nationally and locally, I hope your view of them changes when you see them through this lens.

Your Doctor Is Your Real Financial Planner

As the Medical Director of the Kansas Business Group on Health I’m sometimes asked to weigh in on hot topics that might affect employers or employees. This is a reprint of a blog post from KBGH:

The last time you spoke to your financial planner, I suspect the first question she asked you was some version of “Where would you like to be in ten years?” Or twenty, or thirty. Maybe you told her that you wanted to have your house paid off, or to be out of debt, or to be retired, or to have enough savings to send your kids to college.

The last time you went to the doctor, though, I’m willing to bet your conversation was more…retrospective. Medical students are taught to use open-ended questions to initiate a visit, so he probably asked something like “What brings you in today?” And if you’re like most people your answer wasn’t “I want to make sure I’m happier and healthier ten years from now than I am today.” Instead you probably led with whatever complaint was bothering you that day: a rash, a sore joint, shortness of breath. This doesn’t mean you were doing it wrong. Doctors exist to relieve suffering, after all. The Hippocratic Oath states in part that “I will apply, for the benefit of the sick, all measures which are required.”

``Where would you like to be in ten years?`` isn't just a question that should come from your financial planner. It should come from your doctor, too.

But if you’ll allow the slight stretching of a metaphor, what if your interactions with your health care professional sounded more like your conversations with your financial professional? Because the person that is most in charge of your financial future may not be your financial advisor. It’s more likely your doctor. Here are some hard truths at the intersection of medicine and finance:

So “Where would you like to be in ten years?” isn’t just a question that should come from your financial planner. It should come from your doctor, too.

What if we applied a financial planning rubric to health and wellness? Once the shock wore off from your doctor asking you where you wanted to be in ten years, what would you say? If you were diabetic, you might first answer that you wanted to avoid the complications of diabetes: you wanted to keep your vision, you wanted to keep all your toes, and you wanted to avoid having to go on dialysis for kidney failure. These are all perfectly good answers, but they suffer from low expectations. They’re a little like telling your financial advisor that you want to avoid bankruptcy and avoid having the bank repossess your house.

What if you were more ambitious? What if you said that, in addition to all those, you wanted to run a 5k with your granddaughter, or dance at your son’s wedding without being out of breath? What if you said you wanted to be able to carry your infant grandson up and down stairs without fearing a fall? Fortunately, just as the best financial strategies tend to be simple, the best health strategies are simple, too. Just as the financial advisor would hopefully come up with a plan to start putting money away, your doctor would work with you to make a shared decision on how to get to the last dance at that wedding a few years from now. The financial advisor might tell you to maximize deposits into tax-deferred annuities, while the doc might work with you to start scheduling “deposits” of physical activity. Just as your financial advisor might tell you to knock off the daily trips to Starbucks, your doc might tell you to knock off the bright screens in your eyes for an hour or two before bed (and, hopefully, would tell you to take it easy on the #PSL).

The next time you have a meeting with employees about their health benefits, ask them what they think of this philosophy. After all, the Hippocratic Oath also says, “I will prevent disease whenever I can, for prevention is preferable to cure.” And more powerfully, “I will remember that I do not treat a fever chart, a cancerous growth, but a sick human being, whose illness may affect the person’s family and economic stability.”  Also remember that as an employer, you have the opportunity to help your employees stay healthy by offering real food at work instead of processed foods, providing a wellness program in a box, or by helping to shape the environment in which your employees live.

Links for Tuesday, October 9, 2018: Overtreatment of subclinical hypothyroidism, altruism and specialty choice, and Roman wiping technology

Treating your TSH level of 10 mIU/L with thyroid hormone probably won’t make you feel better

But your doctor will probably try to talk you into it, anyway (paywall):

“Although current guidelines are at first sight cautious with treatment recommendations, more than 90% of persons with subclinical hypothyroidism and a thyrotropin level of less than 10 mIU/L would actually qualify for treatment. However, results of this meta-analysis are not consistent with these guideline recommendations.”

Are altruistic students more likely to choose lower-paying specialties in medicine?

This paper is complex and paywalled, and I won’t pretend to understand it. But yes, it does seem that altruism is related to choosing lower-paying specialties and more underserved areas:

<$300,000 per year is defined as a lower-paying specialty, which calls my career choices into doubt.

<$300,000 per year is defined as a lower-paying specialty, which calls my career choices into doubt.

How did ancient Romans wipe without toilet paper?

Let’s all share a collective shiver at the thought of a communal, stall-less bathroom with sponges on sticks, shall we?

Follow-up on medical school rank and narcotic prescriptions

I've had several conversations with fellow docs about the NBER paper from last week showing a relationship between medical school rank and narcotic prescriptions. Naturally, the responses I got were pretty skeptical. A recurrent theme I ran across was that the authors didn't pay enough attention to practice setting. 

1. Higher-ranked medical schools tend to produce more students who eventually land in academia, often at higher-ranked medical schools or residency programs.

2. Because of the culture of those high-performing places, characterized by greater access to subspecialists, a slower pace of practice, the presence of trainees to keep you honest and whatnot, you practice more conservatively and without fear of patients firing you for not giving them narcotic prescriptions.

 3. Perhaps people graduating from lesser-ranked schools end up in private practice, where there is more pressure to write a narcotic prescription to all those patients with back pain, just to keep them from 1) firing you, and 2) telling all their friends and family what a crappy, uncaring doctor you are.

4. So the speculated end result is that people graduating from higher-ranked medical schools end up writing fewer narcotic prescriptions than their peers from lower-ranked schools.

I pointed out to several people that the study took into account specialty and location; the relationship held for people in the same specialty and same county. The investigators pontificated on practice setting (noting that DO graduates often take care of a more rural, white population, for instance). But they didn't control for it. So I held my hands up ¯\_(ツ)_/¯ and moved on with my life.

But then I listened to a segment about it on the Weeds podcast today (start at 1:01:25):

UPDATE: I'm having some trouble embedding the audio, so if you can't get it to play, go here: http://bit.ly/2uLk2lY

Sarah, Ezra, and Matthew made note that the relationship held within the same clinic, so I re-visited the paper. I found this: 

Check the footnote. *slaps forehead*

Check the footnote. *slaps forehead*

So the investigators did account for practice setting, but since it was hidden in a footnote, I missed it. 

The take-home from this paper is still kind of hard to identify. I'm not in favor of necessarily checking the LinkedIn page of every doctor you see to check what med school she went to, but there is clearly some kind of relationship between the culture of medical schools and the prescribing behavior of graduates.

The lower-ranked your doctor's medical school, the more likely he'll write you a narcotic prescription

You read that headline right: investigators in an NBER paper found that docs who went to a lower US News-ranked school are more likely to write narcotic prescriptions, and the ones who write narcotic prescriptions are likely to write for more drugs, depending on the ranking of their school. And lordy, those osteopathic schools:

US News publishes several rankings, in topics from research to primary care to women's health. For this paper, the investigators used the "research" ranking, which is difficult to translate into medical student bedside education. After all, some of my best teachers in med school hadn't published a paper in a decade.

Several other take-home points from this. First, at first glance general practitioners write a ton of narcotic prescriptions; their rate on the y-axis is roughly double the overall physician population's. But when you consider that primary care docs perform well over half of all the visits delivered, that number of narc prescriptions looks less impressive.

Second, the effect size, if you're willing to take a leap and go straight to the idea that the quality of research at your medical school somehow has a causative effect on how many hydrocodone prescriptions you write, is huge. Using Harvard as the index school, the schools in the eighties and nineties have graduating docs writing three times as many prescriptions.

My first thought when I read this was that docs who went to lower-ranked schools may end up on places where they're more compelled to write narcotic prescriptions: places with high poverty, or a large blue-collar workforce, for instance. But the investigators accounted for that, and found that the relationship persisted even within the same county:

I can't help but try to apply this research to myself, even though I'm an endocrinologist and therefore mostly shielded from the narcotic game, and even though I see relatively few patients nowadays. But here we go. I attended the University of Kansas, which is comfortably ensconced in a tie at number 65 on the research list:

Oof. Medical school got a lot more expensive in the last couple decades.

Oof. Medical school got a lot more expensive in the last couple decades.

So where would I live in the narc prescribing graph?

Riiiiiiiiight about there. It's a wonder I'm not a bonafide narcotic prescribing machine.&nbsp;

Riiiiiiiiight about there. It's a wonder I'm not a bonafide narcotic prescribing machine. 

What's unsaid in this list is that KU has three campuses (two at the time of my training). And it further goes without saying that the training in Wichita, Salina, or Kansas City may have subtle differences that would lead to slightly different physician performance or behavior. Furthermore, it would be interesting to see the research repeated with residency or fellowship training as the independent variable, since those are the years when trainees really fall into a groove of prescribing habits. If I were held to the standard of my internship with a University of Washington program, I'd be compared to the folks at the skinny end of the graph:

Go dawgs.

Go dawgs.

But if my fellowship training at UNC-Chapel Hill were the standard, I'd be in a nice, comfortable happy medium between the narc-crazed sixties and the narc-stingy pre-teens:

The take-home from this isn't that we should all check our doctors' CVs before we go see them, in fear of them hooking us on oxycodone. It's just that schools who inhabit the lower tiers of medical research need to do a better job of teaching narcotic prescribing. 

And obviously, the take-home for patients is to be very, very careful about requesting narcotics for pain. They don't work as well as we think they do, and the potential for harm is huge. 

I found this link, fwiw, via marginalrevolution.com