Emily Oster

7 min Read Emily Oster

Emily Oster

Diabetes, Kids, and COVID

Emily Oster

7 min Read
In early January, the CDC released, through its MMWR paper series, a report suggesting that kids under 18 who recovered from COVID-19 were at higher risk for developing diabetes. This was, predictably, widely covered in the media and led (for me, at least) to a long thread of panicked emails.

Online, a number of commentators picked at very significant limitations in the study. I agree; the study is extremely flawed. But it’s one thing to say that the study is problematic and another to unpack it and think about what might have been done differently. Which is what I want to do today. The TL;DR is that I do not see any compelling reason that the evidence should make you any more worried about this issue than you were before seeing the study.

I’ll talk it through in a few steps:

  1. What does the study do and say?
  2. What are the inherent problems and data limitations?
  3. What could it have done better?
  4. Why is this in the MMWR? Why did the CDC put it out?

What does the study do and say? 

You can read the MMWR study here. Very broadly, what the authors do is take two sources of medical claims data — this is data that reports diagnoses for individuals, based on insurance records — and explore the relationship between COVID-19 and the subsequent development of any type of diabetes in children.

More specifically: the authors identify patients who were diagnosed with COVID-19 at some point between March 2020 and February 2021. In one data set, this is based only on diagnosis; in the second it is also based on those with a positive COVID test. The authors then create an age-and-sex-matched comparison group of children who did not have a COVID-19 diagnosis during this period.

For the COVID-19 patients, the authors define the “index date” as the first date with a claim for COVID-19 or the first positive test. For the non-COVID patients, they choose a randomly selected claim date as the index date. They then analyze the number of diabetes diagnoses in the two groups in the months after the index date. This is a fairly common empirical approach, and it makes some intuitive sense. Basically, they want to ask whether a diabetes diagnosis is more common after a COVID-19 diagnosis than in another group after a randomly chosen non-COVID medical encounter.

What the authors find when they do this is that there are more diagnoses of diabetes in the month after the COVID-19 diagnosis than in the random following month in the non-COVID group. The overall numbers are small. For example, the authors find in the COVID-19 group an incidence of 316 diabetes diagnoses per 100,000 individuals per year. But the COVID-19 diagnosis group is consistently higher than the matched comparison group. The effects are more consistent for the 12-to-17 age group. And the authors show that this effect doesn’t show up if you look pre-COVID at other respiratory infections. That is, we do not see this effect after a flu diagnosis in 2018.

The diabetes diagnoses in the paper include both Type 1 and Type 2 diabetes, and the authors do not separate them out, so it is not possible to learn which type is driving these results.

The paper concludes that the data shows an increased risk of diabetes after COVID-19 infection for people under 18 and emphasizes the importance of vaccination.

What are the inherent problems and data limitations?

There are (at least) two important problems with this study. By far the most important is that the authors are unable to control for any characteristics of individuals other than age and sex.

To see why this is a problem, consider the issue of body mass index. Children vary in their BMI, and it is well-known that a higher BMI correlates with a greater chance of a Type 2 diabetes diagnosis. In addition, a higher BMI is also correlated with a greater risk of COVID-19 (not necessarily having it, but having a serious enough case for it to be detected). This latter point was made recently by the CDC in another MMWR piece.

What this means is that the population of children who have COVID-19 are more likely to have a higher BMI, and that higher BMI is associated with a greater risk of diabetes diagnosis. Even in the absence of COVID-19, they would be more likely to be diagnosed just given this risk factor.

Essentially, this is a problem of “residual confounding” or “omitted variable bias.” The two groups — the COVID and non-COVID group — are likely different in a number of ways that the authors do not adjust for. BMI is the most obvious, but others include race and socioeconomic status, as well as other conditions. Without this information, it is very difficult to know if COVID-19 is the cause of the higher rates of diabetes or if it is one of the many other differing factors.

There is a second issue, which relates to timing. Even if COVID-19 didn’t cause diabetes, we might see more diagnoses right after a diagnosis of COVID-19 because the sustained interaction with the medical system prompted diagnosis. Some of the checks the authors do make this story perhaps less likely, and I’d overall rank it as less important than the key issue of omitted variables.

The particular issue of not adjusting for BMI or obesity has been raised frequently in response to the paper. The reason the authors do not adjust for differences in this condition in their analysis is that they cannot do so with the data they have. The paper relies on medical claims data, which reports diagnosis codes but doesn’t have the kind of demographic or health data you’d get in (say) an electronic medical record. With data like this, it is simply not possible to adjust for differences in BMI or race or socioeconomic status.

This doesn’t mean they couldn’t have done better, though.

What could they have done better?

What the authors have to work with here is a long “time series” of data on individuals and diagnosis codes. With this, they could do better than they did.

One improvement to the paper would be to separate out Type 1 and Type 2 diagnoses. These have different diagnosis codes, so it is possible to look at them separately. I am not sure why that wasn’t done.

A second improvement would be to adjust for pre-diabetes. Often, with Type 2 diabetes, individuals are diagnosed with “pre-diabetes” prior to diabetes diagnosis. It’s a diagnosis that comes with some behavior-change advice and perhaps additional monitoring. There is a diagnosis code for pre-diabetes, and the authors could have used that to look at differences across groups, or as a control.

A more involved but more useful improvement would have been to use more of the time variation in the data to, effectively, look for pre-trends. To see how this works, let’s go back to the basics of their approach. The authors have a COVID-19 group and a comparison group, and they compare diabetes diagnosis rates in the month after COVID-19. If they were to put their results on a graph, it would be like this:

But the reality is that they have data from the earlier and later periods that they are not using. It would be possible to, for these same people, look at diagnosis rates earlier and later.1 Why would this be helpful? Let’s think about the graph below, where I’ve added two sets of lines, both of which would be consistent with the data in the paper.

The solid lines — light blue versus dark blue — reflect what looks like a real effect of COVID-19 on diagnosis. Most importantly, the diagnosis rates in the earlier period are similar, and it is only post-COVID that the rates go up. The dotted lines, though, would also be consistent with the numbers in the paper, but they tell a totally different story. They would tell a story of two groups with different underlying risks but where COVID seemed to play little role.

I do not know which graph would show up if the authors had done this. It wouldn’t be hard to do. My strong suspicion is it would look more like the dotted lines than the solid ones. But that is just my instinct. My point isn’t that we can prove that the results are biased in this way; it is, instead, that the paper could have been done better.

In the end, that is my strongest feeling in reading it. This paper is about a possibly important question, and in principle the data seems like it could be informative (up to a point). But the paper isn’t well-done. It’s missing very basic analysis, like separating out Type 1 and Type 2 diabetes. Graphing diagnoses over time isn’t a magical approach I made up for this newsletter; it’s standard for an event. The idea of using other suggestive diagnoses like pre-diabetes for controls is straightforward. There are a tremendous number of fillable holes.

The holes ultimately add up to the point where the paper isn’t informative. Could it be that there is an effect? There could, just like there could have been before you saw the article. But I would say I’m no more convinced of an effect after reading the paper than before, which isn’t a great commentary.

Why is this in MMWR?

I suspect the question has occurred to many of you in reading this: Why is it in MMWR? The outlet has gotten a huge amount of attention during the pandemic, and this particular article was widely covered in major media outlets. I’m far from the only person to notice its glaring weaknesses.

Why weren’t these issues caught in peer review? The goal of peer review, in an ideal world, is to identify basic weaknesses and ask the authors to fix them. The main answer is that MMWR isn’t peer-reviewed, at least not in the traditional sense. Papers undergo a 14-step review process that takes months, but the review is all internal to the CDC. In my experience from publishing there, much of this review focuses on format and phrasing and not on the content of the analysis.

MMWR publications are also an opportunity to put scientific weight behind public health messaging. In this case, the paper ends with a strong push for vaccination for children, a message that the CDC has been trying to send in many ways. I am also strongly supportive of vaccination for children, but there are much better ways to convince people (like this chart about vaccination and hospitalization in New York State).

It’s actually not helpful to try to convince people to vaccinate their kids with poor quality evidence of this type. It gives those who oppose vaccines something legitimate to complain about, and terrifies at least some parents whose kids are not vaccine eligible yet.

I am not sure why this paper was selected for MMWR or what type of review it went through. What I can say is that the paper is deeply flawed, and if you are worrying about it, you should stop.

Community Guidelines
Covid-19 rapid antigen tests arranged in a pattern on a yellow background.

Feb 20 2023

12 min read

COVID-19: Where to Go from Here

A long-term view of the virus

Emily Oster
Covid-19 rapid antigen tests arranged in a pattern on a yellow background.

Oct 20 2022

9 min read

Should You Get the Bivalent Booster?

The latest on the risks and benefits of COVID vaccines boosters for older adults, pregnant people, and kids

Emily Oster
A line graph with pink, yellow, and blue dots representing life's ups and downs.

Aug 16 2022

3 min read

Wins, Woes, and Doing It Again

We have our first story from a dad! And it’s a good one. 10/10 —Girl Dad with Confidence Growing by Read more

Emily Oster
Covid-19 rapid antigen tests arranged in a pattern on a yellow background.

Aug 15 2022

8 min read

Updated CDC Guidelines for School and Child Care

NO QUARANTINES!!!

Emily Oster

Instagram

left right
Do men really get worse colds? Not really, but they definitely think so! 

#mancold #perceptionvsreality #sickday #staystrong #emilyoster

Do men really get worse colds? Not really, but they definitely think so!

#mancold #perceptionvsreality #sickday #staystrong #emilyoster
...

💧 Is your kid drinking bathwater? Here’s the 411: It’s gross but not dangerous! Comment “Link” for my full guide to bathtime.

 A little soap or mold from toys isn’t harmful, and diluted pee is no big deal. Eating a lot of poop can make you sick, but in small amounts, it isn’t toxic.

Bottom line: Bathwater isn’t your kid’s best drink option, but don’t stress too much! Just keep an eye on them during bathtime for safety. 

#kidsbathtime #bathtoys #bathtimefuntime #emilyoster #parentdata

💧 Is your kid drinking bathwater? Here’s the 411: It’s gross but not dangerous! Comment “Link” for my full guide to bathtime.

A little soap or mold from toys isn’t harmful, and diluted pee is no big deal. Eating a lot of poop can make you sick, but in small amounts, it isn’t toxic.

Bottom line: Bathwater isn’t your kid’s best drink option, but don’t stress too much! Just keep an eye on them during bathtime for safety.

#kidsbathtime #bathtoys #bathtimefuntime #emilyoster #parentdata
...

Why is it that schools always call mom, even when dad’s the one with more availability? Comment “Link” to dive into the data on inequality in parental workloads.

A study shows just how deep the gender divide runs when it comes to household labor—even in something as simple as a phone call. Does this ring true for you? Share your experience in the comments 👇

#gendergap #momstruggles #parentsupport #emilyoster #parentdata

Why is it that schools always call mom, even when dad’s the one with more availability? Comment “Link” to dive into the data on inequality in parental workloads.

A study shows just how deep the gender divide runs when it comes to household labor—even in something as simple as a phone call. Does this ring true for you? Share your experience in the comments 👇

#gendergap #momstruggles #parentsupport #emilyoster #parentdata
...

Is your child getting enough sleep? 💤 Kids need 9-11 hours of rest for better focus, behavior, and health. Comment “Link” for an article on the importance of sleep and how to help your kids get more of it. It’s time to make sleep a priority!

#childsleep #childhooddevelopment #parentingtips #emilyoster #parentdata

Is your child getting enough sleep? 💤 Kids need 9-11 hours of rest for better focus, behavior, and health. Comment “Link” for an article on the importance of sleep and how to help your kids get more of it. It’s time to make sleep a priority!

#childsleep #childhooddevelopment #parentingtips #emilyoster #parentdata
...

Here’s my rant on motherhood inspired by the Barbie movie. Motherhood is hard enough without the unsolicited expectations we’re constantly assigned. As I always say, there is no secret option c. You’re doing great, and I hope you know that! 

Share this with a mom you think is doing great!

#parentdata #emilyoster #motherhood #barbiemovie

Here’s my rant on motherhood inspired by the Barbie movie. Motherhood is hard enough without the unsolicited expectations we’re constantly assigned. As I always say, there is no secret option c. You’re doing great, and I hope you know that!

Share this with a mom you think is doing great!

#parentdata #emilyoster #motherhood #barbiemovie
...

Ever seen a headline that makes your heart race, but when you dig deeper, the study behind it doesn’t hold up? That’s a panic headline! It’s designed to grab attention and spark fear, but the research it’s based on is often weak or irrelevant. Next time you see one, take a breath, look closer, and don’t let sensationalism get you stressed out.

What’s the most recent panic headline you’ve seen? Drop it in the comments and let’s break it down together! ⬇️

#parentdata #emilyoster #panicheadline #datadriven #riskmanagement #parentingstruggles

Ever seen a headline that makes your heart race, but when you dig deeper, the study behind it doesn’t hold up? That’s a panic headline! It’s designed to grab attention and spark fear, but the research it’s based on is often weak or irrelevant. Next time you see one, take a breath, look closer, and don’t let sensationalism get you stressed out.

What’s the most recent panic headline you’ve seen? Drop it in the comments and let’s break it down together! ⬇️

#parentdata #emilyoster #panicheadline #datadriven #riskmanagement #parentingstruggles
...

Is constant phone access impacting your child’s development? 📵 Today on the ParentData podcast, listen to @profemilyoster and @jonathanhaidt discuss the impact of phones and social media on learning and child mental health.

Listen to this episode now and subscribe to ParentData with Emily Oster in your favorite podcast app 🎧

#parentdata #parentdatapodcast #theanxiousgeneration #kidsmentalhealth #screentime #jonathanhaidt #emilyoster

Is constant phone access impacting your child’s development? 📵 Today on the ParentData podcast, listen to @profemilyoster and @jonathanhaidt discuss the impact of phones and social media on learning and child mental health.

Listen to this episode now and subscribe to ParentData with Emily Oster in your favorite podcast app 🎧

#parentdata #parentdatapodcast #theanxiousgeneration #kidsmentalhealth #screentime #jonathanhaidt #emilyoster
...

Here’s your Monday reminder for the start of the school year: You’re doing a great job, rice bunnies or not!

This is a sneak peek from the Saturday newsletter on ParentData. Want more parenting tips and insights? Subscribe now at the link in bio.

#parentdata #emilyoster #parentingadvice #parentingtips #parentingquotes #parentingishard

Here’s your Monday reminder for the start of the school year: You’re doing a great job, rice bunnies or not!

This is a sneak peek from the Saturday newsletter on ParentData. Want more parenting tips and insights? Subscribe now at the link in bio.

#parentdata #emilyoster #parentingadvice #parentingtips #parentingquotes #parentingishard
...

Reflux: It’s more common than you think! Comment “Link” for an article by @thepediatricianmom breaking down the information we have about reflux — what it is, what you can do, and red flags to look out for.

This graph shows how reflux changes with age. Nearly half of all babies experience reflux by 3 months, often peaking around 4 months before improving by their first birthday. And remember, if you’re struggling, you’re not alone. The most effective treatment for infant reflux is time. It will get better!

#parentdata #refluxbaby #babyreflux #spitup #parentingadvice #emilyoster

Reflux: It’s more common than you think! Comment “Link” for an article by @thepediatricianmom breaking down the information we have about reflux — what it is, what you can do, and red flags to look out for.

This graph shows how reflux changes with age. Nearly half of all babies experience reflux by 3 months, often peaking around 4 months before improving by their first birthday. And remember, if you’re struggling, you’re not alone. The most effective treatment for infant reflux is time. It will get better!

#parentdata #refluxbaby #babyreflux #spitup #parentingadvice #emilyoster
...

We’re heading into a three-day weekend, which means a lot of you might take the opportunity to do some potty training. 

Here are some things to keep in mind:
🚽 It takes longer than three days (based on the data!)
🚽 Your child will have trouble staying dry at night.
🚽 Poop sometimes comes later than pee – this is common, you just have to work through it.

Comment “Link” for an article that breaks down potty training data from ParentData readers,  along with helpful tips and tricks.

#pottytraining #pottytrainingtips #pottytrainingproblems #parentdata #emilyoster

We’re heading into a three-day weekend, which means a lot of you might take the opportunity to do some potty training.

Here are some things to keep in mind:
🚽 It takes longer than three days (based on the data!)
🚽 Your child will have trouble staying dry at night.
🚽 Poop sometimes comes later than pee – this is common, you just have to work through it.

Comment “Link” for an article that breaks down potty training data from ParentData readers, along with helpful tips and tricks.

#pottytraining #pottytrainingtips #pottytrainingproblems #parentdata #emilyoster
...

Trampoline parks: great way to get the sillies out or injury haven? Or both? Comment “Link” for an article breaking down a 2023 study on injury trends in trampoline parks.

Here’s a visualisation based on the paper, showing the injury rate by area. Beware the foam pit and the high-performance areas! Slam-dunking, though, seems fine.

#parentdata #emilyoster #trampolinepark #childsafety #trampolinefun

Trampoline parks: great way to get the sillies out or injury haven? Or both? Comment “Link” for an article breaking down a 2023 study on injury trends in trampoline parks.

Here’s a visualisation based on the paper, showing the injury rate by area. Beware the foam pit and the high-performance areas! Slam-dunking, though, seems fine.

#parentdata #emilyoster #trampolinepark #childsafety #trampolinefun
...

I’m teaming up with @Wholefoods to remind you that even though school lunches can be tricky, they have everything you need, from conventional to organic, to give you peace of mind about the foods your kids eat. Through their rigorous Quality Standards, they ban 300+ ingredients from food. 

Does your kid have any special or weird lunch requests? Share in the comments! Tap the link in my bio for more tips and inspiration #WholeFoodsMarket

I’m teaming up with @Wholefoods to remind you that even though school lunches can be tricky, they have everything you need, from conventional to organic, to give you peace of mind about the foods your kids eat. Through their rigorous Quality Standards, they ban 300+ ingredients from food.

Does your kid have any special or weird lunch requests? Share in the comments! Tap the link in my bio for more tips and inspiration #WholeFoodsMarket
...

Travel is already stressful. Add kids to the equation, and it becomes even more complicated. Here are 3 tips and considerations for handling jet lag in kids.

#travelwithkids #jetlag #melatonin #parentingtips #parentdata #emilyoster

Travel is already stressful. Add kids to the equation, and it becomes even more complicated. Here are 3 tips and considerations for handling jet lag in kids.

#travelwithkids #jetlag #melatonin #parentingtips #parentdata #emilyoster
...

Happy 11th birthday to #ExpectingBetter 🎂🎉 Writing this book completely changed my life. I could never have imagined the opportunities and community it would lead me to. Grateful to all of you for reading and being here!

To celebrate, you can use the code “expectingbetter” for 15% off Web or Plus subscriptions on ParentData.org 💛

#bookbirthday #pregnancyadvice #parentdata #emilyoster

Happy 11th birthday to #ExpectingBetter 🎂🎉 Writing this book completely changed my life. I could never have imagined the opportunities and community it would lead me to. Grateful to all of you for reading and being here!

To celebrate, you can use the code “expectingbetter” for 15% off Web or Plus subscriptions on ParentData.org 💛

#bookbirthday #pregnancyadvice #parentdata #emilyoster
...

Screens have become a ubiquitous part of classroom life. Is this a good thing? Today on the ParentData podcast, I talk with @jessgrosewrites from the @nytimes. She recently ran a survey asking about kids’ screen usage after not being able to find studies and data on the subject.

“Nothing is all bad or all good. But I think overall, there just has been very little scrutiny into something that has been a massive shift in the way kids learn in the past, let’s say, two decades.”

Comment “Link” for a DM to listen to today’s podcast episode. 🎧

#screentime #technologyintheclassroom #parentdatapodcast #parentdata #emilyoster

Screens have become a ubiquitous part of classroom life. Is this a good thing? Today on the ParentData podcast, I talk with @jessgrosewrites from the @nytimes. She recently ran a survey asking about kids’ screen usage after not being able to find studies and data on the subject.

“Nothing is all bad or all good. But I think overall, there just has been very little scrutiny into something that has been a massive shift in the way kids learn in the past, let’s say, two decades.”

Comment “Link” for a DM to listen to today’s podcast episode. 🎧

#screentime #technologyintheclassroom #parentdatapodcast #parentdata #emilyoster
...

We surveyed the ParentData audience and here’s what you said about the worst baby products. Bottom of the list: unnecessary warmers. Don’t get your kid used to having warm diaper wipes! Nothing good can come of that.

Comment “Link” for the best baby items and other parenting wisdom from the ParentData community. Best general advice: get things used, and you do not need as much as you think. 

Add your advice below! What do you wish you’d known about in advance, and what was a waste? ⬇️

#parentdata #emilyoster #babyproducts #babyitems #newparents #firsttimeparents

We surveyed the ParentData audience and here’s what you said about the worst baby products. Bottom of the list: unnecessary warmers. Don’t get your kid used to having warm diaper wipes! Nothing good can come of that.

Comment “Link” for the best baby items and other parenting wisdom from the ParentData community. Best general advice: get things used, and you do not need as much as you think.

Add your advice below! What do you wish you’d known about in advance, and what was a waste? ⬇️

#parentdata #emilyoster #babyproducts #babyitems #newparents #firsttimeparents
...