Austin controversies Coronavirus

Modeling panic in Austin

September 1, 2020

We do not have the data science skills to answer a question that troubles us, to wit the extent to which epidemiological models have over-estimated risk of Covid-19 and thereby influenced suppressionist responses from politicians. We can, however, peek at a couple of proximate examples and ask a few questions.

In Austin, the celebrated University of Texas epidemiologists have effectively driven the local policy response to the pandemic, because what politician in this town can say “I don’t believe everything UT scientists say?” Not gonna happen, no way, no how. We do not always, or even frequently, agree with Austin’s Mayor Steve Adler, but our unqualified commitment to intellectual honesty compels us to feel his pain. In this “we believe science and definitely Hook ’em” town, Adler’s got to do what the UT epidemiologists recommend whether or not he privately worries that they might be wrong.

The main page for the UT projections is here. Anybody can scroll around and look at current projections for cases, hospitalizations, and deaths from Covid-19 over time. There also seems to be the archived data necessary to see past projections, but that requires the aforementioned data science skills we do not have in our otherwise vast armamentarium.

We do, however, have a few examples of historical predictions that make us worry that the UT disease forecasters have pushed Mayor Adler and Texas Governor Abbott toward pandemic response policies that were and are more restrictive than necessary or healthy.

On March 24 the team at UT presented this report to the Austin City Council and other learned local officials. On page four one finds a summary of the forecast for the key metrics we were all worried about in late March lined up with the policy response:

The “Austin-Round Rock MCA” includes Travis, Williamson, Hays, Caldwell, and Bastrop counties in central Texas. As of August 17, the aggregate deaths attributed to Covid-19 in those counties over five months was 581 (link) out of a population of roughly 2.2 million (for those of you keeping track at home, that is roughly 9 days of all-cause deaths for a typical US population of 2.2 million). Given that the death estimates in the bottom row of the table above are median projections at various levels of social distancing since March 23, one might conclude that the five counties in question have done a rather extraordinary job of social distancing, having reduced aggregate human interaction by between 75% and 90%.

Then again, one might be an idiot.

We do not believe that outside of a few highly compliant affluent neighborhoods in Austin itself the regional population has reduced its interaction by anything close to 75%, much less 90%, in the last five months. Any late-spring tour of Williamson County (“Wilco” is the second largest in the metro area with more than 500,000 residents) revealed virtually no mask game until the mandate and very little regard for the hazards of the disease or the case counts over which the media obsess. This is not just our impression, but the observation of our astute scientist daughter, who lives in Wilco and has been known to vent to her father on the topic.

Then there is Austin proper. Beginning in late May and for weeks thereafter, Austin hosted massive public demonstrations, which were masked up but not much distanced and naturally flowed in to the reopened bars. Grabbing a few beers after screaming at cops in 95 degrees is, actually, completely understandable and predictable. We were there. We saw no end of cute young people with neo-Marxist signs and colorful hair packing in to our favorite craft breweries after (actually) mostly peaceful demonstrations.

And never mind the insouciant youth in the parks. Egads.

Yet we are to believe that Austin and its environs have been 75-90% socially distant?

Not a chance on God’s green earth.

Now, you might say we should cut the UT team a break, insofar as nobody knew much about SARS-CoV-2 in the third week of March. Fair enough. So how has the UT team done more recently?

On August 10, we captured UT’s death projections for the State of Texas on August 31.

As of August 10, the UT epidemiologists projected that 23,460 Texans will have died from Covid-19 by August 31, within a range of 20,665 to 26,726.

Oops.

To be completely fair, the actual August 31 number will probably rise by 100-200 as the death certificates for the last few days trickle in, but UT still will have overshot its three week forecast for Texas by 80%.

What about more recently? We also grabbed an August 18 screenshot.

Once the UT team got within a two week window, they did hit the forecast range. Giving them full credit for late death certificates they hoisted their chin above “Min Projected” 12,602 deaths. We cannot resist noting, however, that the UT scientists gave themselves a massive 64% difference between that the high end of their range (20,672) and the low end (12,602) a mere 13 days out. Plenty of us dashboard doomscrollers could have hit the side of that barn without all that UT computing power.

Believe science, indeed.

Now, notwithstanding the fun we have had with this post, the serious point is not to castigate these epidemiologists or epidemiologists in general. No doubt they are working hard to improve their forecasts, and indeed they are contributing importantly to the policy debate. However, the demands from the media and the political left to “believe science” ought not actually mean “believe models.” Because many models, including the models much relied upon to inform pandemic response policies, are wildly wrong even when developed by the actual best people.

Models of anything, unleavened with judgment forged in honest and open debate, are not “science” at all. Unfortunately, we have of late had very little honest and open debate, and that is a huge problem.

You Might Also Like

10 Comments

  • Reply Willy September 1, 2020 at 12:16 pm

    I think scientists are under tremendous pressure to meet the demands of politicians. You’ll find similar “anomalies” in the climate change models as well. Look at the Michigan State professors who were forced to retract their study about police bias in shootings. Science is under assault from the people that condescendingly implore us to “believe science.”

  • Reply Jim Dahmus September 1, 2020 at 12:29 pm

    The deaths reported are probably much higher than the deaths actually caused by Covid. So the error % in the model is even worse than the article suggests

  • Reply Alan September 1, 2020 at 12:36 pm

    The scientific method: (1) propose a hypothesis, (2) test it, (3) draw conclusions.

    Modeling is step 1. It’s not science until the process is complete.

  • Reply George_Banner September 1, 2020 at 1:56 pm

    In the search for answers we often fail to recognize the most simple and obvious one: the evil nature of the individuals involved and their will to do harm to others.
    There is no pandemic.
    There are, though, a considerable number of leftoxenomorphs willing to do ANYTHING to destroy Western civilization and America in particular to, they imagine, rule over the dystopian remains.
    THAT is what we are witnessing.
    This is an attack against reason and decency by a bunch of cultural marxists running amok because they can.
    And bullshitsectionality is sacred because shut up.
    And men are “toxic” because vagina.
    And America is racist because BLM says so.
    And pisslims are sacred because they hate us.
    And pedophiles should babysit your children because “what would be so wrong with that”?
    And a woman can “marry” her pet or a plant or herself because everything is a “social construct” and anything goes and 2 + 2 = whatever.

  • Reply J Allen September 1, 2020 at 1:59 pm

    Sadly, the Horns in the field are no better than the Horns on the field. Ugh,

  • Reply P A September 1, 2020 at 2:31 pm

    Science is grrant – driven.

    Grants are awarded by bureaucrats.

    Who award funding limits set by politicians.

    Who respond to the demands of their constituents. Especially the donor constituents.

  • Reply mikee September 1, 2020 at 3:23 pm

    “We do not always, or even frequently, agree with Austin’s Mayor Steve Adler, but our unqualified commitment to intellectual honesty compels us to feel his pain.”

    Mayor Steve Adler’s primary source of pain is from having his head so far up his colon that he can peek out his belly button. He isn’t called “Asshat Adler” because of his chapeau choices, but rather because he keeps his ears from hearing, his eyes from seeing, his nose from smelling, with his head up his ass. Tell him the homeless are a problem because of his camping ordinance and he’ll spout off about doubling the budget to promote homelessness in Austin by $30,000,000, rather than agreeing. He truly is an Asshat.

    • Reply Editor September 1, 2020 at 4:13 pm

      Uh, solid point.

  • Reply NHL September 1, 2020 at 4:34 pm

    Modeling under uncertainty is hard. It’s one thing to predict the next 4 quarters of revenues and earnings of a mature industrial company. There’s lots of history, and the volatility of the inputs to the model are low. Modeling the spread of the virus (and hospitalizations and deaths) involves variables where the assumptions could be off by an order of magnitude, which is of course much more challenging. I think it’s fine to say, in the first case, that results will be in a narrow range, and in the second case, qualify it by saying that it is a WAG (wild-assed guess). So if the WAG disclosure was not made, that is indeed an oversight.

    • Reply Editor September 1, 2020 at 5:24 pm

      I agree in general, but there is a lot less uncertainty now than in March.

    Leave a Reply