Thursday, October 08, 2009

Is It More Like 1.2% to 1.5%?

Over two years ago I wrote a post titled Moving Toward a New Consensus Prevalence of 1% or Higher. At the time the prevalence of ASD was generally considered to be 0.6%. If you Google it, you'll find this figure is still the one that's cited most frequently. At present, no one has come out and precisely said the consensus prevalence has been revised to 1%, but I think that's pretty much where we're at. Consider what Roy Richard Grinker said recently to Time Magazine.
"It provides what scientists call convergent validity: no matter how you shake the bushes, you come up with this 1%," says Richard Roy Grinker, an autism researcher at George Washington University who has worked to determine ASD prevalence in South Korea.
(source)

Two years ago, and even long before this – as suggested by Lorna Wing – there were already some indications in the literature that 1% might be a more accurate figure. It was not a lucky guess or anything like that. My concern, which came to pass, was that as study methodologies evolved and awareness improved, the public would be frightened by what might appear to be a real increase in the prevalence of autism, with no end in sight. Ms. Clark (you remember her, right?) speculated that the process might be very gradual, with people getting increasingly surprised, and finally collapsing from exhaustion. It turned out to be a little more quick and relatively painless, at least so far.

I believe the question at this point is whether we've reached a plateau. Is prevalence going to stabilize at 1%? Have identification methods been pushed to their limits? Is the level of awareness (important in phone surveys and passive systems) the highest it's ever going to be?

I think that's possible, provided the same criteria and diagnostic tools continue to be used. But I gotta tell you, I have some reasons to believe we haven't seen the end of this just yet – not very many reasons, admittedly, but some. We might find that a more accurate number for prevalence is a little bit higher, perhaps 1.2%, or even 1.5%.

I'm not going to discuss cultural trends or the inherent subjectivity of psychiatric diagnoses, simply because this would be difficult, if not impossible, to quantify. But I do want to discuss case finding in this post.

What brings this about is the recent NHS prevalence study of autism among UK adults. The study has already been discussed by Anthony Cox, Kev Leitch, Sullivan, Catherina, and others. It found that 1% of adults living in private households had ASD. This result should come as no surprise to regular readers of this blog, particularly those who have read High Prevalence of Autism in Adults.

The NHS study did not look for autistic adults living in "communal establishments" (institutions.) According to the NAS, the report is "the first part of a much more detailed research project" (source) so I have little doubt there will be a follow-up that looks for adults in institutions. What will happen then? The NHS report says that 2% of all adults live in communal establishments. I believe pooled prevalence from both studies might turn out to be around 1.3%. It will easily be 1.2%.

Of course, there's some room for statistical uncertainty in these figures, and we'll have to wait for replications that use roughly the same methodology to see how the figures converge. But taking them at face value, 1.2% or 1.3% are a little higher than might be expected. Shouldn't the prevalence among children in the UK be even higher than this? Presumably, diagnostic stability to adulthood is not 100%, and autistics might have a slightly lower life expectancy than normal.

It's important to understand that the NHS study is not only the first of its kind, but also one with a methodology that is both novel and innovative. The methodology is designed so that the prevalence of ASD can be estimated even if the screening tools available to the researchers are unreliable and not well researched. The method does not require knowing how a screening tool performs a priori. It's preferable that the tools perform well – it helps with statistical power – but this is not a requirement per se.

I realize most people can't seem to make heads or tails of the methodology of the NHS study. I've tried to explain it with examples (e.g. here). You have my assurance that it's probabilistically sound. This can be proven mathematically.

That's not to say the methodology doesn't have any problems. Like any new methodology, it will be scrutinized in the scientific literature. Potential issues will be identified. Guidelines on how the selection probabilities should be defined will be proposed, etc. This is generally acknowledged by the authors:
The present methods are therefore felt by the authors to be to the highest standard achievable at present. However this is a first methodological development of its kind in the autism field and it is to be hoped that future surveys could build and improve on the present procedures.

Don't be surprised, though, if this methodology becomes a sort of standard that is subsequently used in studies of children, and not just those dealing with autism prevalence. Don't be surprised either if this in turn results in slightly higher prevalence figures.

The methodology of the NHS study is such that it doesn't leave any autistics behind, so to speak. It produces only an estimate, but it's an estimate that includes all autistics in principle (if we discount participation refusal biases.) A study that relies on a conventional screening process, on the other hand, can easily leave out autistics who did not pass the screening.

It's not easy to know a priori how many autistics a screening tool might miss. Suppose you evaluate 1000 random persons with a reliable diagnostic instrument and also a screening tool you want to test. You might identify 10 autistic people by means of this undoubtedly expensive endeavor. Suppose 5 of them also passed the screening. Can you assume 50% of autistics are missed by the screening tool? Not really. With statistical confidence, you can only say that anywhere from 20% to 80% would pass a screening.

Sure, you could test a much larger group of previously identified autistics. But how do you know this group is representative of all the autistics you intend to identify in a subset of the general population? This is clearly a limitation of pre-NHS methodology.

In the old days, they didn't even take into account the likely unreliability of screening methods. In Lotter (1966), for example, they just provided a questionnaire for teachers to fill out and only considered children reported as having "certain types of behavior." At various other levels of screening, it was always assumed the screening was perfect.

This brings me to a relatively recent study, Kadesjö et al (1999). It reported the prevalence of ASD was 1.21% in the small Swedish town of Karlstad. All children involved were born in 1985. What's interesting about this study is its intensity. The primary author personally evaluated 50% of 818 children attending normal classrooms. Unfortunately, it was a small study. They found 10 autistic children out of 826. If they had only found 9 autistic children, prevalence would be 1.1%. If they had found 11 children, prevalence would be 1.3%. I can't help but wonder, though, what might have happened if 100% of the children had been evaluated. Is it possible that at least one more autistic child would be found among the remaining 409 children who were not assessed for autism past the initial screening?

To summarize, diagnostic criteria and diagnostic methods are not the only thing that matter in a prevalence study. Case finding is also crucial, but now the NHS has introduced a methodology that could make case finding practically a non-issue.

8 comments:

  1. Well to quote a rather well worn cliche of mine which applies to you as well as those who reckon they are oh so clever with there demographics.

    "What would you know"

    You set the limits of a set, and you can only measure what fits within those limits, but what if the limits are wrong?

    I am utterly convinced that they are.

    ReplyDelete
  2. Whether the limits are wrong is slightly off-topic. Well, if they are, the figures need to be thrown out, and we need to start over.

    ReplyDelete
  3. What is the actual prevelance? If you believe Robert Plomin the prevelamce is between 5% and 10% with a mean of 7.5%.

    Plomin's group has been testing a large sample of twins and reported that 5% of the sample of thousands of twin pairs possessed 'extreme autistic traits' and around 10% of the entire sample possessed at least one of the triad of autistic-like traits (social, communicative or repetative impirments) and they were on a level of severity found in their sample of twins meeting dignosic criteria for an ASD.

    'Autism' and its definition, especially by the English (Lorna Wing and Simon-Baron Cohen were particpants in the English study) has changed from a developmental disorder to a collection of normal personality traits and communicative styles redefined as 'autism'.

    If you believe that autism traits is a collection of normal variants then you have to accept Plomin's estimate of between 5% and 10% of the general population.

    This is where we are headed, so your estimates are far below what Plomin's estimates are.

    The problem is that as autism is redefined as a human trait, what is being missed is that autism is a profound developmental disorder, not a personality trait condition.

    ReplyDelete
  4. @RAJ: Of course, you've never indicated how you think autism should be defined. I think you've said Kanner criteria is superior, but you haven't been able to argue why it is superior, with actual data (i.e. why it is more useful in practice, how this definition would be more helpful to people, how it is less subjective, reasons why it correlates better with something in nature, etc.)

    About Plomin's work, what's the specific citation? Either way, is there any reason to believe the group of twins is representative of the general population?

    ReplyDelete
  5. Na moral o Blog, maneiro essa parada!!!
    Gostei, um abraço!

    ReplyDelete
  6. This comment has been removed by a blog administrator.

    ReplyDelete
  7. SpiritualHealer/fluhealer's comment is removed because it's spam. The same comment is posted to multiple blogs.

    ReplyDelete
  8. Southeast and main Asian pandora jewelry countries have twisted rubies for centuries, cheap pandora bracelets but research as to where, and how to find more deposits is Pandora charms spare, and production has figured out how and mining companies,” Pandora beads Giuliani says, to look at exactly the right time and place.” pandora set Farther investigation of claret formation, based on tectonic scenery, cheap pandora geochemistry, fluid inclusions and isotopic ratios, allowed discount pandora Giuliani’s lineup to remodel a new prototype for the French Institute pandora 2010 of Research for Development (IRD) and the National Scientific pandora sale Center of Research, two government-sponsored knowledge Pandora Bangles and technology research institutes that aim to aid in the sustainable cheap pandora bracelets development of developing countries. Before the collision pandora bracelets prices of the Eurasian and Indian plates, lagoons or deltas sat in the regions where marble is giant, pandora bracelets and charms he says, “and there is the brains to expect that the new pandora bracelets sale thoughts should help development of the artless capital.” discount pandora bracelets Virginie Garnier, Gaston Giuliani and Daniel Pandora necklace Ohnenstetter urban the shape to do just that. They work for the garnet cheap pandora charms genesis. While studying the bedrock in Vietnam in 1998, the discount pandora charms French players found rubies, which detained traces of aluminum, chromium pandora charms sale and vanadium from universities, international corporations, governments pandora charms 2010 and why the rubies got there, and has created a paradigm Pandora beads to help these evaporites, Garnier says, when the Eurasian cheap pandora beads and Indian plates collided, raising the Himalaya Mountains.

    ReplyDelete