AnnexesAmerican Journal of Epidemiology Advance Access published November 14, 2006192American Journal of EpidemiologyCopyright ª 2006 by the Johns Hopkins Bloomberg School of Public HealthAll rights reserved; printed in U.S.A.DOI: 10.1093/aje/kwk017Practice of EpidemiologySensitivity of Four Psychometric Tests to Measure Cognitive Changes in BrainAging-Population–based StudiesCéci<strong>le</strong> Proust-Lima 1,2 ,Hélène Amieva 2,3 , Jean-Francxois Dartigues 2,3 , and Hélène Jacqmin-Gadda 1,21 INSERM E0338, Bordeaux, France.2 Université Victor Sega<strong>le</strong>n Bordeaux 2, Bordeaux, France.3 INSERM U593, Bordeaux, France.Received for publication April 11, 2006; accepted for publication July 5, 2006.Choosing the measure of cognition in an epidemiologic study investigating cognitive changes over time isa chal<strong>le</strong>nging question. A powerful measure must be ab<strong>le</strong> to detect small cognitive changes in all the range ofcognition observed in the target population. This work aims at comparing the sensitivity to detect cognitive changesin the observed range of cognition of four widely used psychometric tests in an aging-population–based studythrough a nonlinear latent process model, assuming that the psychometric tests are nonlinear noisy transformationsof their common factor. With data from the French prospective cohort study PAQUID (1989–2001), the authorsfound that the Mini-Mental State Examination and the Benton Visual Retention Test exhibited a better sensitivity tocognitive changes in low <strong>le</strong>vels of cognition, whi<strong>le</strong> the Digit Symbol Substitution Test was more sensitive tochanges in high <strong>le</strong>vels of cognition. In contrast, the Isaacs Set Test shortened at 15 seconds appeared to besensitive to small changes in all the range of cognition and, thus, represents an appropriate measure of cognition inpopulation-based studies including both highly normal and severely impaired subjects.aging; cognition; dementia; epidemiologic methods; neuropsychological testsAbbreviations: BVRT, Benton Visual Retention Test; DSST, Digit Symbol Substitution Test; IQR, interquarti<strong>le</strong> range;IST15, Isaacs Set Test shortened at 15 seconds; MMSE, Mini-Mental State Examination.With the increasing number of peop<strong>le</strong> suffering fromneurodegenerative diseases, especially Alzheimer’s disease,investigating cognitive changes over time has receivedgrowing attention in population-based cohort studies for understandingthe natural history of the neurodegenerative diseasesand in intervention trials designed to assess the effectsof drugs on neuropsychological functioning (1, 2). In thesestudies, cognition is generally assessed through a battery ofpsychometric tests repeatedly administered to the subjects.Col<strong>le</strong>cting several cognitive tests may be useful, because thisallows exploration of the various cognitive domains (memoryfunctioning, attention, or executive functions) and becausethe tests often have different metrologic properties. Inparticular, some tests are very sensitive to small changes athigh <strong>le</strong>vels of cognition, whi<strong>le</strong> others are more sensitive tochanges at the lower <strong>le</strong>vels. As a consequence, when studyingthe effects of drugs or the aging process on cognition,results may differ considerably according to the properties ofthe test being used (3). A way to deal with this prob<strong>le</strong>m is tostudy the change over time of the common latent cognitive<strong>le</strong>vel underlying the battery of cognitive tests used (4).However, administering an extensive battery of neuropsychologicaltests can turn out to be difficult, because of theduration (and thus cost) of the evaluation and also becausesubjects presenting cognitive impairment are more prone torefuse long testing sessions than cognitively intact elderlysubjects (5). In this way, it would be of substantial interestto compare the properties of commonly used cognitive testsCorrespondence to Céci<strong>le</strong> Proust-Lima, INSERM E0338, Institut de Santé Publique, d’Epidémiologie et de Développement, Université deBordeaux 2, 146 rue Léo Saignat, 33076 Bordeaux Cedex, France (e-mail: ceci<strong>le</strong>.proust@isped.u-bordeaux2.fr).1
Annexes 1932 Proust-Lima et al.to highlight arguments for se<strong>le</strong>cting a restricted number oftests and even only one according to the aim of the study.Brevity and ease of use are obviously re<strong>le</strong>vant criteria bywhich to se<strong>le</strong>ct a test for population-based studies. Nonethe<strong>le</strong>ss,it is more crucial to se<strong>le</strong>ct a test ab<strong>le</strong> to detect smallchanges in cognition in all the range of cognitive <strong>le</strong>velsobserved in the target population (1, 2), particularly in casesof prolonged follow-up or long-term prevention studies. Indeed,the range of general cognitive <strong>le</strong>vel targeted will bedifferent according to whether the study samp<strong>le</strong> consists ofsubjects from population-based cohorts, patients consultingmemory clinics for memory troub<strong>le</strong>s, or patients withAlzheimer’s disease enrol<strong>le</strong>d in pharmacologic trials. Untilnow, when a sing<strong>le</strong> psychometric test is col<strong>le</strong>cted, the Mini-Mental State Examination (MMSE) (6) is usually preferred,because it gives a brief measure of global cognitive functioning(7). However, as the MMSE suffers from a strongceiling effect, it is not suitab<strong>le</strong> to identify slight declines inhigh <strong>le</strong>vels of cognition (7, 8) and, thus, is not appropriate tostudy normal cognitive aging in prospective studies, particularlyamong highly educated peop<strong>le</strong>.The aim of this work is to compare the sensitivity to cognitivechange of four tests widely used in clinical practice:the MMSE, the Isaacs Set Test, the Benton Visual RetentionTest, and the Digit Symbol Substitution Test. More specifically,we would like to identify the most appropriate test tomeasure cognitive changes over time in heterogeneous populations,including both highly normal and severely impairedsubjects, as encountered in population-based studies. To answerthis purpose, we use a nonlinear latent variab<strong>le</strong> modelfor longitudinal multivariate data in which psychometric testsare assumed to be nonlinear parameterized transformationsof a common factor (4). The common factor is a latent processrepresenting the latent cognitive process underlying the psychometrictests. It is related to age through a linear mixedmodel for describing the latent cognitive evolution accordingto age. By estimating f<strong>le</strong>xib<strong>le</strong> transformations between thepsychometric tests and the common factor, we are ab<strong>le</strong> tocompare the metrologic properties of the psychometric tests.This approach may be viewed as an extension of ItemResponse Theory (9) to hand<strong>le</strong> repeated measurements ofquantitative outcomes (the summary scores of each test) insteadof binary outcomes (the individual binary items of onetest). The link functions estimate the mean score of each testgiven the values of the latent process similarly to the ItemCharacteristic Curve in Item Response Theory models thatestimates the probability of correct response given the latentability. In addition, we are ab<strong>le</strong> to estimate evolution withtime of the latent process and the test scores.MATERIALS AND METHODSPopulationPAQUID is a prospective cohort study initiated in 1988 insouthwestern France (Dordogne and Gironde) to explorefunctional and cerebral aging. In brief, 3,777 subjects whowere 65 years or older and were living at home at enrollmentwere included in the cohort and were followed up forsix times with a visit at 1 year, 3 years, 5 years, 8 years,10 years, and 13 years after the initial visit, except at 1 year inDordogne. At each visit, a neuropsychological evaluationand a diagnosis of dementia were carried out at home.Letenneur et al. (10) offer a detai<strong>le</strong>d description of thePAQUID program.Neuropsychological evaluationIn PAQUID, a battery of psychometric tests was used toevaluate cognition. In this paper, we focus on the followingfour tests. The Mini-Mental State Examination (6) is a summed scoreevaluating various dimensions of cognition (memory, calculation,orientation in space and time, language, and wordrecognition). It is used as an index of global cognitiveperformance and ranges from 0 to 30. The Isaacs Set Test shortened at 15 seconds (11) evaluatesverbal fluency abilities and speed of verbal production.Subjects have to give a list of words (with a maximum of10) belonging to a specific semantic category in 15 seconds.Four semantic categories were successively used (cities,fruits, animals, and colors). The score ranges from 0 to 40. The Benton Visual Retention Test (12) evaluates immediatevisual memory. After the presentation for 10 secondsof a stimulus card displaying a geometric figure, subjectsare asked to choose the initial figure among four possibilities;15 figures are successively presented. The scoreranges from 0 to 15. The Digit Symbol Substitution Test (13) explores attentionand psychomotor speed. Given a code tab<strong>le</strong> displayingthe correspondence between pairs of digits (from 1 to9) and symbols, the subjects have to fill in blank squareswith the symbol that is paired to the digit displayed abovethe square. The subjects have to fill in as many squares aspossib<strong>le</strong> in 90 seconds. In PAQUID, the score ranges from0 to 76 even if the theoretical maximum is 90.Statistical modelThe statistical model assumes that the correlation betweenthe tests is induced by a latent common cognitivefactor. Thus, each test is a noisy measure of a test-specific nonlineartransformation of the common factor. The evolution ofthe common factor was mode<strong>le</strong>d using a linear mixed model(14) that aims at evaluating changes over time of a repeatedoutcome (here, the latent common factor), accounting for correlationbetween the repeated measures on each subject. Thelinear mixed model included random intercept, age, and agesquared in accordance with other longitudinal aging studies(15, 16) that showed quadratic cognitive evolutions. Weadded a Brownian motion to account for individual deviationsfrom this quadratic evolution and thus relaxed the parametricform of the model. Test-specific random intercepts wereadded to evaluate if, for a same <strong>le</strong>vel of the latent commonfactor, two subjects scored differently at the tests.We used f<strong>le</strong>xib<strong>le</strong> nonlinear transformations to link eachpsychometric test with the latent common factor. The chosenf<strong>le</strong>xib<strong>le</strong> transformations were beta cumulative distributionfunctions that offer a large variety of shapes (concave,convex, or sigmoid) using only two estimated parameters per
- Page 1 and 2:
Université Victor Segalen Bordeaux
- Page 3 and 4:
3RemerciementsA Monsieur Jean-Louis
- Page 5 and 6:
5Un immense merci à tous ceux que
- Page 7 and 8:
7A Delphine et ses mille et une his
- Page 9 and 10:
TABLE DES MATIÈRES 92.3.2 Estimati
- Page 11 and 12:
TABLE DES MATIÈRES 116.3.1 Adéqua
- Page 13 and 14:
Introduction 13ans atteintes d’un
- Page 15 and 16:
Introduction 15Mais, pour l’insta
- Page 17 and 18:
Introduction 171.2 Problèmes méth
- Page 19 and 20:
Introduction 191.2.3 Association en
- Page 21 and 22:
Introduction 21QUID suggère que le
- Page 23 and 24:
Chapitre 2Etat des connaissancesCe
- Page 25 and 26:
Etat des connaissances 25Plusieurs
- Page 27 and 28:
Etat des connaissances 27Prise en c
- Page 29 and 30:
Etat des connaissances 29Extensions
- Page 31 and 32:
Etat des connaissances 31données s
- Page 33 and 34:
Etat des connaissances 33variables
- Page 35 and 36:
Etat des connaissances 35(2000) ne
- Page 37 and 38:
Etat des connaissances 372.3 Modél
- Page 39 and 40:
Etat des connaissances 39chapitre 3
- Page 41 and 42:
Etat des connaissances 41de mélang
- Page 43 and 44:
Etat des connaissances 43Hawkins et
- Page 45 and 46:
Etat des connaissances 45tique de d
- Page 47 and 48:
Etat des connaissances 47L’estima
- Page 49 and 50:
Etat des connaissances 49normales s
- Page 51 and 52:
Etat des connaissances 512.4 Modél
- Page 53 and 54:
Etat des connaissances 53en tant qu
- Page 55 and 56:
Etat des connaissances 55interactio
- Page 57 and 58:
Etat des connaissances 57décrite p
- Page 59 and 60:
Etat des connaissances 59entre l’
- Page 61 and 62:
Etat des connaissances 612.4.3 Cas
- Page 63 and 64:
Etat des connaissances 63l’inform
- Page 65 and 66:
Modèle nonlinéaire à processus l
- Page 67 and 68:
Modèle nonlinéaire à processus l
- Page 69 and 70:
Modèle nonlinéaire à processus l
- Page 71 and 72:
Modèle nonlinéaire à processus l
- Page 73 and 74:
Modèle nonlinéaire à processus l
- Page 75 and 76:
Modèle nonlinéaire à processus l
- Page 77 and 78:
Modèle nonlinéaire à processus l
- Page 79 and 80:
Modèle nonlinéaire à processus l
- Page 81 and 82:
Modèle nonlinéaire à processus l
- Page 83 and 84:
Modèle nonlinéaire à processus l
- Page 85 and 86:
Modèle nonlinéaire à processus l
- Page 87 and 88:
Modèle nonlinéaire à processus l
- Page 89 and 90:
Modèle nonlinéaire à processus l
- Page 91 and 92:
Modèle nonlinéaire à processus l
- Page 93 and 94:
Chapitre 4Modèle nonlinéaire à c
- Page 95 and 96:
Modèle nonlinéaire à classes lat
- Page 97 and 98:
Modèle nonlinéaire à classes lat
- Page 99 and 100:
Modèle nonlinéaire à classes lat
- Page 101 and 102:
Modèle nonlinéaire à classes lat
- Page 103 and 104:
Modèle nonlinéaire à classes lat
- Page 105 and 106:
Modèle nonlinéaire à classes lat
- Page 107 and 108:
Modèle nonlinéaire à classes lat
- Page 109 and 110:
Modèle nonlinéaire à classes lat
- Page 111 and 112:
Modèle nonlinéaire à classes lat
- Page 113 and 114:
Modèle nonlinéaire à classes lat
- Page 115 and 116:
Modèle nonlinéaire à classes lat
- Page 117 and 118:
Modèle nonlinéaire à classes lat
- Page 119 and 120:
Modèle nonlinéaire à classes lat
- Page 121 and 122:
Modèle nonlinéaire à classes lat
- Page 123 and 124:
Modèle nonlinéaire à classes lat
- Page 125 and 126:
Modèle nonlinéaire à classes lat
- Page 127 and 128:
Modèle nonlinéaire à classes lat
- Page 129 and 130:
Modèle nonlinéaire à classes lat
- Page 131 and 132:
Modèle nonlinéaire à classes lat
- Page 133 and 134:
Modèle nonlinéaire à classes lat
- Page 135 and 136:
Modèle nonlinéaire à classes lat
- Page 137 and 138:
Modèle nonlinéaire à classes lat
- Page 139 and 140:
Modèle nonlinéaire à classes lat
- Page 141 and 142: Modèle nonlinéaire à classes lat
- Page 143 and 144: Modèle nonlinéaire à classes lat
- Page 145 and 146: Modèle nonlinéaire à classes lat
- Page 147 and 148: Modèle nonlinéaire à classes lat
- Page 149 and 150: Chapitre 6Discussion et perspective
- Page 151 and 152: Discussion et perspectives 151la pr
- Page 153 and 154: Discussion et perspectives 153Varia
- Page 155 and 156: Discussion et perspectives 1556.2 M
- Page 157 and 158: Discussion et perspectives 157à cl
- Page 160 and 161: Discussion et perspectives 160effet
- Page 162 and 163: Discussion et perspectives 162Dans
- Page 164 and 165: Chapitre 7BibliographieAmieva, H.,
- Page 166 and 167: Bibliographie 1661, S19-25.Brown, E
- Page 168 and 169: Bibliographie 168Sons, New-York.Fol
- Page 170 and 171: Bibliographie 170Hogan, J. W. et La
- Page 172 and 173: Bibliographie 172Lin, H., McCulloch
- Page 174 and 175: Bibliographie 174Park, CA.Muthén,
- Page 176 and 177: Bibliographie 176Schlattmann, P. (2
- Page 178 and 179: Bibliographie 178in the random-effe
- Page 180 and 181: Chapitre 8Annexes8.1 Liste des publ
- Page 182 and 183: Annexes 182Pau (France)Communicatio
- Page 184 and 185: Annexes 184166 C. Proust, H. Jacqmi
- Page 186 and 187: Annexes 186168 C. Proust, H. Jacqmi
- Page 188 and 189: Annexes 188170 C. Proust, H. Jacqmi
- Page 190 and 191: Annexes 190172 C. Proust, H. Jacqmi
- Page 194 and 195: Annexes 194Psychometric Tests’ Se
- Page 196 and 197: Annexes 196Psychometric Tests’ Se
- Page 198 and 199: Annexes 198Psychometric Tests’ Se
- Page 200 and 201: Annexes 200Abstract :When investiga
- Page 202 and 203: Annexes 202educated subjects. This
- Page 204 and 205: Annexes 204(iii) the recognition fo
- Page 206 and 207: Annexes 206Explanatory variablesIn
- Page 208 and 209: Annexes 208IST15 (median=28, IQR=24
- Page 210 and 211: Annexes 210and on the mean evolutio
- Page 212 and 213: Annexes 212These findings should be
- Page 214 and 215: Annexes 214Appendix : model specifi
- Page 216 and 217: Annexes 216References[1] Amieva H,
- Page 218 and 219: Annexes 218[19] Letenneur L, Commen
- Page 220 and 221: Annexes 220Figure 1 : (A) Predicted
- Page 222 and 223: Annexes 222Table 1: demographic and
- Page 224: Annexes 224MMSE 0.0037 * 0.0013,0.0