Reliability and validity of an internalizing symptom scale based on the adolescent and adult Semi-Structured Assessment for the Genetics of Alcoholism (SSAGA).
- Authors
- Acion, Laura; Kramer, John; Liu, Xiangtao; Chan, Grace; Langbehn, Douglas; Bucholz, Kathleen; McCutcheon, Vivia; Hesselbrock, Victor; Schuckit, Marc; Dick, Danielle; Hesselbrock, Michie; Kuperman, Samuel
- Year
- 2019
- Journal
- The American journal of drug and alcohol abuse
- PMID
- 29870277
- DOI
- 10.1080/00952990.2018.1476520
- PMCID
- PMC6481182
BACKGROUND: The Semi-Structured Assessment for the Genetics of Alcoholism (SSAGA) is an interview that assesses psychiatric symptoms and diagnoses, including substance use disorders and anxiety and mood (i.e., internalizing) disorders. Although the SSAGA is widely used, there exists no overall internalizing characteristics scale based on items drawn from SSAGA's mood and anxiety disorder sections. OBJECTIVES: To design and assess a SSAGA-based measurement instrument capturing the overall internalizing dimension that underlies more specific internalizing conditions. METHODS: We developed, assessed, and characterized a new scale for measuring internalizing problematic characteristics derived from the SSAGA interview. All samples were drawn from the Collaborative Studies on the Genetics of Alcoholism, a prospective multi-site genetic study of families at high risk for alcohol use disorders. All participants taking part in the study between September 2005 and September 2017 were eligible (nΒ =Β 904, 52.2% female). RESULTS: The scale had adequate internal consistency (ordinal Ξ±Β =Β 0.85, 95% CIΒ =Β [0.81, 0.89]). Construct validity was supported by its association with other measures of internalizing characteristics (Internalizing Scale from Achenbach Self Reports; Neuroticism Scale from the Neuroticism-Extraversion-Openness Five-Factor Personality Inventory). Several indices of alcohol, marijuana, and nicotine misuse were also positively associated with Internalizing Scale scores. CONCLUSIONS: The Internalizing Scale has very good psychometric properties and can be used in studies that incorporate the SSAGA interview to study the association between internalizing characteristics and problematic alcohol and other substance use. These associations can potentially be utilized to identify individuals at risk for substance problems and to design treatments targeting such individuals.
Distribution of the Internalizing Scale score in the validation sample. SD: standard deviation. Q1: First quartile. Q3: Third quartile.
LLM interpretation
This is a histogram showing the distribution of Internalizing Scale scores for a validation sample of $n=723$. The y-axis represents the percentage of the sample, and the x-axis represents the scale score. The data is heavily right-skewed, with the majority of participants scoring 0 (approximately 60%) and a mean score of 1.32.
| Name | Type |
|---|---|
| Achenbach Internalizing Scale local | phenotype |
| addiction | phenotype |
| Adolescent members local | cohort |
| adolescents | cohort |
| Adult Achenbach Internalizing Scale local | phenotype |
| adults | cohort |
| adult substance initiation local | phenotype |
| aggression | phenotype |
| agoraphobia | phenotype |
| alcohol | phenotype |
| alcohol dependence | phenotype |
| Alcohol Use Disorder | phenotype |
| alcohol use disorders | phenotype |
| anxiety | phenotype |
| anxiety symptoms | phenotype |
| AUD | phenotype |
| Collaborative Studies on the Genetics of Alcoholism | cohort |
| Collaborative Study on the Genetics of Alcoholism (COGA) | cohort |
| conduct disorder | phenotype |
| depression | phenotype |
| depressive symptoms | phenotype |
| Desires for Alcohol Questionnaire local | phenotype |
| Desires for Alcohol Questionnaire total score local | phenotype |
| development sample local | cohort |
| Development sample local | cohort |
| Development subsample local | cohort |
| drug | drug |
| drug dependence | phenotype |
| drugs | drug |
| DSM5 AUD diagnosis local | phenotype |
| early internalizing characteristics local | phenotype |
| externalizing disorders | phenotype |
| female individuals | cohort |
| heritability | phenotype |
| hostility | phenotype |
| impulsivity | phenotype |
| internalizing characteristics | phenotype |
| internalizing construct local | phenotype |
| internalizing disorders | phenotype |
| internalizing domain | phenotype |
| Internalizing Scale local | phenotype |
| Internalizing Scale (Achenbach) local | phenotype |
| Internalizing Scale (development) local | phenotype |
| Internalizing Scale score local | phenotype |
| Internalizing Scale (SSAGA) local | phenotype |
| Internalizing Scale total score local | phenotype |
| INT Scale scores local | phenotype |
| major depressive disorder | phenotype |
| mania | phenotype |
| marijuana | phenotype |
| marijuana dependence | phenotype |
| marijuana use disorder | phenotype |
| Marijuana use disorder symptoms local | phenotype |
| mood disorders | phenotype |
| neuroticism | phenotype |
| Neuroticism-Extraversion-Openness Five-Factor Personality Inventory local | cohort |
| Neuroticism Subscale local | phenotype |
| Neuroticism Subscale (Five-Factor Personality Inventory) local | phenotype |
| nicotine | drug |
| nicotine dependence | phenotype |
| Nicotine use disorder symptoms local | phenotype |
| novelty seeking | phenotype |
| obsessive-compulsive disorder | phenotype |
| other substances | phenotype |
| panic disorder | phenotype |
| Post-Traumatic Stress Disorder | phenotype |
| Problematic alcohol and substance use local | phenotype |
| Problematic substance use | phenotype |
| psychosis | phenotype |
| relapse after substance treatment local | phenotype |
| serious physical illness | phenotype |
| sex | phenotype |
| social phobia | phenotype |
| specific anxiety diagnoses local | phenotype |
| specific mood diagnoses local | phenotype |
| SSAGA | cohort |
| SSAGA-based Internalizing Scale local | phenotype |
| SSAGA Internalizing Scale local | phenotype |
| SSAGA interview local | cohort |
| stressful life events | phenotype |
| substance use | phenotype |
| suicide | phenotype |
| validation sample | cohort |
| Validation subsample local | cohort |
| Withdrawal/negative affect local | phenotype |
| Young adult members local | cohort |
| Youth Achenbach Internalizing Scale local | phenotype |
| Youth and Adult Achenbach Self Reports local | cohort |
No uploaded files.
| Citation | PMID | DOI | Status |
|---|---|---|---|
| AchenbachT, RescorlaL. Manual for the ASEBA adult forms & profiles. Burlington, VT: University of Vermont 2003. | β | β | β |
| American Psychiatric Association. Diagnostic and statistical manual of mental disorders (DSM-5). Washington, DC: American Psychiatric Association; 2013. | β | β | β |
| BaglinJ Improving your exploratory factor analysis for ordinal data: a demonstration using FACTOR. Practical Assessment, Research & Evaluation. 2014;19(5):2. | β | β | β |
| BauerLO. Predicting relapse to alcohol and drug abuse via quantitative electroencephalography. Neuropsychopharmacology. 2001;25(3):332β340.1152246210.1016/S0893-133X(01)00236-6 | β | β | β |
| BegleiterH, ReichT, HesselbrockV, The collaborative study on the genetics of alcoholism. Alcohol Health and Research World. 1995;19:228β228.PMC687576831798102 | β | β | β |
| BrownSA, BrumbackT, TomlinsonK, The National Consortium on Alcohol and NeuroDevelopment in Adolescence (NCANDA): a multisite study of adolescent development and substance use. Journal of studies on alcohol and drugs. 2015;76(6):895β908.2656259710.15288/jsad.2015.76.895PMC4712659 | β | β | β |
| BucholzKK, CadoretR, CloningerCR, A new, semi-structured psychiatric interview for use in genetic linkage studies: a report on the reliability of the SSAGA. Journal of studies on alcohol. 1994;55(2):149β158.818973510.15288/jsa.1994.55.149 | β | β | β |
| BucholzKK, NurnbergerJIJr, KramerJR, HesselbrockVM, SchuckitMA, BierutLJ. Comparison of psychiatric diagnoses from interview reports with those from best-estimate procedures. Journal of studies on alcohol. 2006;67(1):157β168.1653614010.15288/jsa.2006.67.157 | β | β | β |
| ChassinL, Ritter J. Vulnerability to substance use disorders in childhood and adolescence In IngramRE, & PriceJM (Eds.) Vulnerability to psychopathology: Risk across the lifespan. Guilford Press; 2010; pp. 107β134. | β | β | β |
| CostaL, BauerL, KupermanS, Frontal P300 decrements, alcohol dependence, and antisocial personality disorder. Biological Psychiatry. 2000;47(12):1064β1071.1086280610.1016/s0006-3223(99)00317-0 | β | β | β |
| CostaPT, MacCraeRR. Revised NEO personality inventory (NEO PI-R) and NEO five-factor inventory (NEO FFI): Professional manual. Psychological Assessment Resources; 1992. | β | β | β |
| CrutzenR, Peters G-JY. Scale quality: alpha is an inadequate estimate and factor-analytic evidence is needed first of all. Health psychology review. 2015:1β6.2660299010.1080/17437199.2015.1124240 | β | β | β |
| DawsonDA, GoldsteinRB, MossHB, Li T-K, GrantBF. Gender differences in the relationship of internalizing and externalizing psychopathology to alcohol dependence: Likelihood, expression and course. Drug and alcohol dependence. 2010;112(1):9β17.2055801410.1016/j.drugalcdep.2010.04.019PMC2953598 | β | β | β |
| Del BocaFK, HesselbrockMN. Gender and alcoholic subtypes. Alcohol Research and Health. 1996;20(1):56.PMC687652831798160 | β | β | β |
| DunnTJ, BaguleyT, BrunsdenV. From alpha to omega: A practical solution to the pervasive problem of internal consistency estimation. British Journal of Psychology. 2014;105(3):399β412.2484411510.1111/bjop.12046 | β | β | β |
| EdenbergHJ, ForoudT. Review: The genetics of alcoholism: identifying specific genes through family studies. Addiction biology. 2006;11(3β4):386β396.1696176610.1111/j.1369-1600.2006.00035.x | β | β | β |
| FerrandoPJ, Lorenzo-SevaU. Assessing the quality and appropriateness of factor solutions and factor score estimates in exploratory item factor analysis. Educational and Psychological Measurement. 2017:0013164417719308.10.1177/0013164417719308PMC732823432655169 | β | β | β |
| GadermannAM, GuhnM, ZumboBD. Estimating ordinal reliability for Likert-type and ordinal item response data: A conceptual, empirical, and practical guide. Practical Assessment, Research & Evaluation. 2012;17(3):1β13. | β | β | β |
| GrantBF, GoldsteinRB, SahaTD, Epidemiology of DSM-5 alcohol use disorder: results from the National Epidemiologic Survey on Alcohol and Related Conditions III. JAMA psychiatry. 2015;72(8):757β766.2603907010.1001/jamapsychiatry.2015.0584PMC5240584 | β | β | β |
| GrantBF, StinsonFS, DawsonDA, Prevalence and co-occurrence of substance use disorders and independentmood and anxiety disorders: Results from the national epidemiologic survey on alcohol and relatedconditions. Archives of general psychiatry. 2004;61(8):807β816.1528927910.1001/archpsyc.61.8.807 | β | β | β |
| GriffithJW, ZinbargRE, CraskeMG, Neuroticism as a common dimension in the internalizing disorders. Psychological medicine. 2010;40(7):1125β1136.1990336310.1017/S0033291709991449PMC2882529 | β | β | β |
| HarfordTC, Yi Hy, Chen CM, Grant BF. Psychiatric symptom clusters as risk factors for alcohol use disorders in adolescence: a national study. Alcoholism: Clinical and Experimental Research. 2015;39(7):1174β1185.10.1111/acer.12767PMC449098526110378 | β | β | β |
| HesselbrockM, EastonC, BucholzKK, SchuckitM, HesselbrockV. A validity study of the SSAGA-a comparison with the SCAN. Addiction. 1999;94(9):1361β1370.1061572110.1046/j.1360-0443.1999.94913618.x | β | β | β |
| HornJL. A rationale and test for the number of factors in factor analysis. Psychometrika. 1965;30(2):179β185.1430638110.1007/BF02289447 | β | β | β |
| HussongAM, JonesDJ, SteinGL, BaucomDH, BoedingS. An internalizing pathway to alcohol use and disorder. Psychology of Addictive Behaviors. 2011;25(3):390.2182376210.1037/a0024519PMC3178003 | β | β | β |
| InstituteSAS. Base SAS 9.4 Procedures Guide. SAS Institute; 2014. | β | β | β |
| IvanovaMY, AchenbachTM, RescorlaLA, The generalizability of the Youth Self-Report syndrome structure in 23 societies. Journal of Consulting and Clinical Psychology. 2007;75(5):729.1790785510.1037/0022-006X.75.5.729 | β | β | β |
| KingSM, IaconoWG, McGueM. Childhood externalizing and internalizing psychopathology in the prediction of early substance use. Addiction. 2004;99(12):1548β1559.1558504610.1111/j.1360-0443.2004.00893.x | β | β | β |
| KoobGF, AhmedSH, BoutrelB, Neurobiological mechanisms in the transition from drug use to drug dependence. Neuroscience & Biobehavioral Reviews. 2004;27(8):739β749.1501942410.1016/j.neubiorev.2003.11.007 | β | β | β |
| KoobGF, Le MoalM. Plasticity of reward neurocircuitry and theβdark sideβof drug addiction. Nature neuroscience. 2005;8(11):1442β1444.1625198510.1038/nn1105-1442 | β | β | β |
| KotovR, GamezW, SchmidtF, WatsonD. Linking βbigβ personality traits to anxiety, depressive, and substance use disorders: a meta-analysis. Psychological bulletin. 2010;136(5):768.2080423610.1037/a0020327 | β | β | β |
| KramerJ, ChanG, KupermanS, The role of internalizing and externalizing symptoms in alcohol, nicotine, and marijuana involvement. Alcoholism: Clinical and experimental research. 2015;39:152A. | β | β | β |
| KramerJ, ChanG, KupermanS, WetherillL, BucholzK, AcionL. The combined role of internalizing and externalizing symptoms in alcohol use and problems. Alcoholism: Clinical and experimental research. 2014;38:262A. | β | β | β |
| KramerJR, ChanG, HesselbrockVM, A Principal Components Analysis of the Abbreviated Desires for Alcohol Questionnaire (DAQ)*. Journal of studies on alcohol and drugs. 2010;71(1):150β155.2010542510.15288/jsad.2010.71.150PMC2815057 | β | β | β |
| KruegerRF, MarkonKE. Understanding psychopathology melding behavior genetics, personality, and quantitative psychology to develop an empirically based model. Current Directions in Psychological Science. 2006;15(3):113β117.1839211610.1111/j.0963-7214.2006.00418.xPMC2288576 | β | β | β |
| KruegerRF. The structure of common mental disorders. Archives of General Psychiatry. 1999;56(10):921β926.1053063410.1001/archpsyc.56.10.921 | β | β | β |
| KupermanS, ChanG, KramerJR, A model to determine the likely age of an adolescentβs first drink of alcohol. Pediatrics. 2013;131(2):242β248.2329643110.1542/peds.2012-0880PMC3557403 | β | β | β |
| KupermanS, SchlosserSS, KramerJR, Developmental sequence from disruptive behavior diagnosis to adolescent alcohol dependence. American Journal of Psychiatry. 2001.10.1176/appi.ajp.158.12.202211729019 | β | β | β |
| KushnerMG, AbramsK, ThurasP, HansonKL, BrekkeM, SlettenS. Followβup study of anxiety disorder and alcohol dependence in comorbid alcoholism treatment patients. Alcoholism: Clinical and Experimental Research. 2005;29(8):1432β1443.10.1097/01.alc.0000175072.17623.f816131851 | β | β | β |
| KushnerMG, WallMM, KruegerRF, Alcohol dependence is related to overall internalizing psychopathology load rather than to particular internalizing disorders: evidence from a national sample. Alcoholism: Clinical and Experimental Research. 2012;36(2):325β331.10.1111/j.1530-0277.2011.01604.xPMC323525021895708 | β | β | β |
| Lorenzo-SevaU, FerrandoPJ. FACTOR: A computer program to fit the exploratory factor analysis model. Behavior research methods. 2006;38(1):88β91.1681751710.3758/bf03192753 | β | β | β |
| LoveA, JamesD, WillnerP. A comparison of two alcohol craving questionnaires. Addiction. 1998;93(7):1091β1102.974413910.1046/j.1360-0443.1998.937109113.x | β | β | β |
| McLeanCP, AsnaaniA, LitzBT, HofmannSG. Gender differences in anxiety disorders: prevalence, course of illness, comorbidity and burden of illness. Journal of psychiatric research. 2011;45(8):1027β1035.2143957610.1016/j.jpsychires.2011.03.006PMC3135672 | β | β | β |
| MokkinkLB, TerweeCB, PatrickDL, The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Quality of Life Research. 2010;19(4):539β549.2016947210.1007/s11136-010-9606-8PMC2852520 | β | β | β |
| NewcombeRG. Confidence intervals for proportions and related measures of effect size. CRC Press; 2012. | β | β | β |
| Nolen-HoeksemaS Gender differences in depression. Current directions in psychological science. 2001;10(5):173β176. | β | β | β |
| NurnbergerJI, ForoudT, FluryL, MeyerET, WiegandR. Is there a genetic relationship between alcoholism and depression? Alcohol research and health. 2002;26(3):233β240.12875052PMC6683839 | β | β | β |
| PardiniD, WhiteHR, Stouthamer-LoeberM. Early adolescent psychopathology as a predictor of alcohol use disorders by young adulthood. Drug & Alcohol Dependence. 2007;88:S38βS49.1725778110.1016/j.drugalcdep.2006.12.014PMC2034413 | β | β | β |
| PatrickME, SchulenbergJE, OβMalleyPM, Age-related changes in reasons for using alcohol and marijuana from ages 18 to 30 in a national sample. Psychology of addictive behaviors. 2011;25(2):330.2141751610.1037/a0022445PMC3133626 | β | β | β |
| Peters G-JY. The alpha and the omega of scale reliability and validity: why and how to abandon Cronbachβs alpha and the route towards more comprehensive assessment of scale quality. European Health Psychologist. 2014;16(2):56β69. | β | β | β |
| PreussU, SchuckitM, SmithT, BarnowS, DankoG. Mood and anxiety symptoms among 140 children from alcoholic and control families. Drug and alcohol dependence. 2002;67(3):235β242.1212719410.1016/s0376-8716(02)00076-5 | β | β | β |
| R Core Team. R: A language and environment for statistical computing. In: Computing RFfS, ed. Vienna, Austria: ISBN 3-900051-07-0; 2016. | β | β | β |
| SchuckitMA, SmithTL, BarnowS, PreussU, LuczakS, RadziminskiS. Correlates of externalizing symptoms in children from families of alcoholics and controls. Alcohol and Alcoholism. 2003;38(6):559β567.1463364310.1093/alcalc/agg116 | β | β | β |
| ShapiroA, Ten BergeJM. Statistical inference of minimum rank factor analysis. Psychometrika. 2002;67(1):79β94. | β | β | β |
| SlutskeWS, HeathAC, DinwiddieSH, Common genetic risk factors for conduct disorder and alcohol dependence. Journal of Abnormal Psychology. 1998;107(3):363.971557210.1037//0021-843x.107.3.363 | β | β | β |
| Ten BergeJM, KiersHA. A numerical approach to the approximate and the exact minimum rank of a covariance matrix. Psychometrika. 1991;56(2):309β315. | β | β | β |
| VolkowND, KoobGF, McLellanAT. Neurobiologic advances from the brain disease model of addiction. New England Journal of Medicine. 2016;374(4):363β371.2681601310.1056/NEJMra1511480PMC6135257 | β | β | β |
| WuP, BirdHR, LiuX, Childhood depressive symptoms and early onset of alcohol use. Pediatrics. 2006;118(5):1907β1915.1707956110.1542/peds.2006-1221PMC3072781 | β | β | β |
In this knowledge base
| Title | Year | PMID |
|---|---|---|
| High Polygenic Risk Scores Are Associated With Early Age of Onset of Alcohol Use Disorder in Adolescents and Young Adults at Risk. | 2022 | 36324664 |
External
| Title | Authors | Journal | Year | Link |
|---|---|---|---|---|
| Connectomics modeling of regional networks of white-matter fractional anisotropy to predict the severity of young adult drinking. | Li Y et al. | β | 2025 | β |
| Event-related Oscillations to Emotional Faces are Related to a History of Internalizing Disorders. | Ehlers CL et al. | β | 2023 | β |
| The Underlying Mechanisms in the Association Between Traumatic Brain Injury in Childhood and Conduct Disorder Symptoms in Late Adolescence. | Khalaf HKS et al. | β | 2023 | β |
| High Polygenic Risk Scores Are Associated With Early Age of Onset of Alcohol Use Disorder in Adolescents and Young Adults at Risk. | Nurnberger JI et al. | β | 2022 | β |
| Influence of ADHD, especially attention-deficit characteristics, on the course of alcohol-dependent individuals. | Yoshimura A et al. | β | 2022 | β |
| Associations between Suicidal Thoughts and Behaviors and Genetic Liability for Cognitive Performance, Depression, and Risk-Taking in a High-Risk Sample. | Johnson EC et al. | β | 2021 | β |
| Development of Alcohol Use Disorder as a Function of Age, Severity, and Comorbidity with Externalizing and Internalizing Disorders in a Young Adult Cohort. | Nurnberger JI et al. | β | 2019 | β |