The primary coder (MAM) trained an independent rater (RAY) on the coding scheme developed for this study in order to assess interrater reliability. Because ES for 12 of 19 studies were confirmed by a corresponding author, the independent rater coded 3 studies for which author confirmation was not obtained, chosen at random from within that subsample. For calculation of the overall ES, interrater reliability was excellent, Pearson’s r = .981, intraclass correlation coefficient (ICC) = .970, 95% confidence interval = .607–.999. Complete agreement for continuous measures was obtained for year of publication, MRI field strength, difference in education, percentage male, duration of AUD, and number of days abstinent. Reliability was acceptable to high for sample size, ICC = .678, and age, ICC = .998. For categorical measures, all kappa coefficients = 1, indicating complete agreement.
