Korean Clinical Psychology Association

Current Issue

Korean Journal of Clinical Psychology - Vol. 41 , No. 2

[ Original Article ]
Korean Journal of Clinical Psychology - Vol. 41 , No. 2 , pp.43-53
ISSN: 2733-4538 (Online)
publication date 30 May 2022
Received 01 Dec 2021 Revised 09 Feb 2022 Accepted 08 Mar 2022
DOI: https://doi.org/10.15842/kjcp.2022.41.2.001

Psychometric Investigation of the Revised Children’s Manifest Anxiety Scale, Second Edition, Short Form among the Korean Youth Population
Hayoung Yoon1 ; Eun-Ho Lee2 ; Soon-Taeg Hwang3 ; Sang-Hwang Hong4 ; Ji-Hae Kim1,
1Department of Psychiatry, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul
2Depression Center, Department of Psychiatry, Samsung Medical Center, Seoul
3Department of Psychology, Chungbuk National University, Cheongju
4Department of Education, Chinju National University of Education, Jinju, Korea

Correspondence to : Ji-Hae Kim, Department of Psychiatry, Samsung Medical Center, Sungkyunkwan University School of Medicine, 81 Irwon-ro, Gangnam-gu, Seoul, Korea; E-mail: jihae0931.kim@samsung.com


© 2022 Korean Clinical Psychology Association

Abstract

The Revised Children’s Manifest Anxiety Scale, Second Edition (RCMAS-2) has long been used to measure anxiety levels in youth. Its introduction of a 10-item short form has enriched the efficiency and applicability of the scale; however, more research is warranted to elucidate its psychometric properties. This study aims to investigate the factor structure and the measurement invariance of the RCMAS-2 short form (RCMAS-2 SF) in Korean youth. In total, 1,525 participants from seven different cities of South Korea were included in the analysis (Mean Age=12.49, SD=2.54). After randomly assigning participants into two groups, we consecutively performed exploratory and confirmatory factor analyses. The results of both analyses demonstrated that pediatric anxiety assessed using the RCMAS-2 SF is composed of two distinct latent factors: physiological anxiety and cognitive anxiety. Furthermore, the results supported strong invariance across gender and age. The RCMAS-2 SF score also showed good indices of internal consistency, test-retest reliability, and concurrent validity. These findings highlight that the scale can be widely used as a time-efficient screening tool that enables valid score comparisons between boys and girls of different ages.


Keywords: anxiety, RCMAS-2, short form, measurement invariance, reliability, validity

Acknowledgments

This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

Author contributions statement

HYY, a clinical psychology resident in the Department of Psychiatry at Samsung Medical Center, analyzed the data and wrote the manuscript. EHL, a clinical psychologist at the Depression Center at Samsung Medical Center, contributed to the data interpretation. He also led the preparation and correction of the manuscript. STH, a professor from the Department of Psychology at Chungbuk National University, designed the study process in general. He also vastly contributed to data collection the data for this study. SHH, a professor at the Chinju National University of Education, assisted in data collection and clitically revised the article. JHK, a supervisor of the Department of Psychiatry at Samsung Medical Center and a processor of Sungkyunkwan University School of Medicine, served as the principal investigator of the research and supervised the research process in general. All the authors provided critical feedback, participated in the revision of the manuscript, and approved the final submission.


References
1. Ahlen, J., Vigerland, S., & Ghaderi, A. (2018). Development of the Spence Children’s Anxiety Scale-Short version (SCAS-S). Journal of Psychopathology and Behavioral Assessment, 40, 288-304.
2. Ahmad, R., & Mansoor, I. (2011). What I think and feel: Translation and adaptation of Revised Children’s Manifest Anxiety Scale, Second Edition (RCMAS-2) and its reliability assessment. The International Journal of Educational and Psychological Assessment, 8, 1-11.
3. Barker, M. M., Beresford, B., Bland, M., & Fraser, L. K. (2019). Prevalence and incidence of anxiety and depression among children, adolescents, and young adults with life-limiting conditions: A systematic review and meta-analysis. JAMA Pediatrics, 173, 835-844.
4. Beard, C., Sawyer, A. T., & Hofmann, S. G. (2012). Efficacy of attention bias modification using threat and appetitive stimuli: A meta-analytic review. Behavior Therapy, 43, 724-740.
5. Bieda, A., Hirschfeld, G., Schönfeld, P., Brailovskaia, J., Zhang, X. C., & Margraf, J. (2016). Universal happiness? Cross-cultural measurement invariance of scales assessing positive mental health. Psychological Assessment, 29, 408-421.
6. Bienvenu, O. J., & Ginsburg, G. S. (2007). Prevention of anxiety disorders. International Review of Psychiatry, 19, 647-654.
7. Billieux, J., Rochat, L., Ceschi, G., Carré, A., Offerlin-Meyer, I., Defeldre, A. C., Khazaal, Y., Besche-Richard, C., Van der Linden, M. (2012). Validation of a short French version of the UPPS-P Im­pulsive Behavior Scale. Comprehensive Psychiatry, 53, 609-615.
8. Bittner, A., Egger, H. L., Erkanli, A., Jane Costello, E., Foley, D. L., & Angold, A. (2007). What do childhood anxiety disorders pre­dict? Journal of Child Psychology and Psychiatry, 48, 1174-1183.
9. Boschloo, L., Schoevers, R. A., van Borkulo, C. D., Borsboom, D., & Oldehinkel, A. J. (2016). The network structure of psychopathology in a community sample of preadolescents. Journal of Abnormal Psychology, 125, 599.
10. Cha, Y., Lee, E., Hwang, S., Hong, S., & Kim, J. (2020). Psychometric investigation of the Korean Version of the Revised Children’s Manifest Anxiety Scale, Second Edition. Korean Journal of Clini­cal Psychology, 39, 203-214.
11. Chan, S. M., & Leung, C. H. (2015). Factor structure of the screen for child anxiety-related emotional disorders (SCARED) in a community sample of Hong Kong Chinese adolescents. Child Psychiatry and Human Development, 46, 671-682.
12. Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14, 464-504.
13. Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233-255.
14. Chisholm, D., Sweeny, K., Sheehan, P., Rasmussen, B., Smit, F., Cuijpers, P., & Saxena, S. (2016). Scaling-up treatment of depression and anxiety: A global return on investment analysis. The Lancet Psychiatry, 3, 415-424.
15. Cho, S. C., & Choi, J. S. (1989). Development of the Korean form of the state-trait anxiety inventory for children. Seoul Journal of Psychiatry, 14, 150-157.
16. Chorpita, B. F., Plummer, C. M., & Moffitt, C. E. (2000). Relations of tripartite dimensions of emotion to childhood anxiety and mood disorders. Journal of Abnormal Child Psychology, 28, 299-310.
17. Chorpita, B. F., Yim, L., Moffitt, C., Umemoto, L. A., & Francis, S. E. (2000). Assessment of symptoms of DSM-IV anxiety and depression in children: A revised child anxiety and depression scale. Behaviour Research and Therapy, 38, 835-855.
18. Copeland, W. E., Angold, A., Shanahan, L., & Costello, E. J. (2014). Longitudinal patterns of anxiety from childhood to adulthood: the Great Smoky Mountains Study. Journal of the American Academy of Child and Adolescent Psychiatry, 53, 21-33.
19. Costello, E. J., Egger, H. L., & Angold, A. (2004). Developmental Epidemiology of Anxiety Disorders. In T. H. Ollendick & J. S. March (Eds.), Phobic and anxiety disorders in children and adolescents: A clinician's guide to effective psychosocial and pharmacological interventions (pp. 61-91). Oxford University Press.
20. Clark, D. M., & Wells, A. (1995). A cognitive model. Social Phobia: Diagnosis, Assessment, and Treatment, 69, 1025.
21. Creswell, C., Schniering, C. A., & Rapee, R. M. (2005). Threat interpretation in anxious children and their mothers: Comparison with nonclinical children and the effects of treatment. Behaviour Research and Therapy, 43, 1375-1381.
22. Daleiden, E. L., & Vasey, M. W. (1997). An information-processing perspective on childhood anxiety. Clinical Psychology Review, 17, 407-429.
23. Ebesutani, C., Regan, J., Smith, A., Reise, S., Higa-McMillan, C., & Chorpita, B. F. (2012). The 10-item positive and negative affect schedule for children, child and parent shortened versions: Application of item response theory for more efficient assessment. Journal of Psychopathology and Behavioral Assessment, 34, 191-203.
24. Essau, C. A., Ishikawa, S. I., Sasagawa, S., Sato, H., Okajima, I., Otsui, K., Georgiou, G. A., O’Callaghan, J., & Michie, F. (2011). Anxiety symptoms among adolescents in Japan and England: Their relationship with self‐construals and social support. Depression and Anxiety, 28, 509-518.
25. Fenley, A. R., Langer, D. A., Blake, P. R., & Pincus, D. B. (2021). The relation between risk perception and anxiety in youth: An investigation using a novel developmentally tailored measure. Journal of Psychopathology and Behavioral Assessment.
26. Flora, D. B., & Curran, P. J. (2004). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods, 9, 466-491.
27. Gaesser, A. H., & Karan, O. C. (2017). A randomized controlled comparison of emotional freedom technique and cognitive-behavioral therapy to reduce adolescent anxiety: A pilot study. The Journal of Alternative and Complementary Medicine, 23, 102-108.
28. Garber, J., & Weersing, V. R. (2010). Comorbidity of anxiety and depression in youth: implications for treatment and prevention. Clinical Psychology: Science and Practice, 17, 293-306.
29. Gau, S. S., Chong, M. Y., Chen, T. H., & Cheng, A. T. (2005). A 3-year panel study of mental disorders among adolescents in Taiwan. The American Journal of Psychiatry, 162, 1344-1350.
30. Hale, W. W., Crocetti, E., Raaijmakers, Q. A., & Meeus, W. H. (2011). A meta‐analysis of the cross‐cultural psychometric properties of the Screen for Child Anxiety Related Emotional Disorders (SCARED). Journal of Child Psychology and Psychiatry, 52, 80-90.
31. Holmes, M. C., Donovan, C. L., Farrell, L. J., & March, S. (2014). The efficacy of a group-based, disorder-specific treatment program for childhood GAD–A randomized controlled trial. Behaviour Research and Therapy, 61, 122-135.
32. Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.
33. Keller, M. B., Lavori, P. W., Wunder, J., Beardslee, W. R., Schwartz, C. E., & Roth, J. (1992). Chronic course of anxiety disorders in children and adolescents. Journal of the American Academy of Child and Adolescent Psychiatry, 31, 595-599.
34. Kim, H. J., Lee, E. H., Hwang, S. T., Hong, S. H., & Kim, J. H. (2018). Psychometric properties of the Children’s Depression Inventory-2 among a community-based sample of Korean children and adolescents. Korean Journal of Clinical Psychology, 37, 177-186.
35. Kim, J. H., Tsai, W., Kodish, T., Trung, L. T., Lau, A. S., & Weiss, B. (2019). Cultural variation in temporal associations among somatic complaints, anxiety, and depressive symptoms in adolescence. Journal of Psychosomatic Research, 124, 109763.
36. Kovacs M. (2010). Children's depression inventory - second edition (CDI 2) manual. NY: Multi-Health Services Publishing.
37. Krebs, G., Pile, V., Grant, S., Degli Esposti, M., Montgomery, P., & Lau, J. Y. (2018). Research review: Cognitive bias modification of interpretations in youth and its effect on anxiety: A meta‐analysis. Journal of Child Psychology and Psychiatry, 59, 831-844.
38. Lau, J. Y., & Waters, A. M. (2017). Annual research review: An expanded account of information‐processing mechanisms in risk for child and adolescent anxiety and depression. Journal of Child Psychology and Psychiatry, 58, 387-407.
39. Li, H. C. W., & Lopez, V. (2007). Development and validation of a short form of the Chinese version of the State Anxiety Scale for Children. International Journal of Nursing Studies, 44, 566-573.
40. Lowe, P. A. (2015b). The revised Children’s manifest anxiety scale–second edition short form: Examination of the psychometric properties of a brief measure of general anxiety in a sample of children and adolescents. Journal of Psychoeducational Assessment, 33, 719-730.
41. Lowe, P. A. (2015a). Reliability and validity of the RCMAS-2 Short Form scores. Paper presented at the annual meeting of the National Association of School Psychologists, Orlando, FL.
42. Lowe, P. A., & Ang, R. P. (2016). Examination of measurement invariance across culture and gender on the RCMAS-2 short form among Singapore and US adolescents. Journal of Psychoeduca­tional Assessment, 34, 192-198.
43. Mahakwe, G., Johnson, E., Karlsson, K., & Nilsson, S. (2021). A systematic review of self-report instruments for the measurement of anxiety in hospitalized children with cancer. International Journal of Environmental Research and Public Health, 18, 1911.
44. McElroy, E., Fearon, P., Belsky, J., Fonagy, P., & Patalay, P. (2018). Networks of depression and anxiety symptoms across development. Journal of the American Academy of Child & Adolescent Psychiatry, 57, 964-973.
45. McEvoy, P. M., Salmon, K., Hyett, M. P., Jose, P. E., Gutenbrunner, C., Bryson, K., & Dewhirst, M. (2019). Repetitive negative thinking as a transdiagnostic predictor of depression and anxiety symptoms in adolescents. Assessment, 26, 324-335.
46. Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58, 525-543.
47. Merikangas, K. R., He, J. P., Burstein, M., Swanson, S. A., Avenevoli, S., Cui, L., Benjet, C., Georgiades, K., & Swendsen, J. (2010). Lifetime prevalence of mental disorders in US adolescents: Results from the National Comorbidity Survey Replication–Adolescent Supplement (NCS-A). Journal of the American Academy of Child and Adolescent Psychiatry, 49, 980-989.
48. Muthén, B. O. (1984). A general structural equation model with dichotomous, ordered categorical, and continuous latent variable indicators. Psychometrika, 49, 115-132.
49. Muthén, L. K., & Muthén, B. O. (2012). Mplus: Statistical analysis with latent variables; User’s guide (7th ed.). CA: Author.
50. Pina, A. A., Little, M., Knight, G. P., & Silverman, W. K. (2009). Cross-ethnic measurement equivalence of the RCMAS in Latino and White youth with anxiety disorders. Journal of Personality Assessment, 91, 58-61.
51. Raad, J. M. (2013). Validation of the Revised Children's Manifest Anxiety Scale, (RCMAS-2) scores for children with specific learning disabilities (Doctoral dissertation). http://guides.lib.ku.edu/etd
52. Rachman, S., Grüter-Andrew, J., & Shafran, R. (2000). Post-event processing in social anxiety. Behaviour Research and Therapy, 38, 611-617.
53. R Core Team (2020). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. https://www.R-project.org
54. Reuland, M. M., & Teachman, B. A. (2014). Interpretation bias modification for youth and their parents: A novel treatment for early adolescent social anxiety. Journal of Anxiety Disorders, 28, 851-864.
55. Revelle, W. (2015). Psych: Procedures for personality and psychological research. http://personality-project.org/r
56. Reynolds, C. R., & Richmond, B. O. (1985). Revised children’s manifest anxiety scale (RCMAS) Manual. CA: Western Psychological Services.
57. Reynolds, C. R., & Richmond, B. O. (2008). The Revised Children’s Manifest Anxiety Scale, Second Edition (RCMAS-2). Los Angeles, CA: Western Psychological Services.
58. Rolstad, S., Adler, J., & Rydén, A. (2011). Response burden and questionnaire length: Is shorter better? A review and meta-analysis. Value in Health, 14, 1101-1108.
59. Rosseel, Y. (2012). Lavaan: An R package for structural equation modeling and more. Version 0.5–12 (BETA). Journal of Statistical Software, 48, 1-36.
60. Saviola, F., Pappaianni, E., Monti, A., Grecucci, A., Jovicich, J., & De Pisapia, N. (2020). Trait and state anxiety are mapped differently in the human brain. Scientific Reports, 10, 1-11.
61. Schaumberg, K., Zerwas, S., Goodman, E., Yilmaz, Z., Bulik, C. M., & Micali, N. (2019). Anxiety disorder symptoms at age 10 predict eating disorder symptoms and diagnoses in adolescence. Journal of Child Psychology and Psychiatry, 60, 686-696.
62. Schisler, T., Lander, J., & Fowler-Kerry, S. (1998). Assessing children’s state anxiety. Journal of Pain and Symptom Management, 16, 80-86.
63. Scholten, S., Velten, J., Bieda, A., Zhang, X. C., & Margraf, J. (2017). Testing measurement invariance of the Depression, Anxiety, and Stress Scales (DASS-21) across four countries. Psychological Assessment, 29, 1376.
64. Simon, E., Bos, A. E., Verboon, P., Smeekens, S., & Muris, P. (2017). Psychometric properties of the Youth Anxiety Measure for DSM-5 (YAM-5) in a community sample. Personality and Individual Differences, 116, 258-264.
65. Spence, S. H., Barrett, P. M., & Turner, C. M. (2003). Psychometric properties of the Spence Children’s Anxiety Scale with young adolescents. Journal of Anxiety Disorders, 17, 605-625.
66. Spielberger, C. D., Edwards, C. D., Lushene, R. E., Montuori, J., & Platzek, D. (1973). State-trait anxiety inventory for children. Palo Alto, CA: Consulting Psychologists Press.
67. Strauss, C. C., Last, C. G., Hersen, M., & Kazdin, A. E. (1988). Association between anxiety and depression in children and adolescents with anxiety disorders. Journal of Abnormal Child Psychology, 16, 57-68.
68. Van Oort, F. V. A., Greaves‐Lord, K., Verhulst, F. C., Ormel, J., & Huizink, A. C. (2009). The developmental course of anxiety symptoms during adolescence: The TRAILS study. Journal of Child Psychology and Psychiatry, 50, 1209-1217.
69. Van de Schoot, R., Lugtig, P., & Hox, J. (2012). A checklist for testing measurement invariance. European Journal of Developmental Psychology, 9, 486-492.
70. Varela, R. E., & Hensley-Maloney, L. (2009). The influence of culture on anxiety in Latino youth: A review. Clinical Child and Family Psychology Review, 12, 217-233.
71. Varela, R. E., & Biggs, B. K. (2006). Reliability and validity of the Revised Children's Manifest Anxiety Scale (RCMAS) across samples of Mexican, Mexican American, and European American children: A preliminary investigation. Anxiety, Stress and Coping: An International Journal, 19, 67-80.
72. Walkup, J. T., Albano, A. M., Piacentini, J., Birmaher, B., Compton, S. N., Sherrill, J. T., Ginsburg, G. S., Rynn, M. A., McCracken, J., Waslick, B., Iyengar, S., March, J. S., & Kendall, P. C. (2008). Cognitive behavioral therapy, sertraline, or a combination in childhood anxiety. New England Journal of Medicine, 359, 2753-2766.
73. Weems, C. F., Graham, R. A., Scott, B. G., Banks, D. M., & Russell, J. D. (2013). Suppressor effects and age differences in the expression of anxious emotion. Personality and Individual Differences, 55, 283-287.
74. Weisz, J. R., Suwanlert, S., Chaiyasit, W., Weiss, B., Achenbach, T. M., & Walter, B. R. (1987). Epidemiology of behavioral and emotional problems among Thai and American children: Parent re­ports for ages 6 to 11. Journal of the American Academy of Child and Adolescent Psychiatry, 26, 890-897.
75. Weitkamp, K., & Seiffge-Krenke, I. (2019). The association between parental rearing dimensions and adolescent psychopathology: A cross-cultural study. Journal of Youth and Adolescence, 48, 469-483.
76. Wells, A. (1995). Meta-cognition and worry: A cognitive model of generalized anxiety disorder. Behavioural and Cognitive Psychotherapy, 23, 301-320.
77. Whitmore, M. J., Kim-Spoon, J., & Ollendick, T. H. (2014). Generalized anxiety disorder and social anxiety disorder in youth: Are they distinguishable? Child Psychiatry and Human Development, 45, 456-463.
78. Wickham, H., Averick, M., Bryan, J., Chang, W., McGowan, L. D. A., François, R., Grolemund, G., Hayes, A., Henry, L., Hester, J., Kuhn, M., Pedersen, T. L., Miller, E., Bache, S. M., Muller, K., Ooms, J., Robinson, D., Seidel, D. P., . . . & Yutani, H. (2019). Welcome to the Tidyverse. Journal of Open Source Software, 4, 1686.
79. Wu, L. M., Liu, Y., Chen, H. M., Tseng, H. C., & Lin, W. T. (2016). Psychometric properties of the RCMAS-2 in pediatric cancer patients. European Journal of Oncology Nursing, 20, 36-41.
80. Yen, C. F., Ko, C. H., Wu, Y. Y., Yen, J. Y., Hsu, F. C., & Yang, P. (2010). Normative data on anxiety symptoms on the Multidimensional Anxiety Scale for Children in Taiwanese children and adolescents: Differences in sex, age, and residence and comparison with an American sample. Child Psychiatry and Human Development, 41, 614-623.
81. Zahn–Waxler, C., Klimes–Dougan, B., & Slattery, M. J. (2000). In­ternalizing problems of childhood and adolescence: Prospects, pitfalls, and progress in understanding the development of anxiety and depression. Development and Psychopathology, 12, 443-466.
82. Zhou, X., Zhang, Y., Furukawa, T. A., Cuijpers, P., Pu, J., Weisz, J. R., Yang, L., Hetrick, S. E., Giocane, C. D., Cohen, D., James, A. C., Yuan, S., Whittington, C., Jiang, X., Teng, T., Cipriani, A., & Xie, P. (2019). Different types and acceptability of psychotherapies for acute anxiety disorders in children and adolescents: A network meta-analysis. JAMA Psychiatry, 76, 41-50.
83. Zhu, Q., & Lowe, P. A. (2018). Examination of the psychometric properties of the Revised Children’s Manifest Anxiety Scale–Second Edition scores among Chinese secondary school students. Journal of Psychoeducational Assessment, 36, 725-735.