Psychometric Properties of Electronic Teacher Form of Psychological Mental Health Problems Scale in High School Students: Item Analysis and Internal Structure
Subject Areas :saeed akbari zardkhaneh 1 * , Farnaz Mehdipour Maralani 2 , Nader Mansurkiaie 3 , Alimohammad Zanganeh 4 , Mohsen Jallalat-Danesh 5 , Siamak Tahmasebi Garmtani 6 , Masoud Zareiyan 7
1 -
2 -
3 - Allameh Tabataba’I University
4 -
5 -
6 -
7 -
Keywords: adolescent mental healthscale developmentpsychometric properties,
Abstract :
Regarding the prevalence of mental disorders among students and the importance of screening devices in early identification and prevention of having disorders, the aim of present study was to develope an electronic device for screening mental health in high school students. The sample included 1346 high school teachers and students in Alborz, Kermanshah, Eastern Azerbaijan, Sistan & Baluchestan, Fars, and KhorasanRazavi Provinces. The teacher form consisted of 103 items. Items analysis based on 8 criteria showed that all the items except two of them were qualified. Principal component analysis using Varimax rotation showed that the most proper structure is 4-factor structure. But, according to confirmatory factor analysis, 8-Factor model was considered as the final model. Internal consistency of the device was sufficiently good, with coefficients ranging between 0.83 and 0.95. Correlation coefficients between items and subscales varied between 0.49 and 0.87 and correlation coefficients among factors ranged between 0.41 and 0.89. In general, psychometric properties of the Electronic Students Psychological Health Problem Scale (Teacher Form) indicated that it was suitable for screening and research.
اکبری¬زردخانه، سعید؛ آل¬بویه، مریم؛ زنگانه، علی¬محمد؛ منصورکیایی، نادر؛ جلالت¬دانش، محسن؛ و مهدوی، مجتبی (1396). نسخه گزارش والدین مقیاس سلامت روان‌شناختی کودکان: مطالعه مقدماتی ساخت و بررسی ویژگی¬های روان¬سنجی. فصلنامه سلامت¬روان کودک، ۴ (۴)؛ ۱۵۲-۱۶۴.
اکبری¬زردخانه، سعید؛ منصورکیایی، نادر؛ زنگانه، علی¬محمد؛ مهدوی، مجتبی؛ اصانلو، زهرا؛ جلالت¬دانش، محسن؛ طهماسبی¬گرمتانی، سیامک؛ زارعیان، مسعود؛ و طیموری¬فرد، سیدعین¬الله (1397). ساخت و بررسی روایی و اعتبار مقیاس مقدماتی خودگزارشی مشکلات سلامت روان‌شناختی دانش¬آموزان متوسطه دوم کشور. مجله پژوهش در سلامت روان‌شناختی، 12 (4)، 109-94.
حبیبی، مجتبی؛ مرادی، خدیجه؛ پورآوری، مینو؛ و صالحی، سمیّه (1394). بررسی میزان شیوع اختلالات رفتاري در دانش‌آموزان مقطع راهنمایی و متوسطه استان قم. مجله تخصصی اپیدمیولوژي ایران، 11(1)، 63-56.
خدایاری¬فرد، محمد؛ اکبری-زردخانه، سعید؛ پاک¬نژاد، محسن؛ غباری¬بناب، باقر؛ شکوهی¬یکتا، محسن؛ فقیهی، علی¬نقی؛ افروز، غلام¬علی؛ رحیمی¬نژاد، عباس؛ آذربایجانی، مسعود؛ باقری نوع¬پرست، خسرو؛ نرسیسیانس، آر. بی.¬؛ حمامی¬لاله¬زار، یونس؛ خلیلی، شیوا؛ سراج¬زاده، سیدحسین؛ نوربخش، یونس؛ فاطمی، سیدمحسن؛ کثیری، حمید؛ قیامی، زهرا؛ پورحسین، رضا؛ و هومن، حیدر¬علی (1395). ساخت مقياس بين¬المللي دينداري با رويكرد مقايسة بين فرهنگي. مجله روان¬شناسي، 20، 3-1.
خدایاری¬فرد، محمد؛ اکبری¬زردخانه، سعید؛ و زینالی، شیرین (1392). مقایسه ابعاد علائم وسواسی بی¬اختیاری: انطباق¬سازی نسخه فارسی (DOCS-F). مجله علوم رفتاری، 7، (4)، 388-379.
رحیمی¬موقر، آفرین؛ بابایی، نعمت الله؛ رستمی، محمدرضا (1382). بررسی شیوع کودک آزاری در دو منطقه تهران، رفاه اجتماعی، 7، 161-141.
سیف، علی¬اکبر (1386). روش¬های اندازه¬گیری و ارزشیابی آموزشی (چاپ هفتم). تهران: دوران.
غباري¬بناب، باقر؛ پرند، اكرم؛ حسين¬خانزاده ¬فيروزجاه، عباسعلي؛ موللي، گيتا و نعمتي، شهروز (1388). ميزان شيوع مشكلات رفتاري دانش¬آموزان مقطع ابتدايي شهر تهران. پژوهش در حيطه كودكان استثنايي، سال نهم، 3.
کلاین، پل (1393). راهنمای آسان تحلیل عاملی (ترجمه سیدجلال صدرالسادات و اصغر مینایی). تهران: سمت. (تاریخ انتشار به زبان اصلی 1993).
كشكولي، غضنفر (1379). بررسي همه‌گیرشناسی اخـتلالات رفتــاري كودكــان در مــدارس ابتــدايي شهرســتان بوشــهر. پایان¬نامه کارشناسی ارشد دانشگاه علوم پزشكي و خدمات بهداشـتي و درمـاني ايـران. انستيتو روان‌پزشکی تهران.
مایرز، لاورنس¬اس؛ گامست، گلن؛ و گوارینو، جی (1395). پژوهش چند متغیری کاربردی، (ترجمه حسن¬¬پاشا شریفی، ولی‌الله فرزاد، سیمین¬دخت رضاخانی، حمیدرضا حسن‌آبادی، بلال ایزانلو، و مجتبی حبیبی). تهران: رشد. (تاریخ انتشار به زبان اصلی 2006).
مقدم، مرضيه؛ ياسـمي، محمـدتقي؛ بينـا، مهـدي؛ عبـدالملكي، فريــدون و بــاقري¬يزدي، ســيد عبــاس (1381). مطالعــه اپيدميولوژيك اخـتلالات رفتـاري دانـش¬آمـوزان دبـستاني شهرستان قروه در سال 80-81. مجله دانـشگاه علـوم پزشكي كردستان، 7 (25).
مهرابـي، حـسين¬علي (1384). بررسـي ميـزان شـيوع اخـتلالات رفتاري در دانش‌آموزان دوره ابتدايي شهر اصفهان. اصفهان: سازمان آموزش‌وپرورش استان اصفهان.
نجاتی، وحید (1391). شيوع مشكلات رفتاري دانش¬آموزان ابتدايي در شهرستان‌هاي استان تهران. مجله علمي سازمان نظام پزشكي جمهوري اسلامي ايران، 30(2)، 167-162.
هومن، حیدرعلی (1395). تحلیل¬های چندمتغیری در پژوهش رفتاری. تهران: پیک فرهنگ. Arslan, G. (2016). Psychological maltreatment, emotional and behavioral problems in adolescents: The mediating role of resilience and self-esteem. Child Abuse and Neglect, 52, 200-209.
Asparouhov, T., & Muthen, B. (2010). Bayesian analysis of latent variable models using Mplus. (version 4) Technical Report. Los Angeles: Muthen & Muthen.
Bartett, M. S. (1950). Tests of significance in factor analysis. British Journal of Statistical Psychology, 3, 77-85.
Baxter, J., Kokaua, J., Wells, J. E., McGee, M. A., & Oakley Browne, M. A. (2006). Ethnic comparisons of the 12 month prevalence of mental disorders and treatment contact in Te Rau Hinengaro: The New Zealand Mental Health Survey. Australian and New Zealand Journal of Psychiatry, 40(10), 905-913.
Bearden, W. O., Sharma, S., & Teel, J. E. (1982). Sample size effects on chi square and other statistics used in evaluating casual models. Journal of Marketing Research, 19(4), 425-430.
Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88(3), 588-606.
Bester, G. (2013). Adolescent egocentrism in a learning context. Africa Education Review, 10(3), 393-409.
Björnsdotter, A., Enebrink, P., & Ghaderi, A. (2013). Psychometric properties of online administered parental strengths and difficulties questionnaire (SDQ), and normative data based on combined online and paper-and-pencil administration. Child and Adolescent Psychiatry and Mental Health, 7(1), 40. doi: 10.1186/1753-2000-7-40
Blakely Harris, T. B. & Sargent, A. J. (2010). Mental health issues: Child physical abuse and neglect. In I. A. P. Giardino, M. A. Lyn, & E. R. Giardino (Eds.), A practical guide to the evaluation of child physical abuse and neglect (pp. 477-497). New York: Springer.
Bollen, K. A. (1989). Structural equations with latent variables. New York: JohnWiley.
Bosqui, T. J., Maguire, A., Kouvonen, A., Wright, D., Donnelly, M., & O’Reilly, D. (2017). Ethnic density and risk of mental ill health - The case of religious sectarianism in Northern Ireland: A population data linkage study. Health & Place, 47(Supplement C), 29-35.
Campaign for Mental Health Reform (2005, May 11). A public health crisis: Children and adolescents with mental disorders. Congressional Briefings Call for Early Identification, Evaluation, and Treatment of Children’s Mental Disorders . Washington: US paper presented at the Congressional Briefing, www.mhreform.org/kids.
Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14, 464-504.
Comrey, A. L. & Lee, H. B. (1992). A first course in factor analysis. Hillsdale, NJ: Erlbaum.
Dillman, D. A., Smyth, J. D., & Christian, L. M. (2011). Internet, Mail, and Mixed-Mode Surveys: The Tailored Design Method. Hoboken, NJ: Wiley.
Dudley, B. S., Johnson, D. W., & Johnson, R. T. (1997). Using cooperative learning to enhance the academic and social experiences of freshman student athletes. The Journal of Social Psychology, 137(4), 449-459.
Edelbrock, C. (1979). Empirical classification of children’s behavior disorders: Progress based on parent and teacher ratings. School Psychology Digest, 8, 355-369.
Eklund, K., Renshaw, T. L., Dowdy, E., Jimerson, S. R., Hart, S. R., Jones, C. N., & Earha, J. (2009). Early identification of behavioral and emotional problems in youth: Universal screening versus teacher-referral identification. The California School Psychologist, 14, 89-95.
Epstein, R., & Muzzatti, L. (2011). Preliminary validation of an Online DSM-based mental health referral inventory. Journal of Technology in Human Services, 29(4), 284-295.
Epstein, R., Ho, M., Hyun, S., Le, C., Robertson, R. E., & Stout, D. (2017). A DSM-5-Based Online Mental Health Referral Inventory: A large-scale validation study. Journal of Technology in Human Services, 35(1), 231-247.
File, S. E., & Hyde, J. R. G. (2012). Can social interaction be used to measure anxiety? British Journal of Pharmacology, 62(1), 19-24.
Flora, D. B., & Curran, P. J. (2004). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods, 9, 466-491.
Frick, P. J., Burns, C., & Kamphaus, R. W. (2009). Clinical assessment of child and adolescent personality and behavior (2th ed.). New York: Springer.
Furlong, M. J., You, S., Renshaw, T. L., Smith, D. C., & O’Malley, M. D. (2014). Preliminary development and validation of the Social and Emotional Health Survey for Secondary School Students. Social Indictor Research, 117, 1011-1032.
Glover, T. A., & Albers, C. A. (2007). Considerations for evaluating universal screening assessments. Journal of School Psychology, 45(2), 117-135.
Guadagnoli, E., & Velicer, W. F. (1988). Relation of sample size to the stability of component patterns. Psychological Bulletin, 103, 265-275.
Heiligenstein, E., Guenther, G., Hsu, K., & Herman, K. (1996). Depression and academic impairment in college Students. Journal of American College Health, 45(2), 59-68.
Hill, L. G., Lochman, J. E., Coie, J. D., & Greenberg, M. T. (2004). Effectiveness of early screening for externalizing problems: Issues of screening accuracy and utility. Journal of Consulting and Clinical Psychology, 72, 809-820.
Horn, J. L. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30, 179-185.
Howell, D. C. (2007). Statistical methods for psychology (6th ed). Belmont, California: Duxbury Press.
Jellinek, M. S., Murphy, J. M., & Burns, B. J. (1986). Brief psychosocial screening in outpatient pediatric practice. The Journal of Pediatrics, 109, 371–377.
Jones, P. (2013). Adult mental health disorders and their age at onset. British Journal of Psychiatry, 202 (54), 5-10.
Jungrim, M. A. W., & Mendenhall, A. (2017). Educators' perceptions of youth mental health: Implications for training and the promotion of mental health services in schools. Children and Youth Services Review, 73, 384-391.
Kaiser, H. F. (1958). The varimax criterion for analytic rotation in factor analysis. Psychometrika, 23, 187-200.
Kaiser, H. F. (1974). An index of factorial simplicity. Psychometrika, 39, 31-36.
Kamphaus, R. W., & Frick, P. J. (2002). Clinical assessment of child and adolescent personality and behavior (2 ed.). Boston: Allyn & Bacon.
Kamphaus, R. W., & Reynolds, C. R. (2007). Behavior assessment system for children, (BASC-2): Behavioral and emotional screening system (BESS) (2 ed.). Bloomington: Pearson.
Lochman, J. E. (1995). Screening of child behavior problems for prevention programs at school entry. Journal of Consulting and Clinical Psychology, 63, 549–559.
Madariaga, L., Nussbaum, M., Burq, I., Marañón, F., Salazar, D., Maldonado, L., Alarcón, C., & Naranjo, M. A. (2017). Online survey: A national study with school principals. Computers in Human Behavior, 74(Supplement C), 35-44.
Magnin, E., & Maurs, C. (2017). Attention-deficit/hyperactivity disorder during adulthood. Revue Neurologique, 173(7-8), 506-515.
McCoy, S., & Marks, P. (2001). Using electronic surveys to collect data: Experiences from the field. Seventh, Americas Conference on Information Systems, 290, 1502-1501.
Mitchell, M. L., & Jolley, J. M. (2004). Research design explained. (5th ed).Victoria: Wadsworth Publisher.
Muñoz Reyes, J. A., Guerra, R., Polo, P., Cavieres, E., Pita, M., & Turiégano, E. (2017). Using an evolutionary perspective to understand the relationship between physical aggression and academic performance in late adolescents. Journal of School Violence, 18(1), 39-48.
Nunnally, J, O. (1986). Psychometric theory. New York: McGraw- Hill.
Pagano, M. E., Cassidy, L. J., Little, M., Murphy, J. M., & Jellinek, M. S. (2000). Identifying psychosocial dysfunction in school-age children: The Pediatric Symptom Checklist as a self-report measure. Psychology in the Schools, 37(2), 91-106.
Pearson, R. H. (2008). Recommended sample size for conducting exploratory factor analysis on dichotomous data. Journal of Modern Applied Statistical Methods, 9(2), 358-365.
Rosseel, Y. (2012). lavaan: An R Package for Structural Equation Modeling and More. version 0.4-11 (BETA). Journal of Statistical Software, 48(2), 1-36.
Severson, H. H., Walker, H. M., Hope-Doolittle, J., Kratochwill, T. R., & Gresham, F. M. (2007). Proactive, early screening to detect behaviorally at-risk students: Issues, approaches, emerging innovations, and professional practices. Journal of School Psychology, 45, 193-223.
Silva, E., Machado, B. C., Moreira, C. S., Ramalho, S., & Gonçalves, S. (2017). Romantic relationships and nonsuicidal self-injury among college students:The mediating role of emotion regulation. Journal of Applied Developmental Psychology, 50, 36-44.
Stiffler, M. C., & Dever, B. V. (2015). Mental health screening at school: instrumentation, implementation and critical issues. USA: Springer International Publishing, Switzerland.
Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics (5th ed.). NewYork: Harper Collins.
Tabachnick, B. G., & Fidell, L. S. (2013). Using multivariate statistics (6th ed.). Boston, MA: Pearson.
Tukey, J. W. (1977). Exploratory data analysis. Reading, MA: Addison- Wesley.
Turner, N. E. (1998). The effect of common variance and structure pattern on random data eigenvalues: Implications for the accuracy of parallel analysis. Educational and Psychological Measurement, 58, 541-568.
United States Public Health Service (2000). Report of the surgeon general’s conference on children’s mental health: A national action agenda. Washington D.C. Department of Health and Human Services, 17-24.
Walker, H. M., Small, J. W., Severson, H. H., Seeley, J. R., & Feil, E. G. (2014). Multiple- gating approaches in universal screening within school and community settings. In R. J. Kettler, T. A. Glover, C. A. Albers, & K. A. Feeney-Kettler (Eds.), Universal screening in educational settings: Evidence-based decision making for schools (pp. 47-75). Washington DC: American Psychological Association.
Weisz, J. R., Sandler, I. N., Durlak, J. A., & Anton, B. S. (2005). Promoting and protecting youth mental health through evidence-based prevention and treatment. American Psychologist, 60, 628-648.
World Health Organization (2017). Maternal, newborn, child and adolescent health. Retrieved October 20, 2017, From http://www.who.int.
Yuen, W. W. Y., Liu, L. L., & Tse, S. (2019). Adolescent mental health problems in Hong Kong: A critical review on prevalence, psychosocial correlates, and prevention. Journal of Adolescent Health, 64(6), 73-85.