Research in Physical Education, Sport and Health
2025, Vol. 14, No. 2, pp. 3–9
ISSN (Print): 1857-8152; ISSN (Online): 1857-8160

Original scientific paper

Open Access

PSYCHOMETRIC PROPERTY TESTING OF THE KIDSCREEN-27 INSTRUMENT IN 11-YEAR-OLD CHILDREN IN KOSOVO
Ardonit Xhemajli¹ ORCID iD, Mitrichka Dzambazovska Stardelova² ORCID iD, Slavica Novacevska² ORCID iD, Visar Ganiu³ ORCID iD
¹ Faculty of Physical Education and Sport, University of Pristina, Kosovo
² Faculty of Physical Education, Sport and Health, Ss. Cyril and Methodius University, Skopje, Republic of North Macedonia
³ Faculty of Physical Education, University of Tetovo, Tetovo, Republic of North Macedonia
:                        

Download PDF

 

Abstract

Designed to assess health-related quality of life among young populations, the Albanian version of the KIDSCREEN-27 ensures dependable evaluations in culturally diverse environments. The aim of the study was to examine the suitability of the instrument in evaluating various dimensions of health-related quality of life. The research included 143 eleven-year-old students from public primary schools in Gjilan, Republic of Kosovo.The study used advanced and robust statistical methods, such as Exploratory and Confirmatory Factor Analysis (EFA and CFA) to assess the structure of the construct, along with measuring internal consistency through Cronbach’s coefficient, while the use of T-scores enabled cross-cultural comparisons, relying on appropriate statistical tools such as SPSS and Jamovi for psychometric assessment. Statistical analysis showed that the six-factor adaptation of the KIDSCREEN-27 provides a better fit for the data from 11-year-old children in Kosovo compared to the original five-factor framework. This updated model exhibited strong fit indicators (CFI = 0.98; RMSEA = 0.075) alongside a more distinct conceptual organization. Additionally, the internal reliability was satisfactory (α = 0.71–0.82), with minimal presence of ceiling or floor effects.Factor loadings were higher and more stable in the six-factor model. Several significant gender differences were identified, with boys scoring higher in certain dimensions. Overall, the instrument proves to be suitable and valid for use within the cultural and social context Republik of Kosovo.
Keywords:
Quality of Life; Gender Differences; Cultural and Social Context; KIDSCREEN-27; Children; Kosovo

 

Introduction

Recently, interest has grown in assessing children’s health-related quality of life as overall well-being, not just absence of illness. Various researchers have emphasized that children’s health should not be reduced to the assessment of their physical condition alone. According to (Ravens-Sieberer et al., 2007; Michalos, 2014; Befus et al., 2023), children’s well-being is not only related to the physical aspect of health, but also includes emotional, social and behavioral dimensions. The work of (Power et al., 2019; Solans et al., 2008; Taylor et al., 2008; Higginson & Carr, 2001; Eiser & Morse, 2001; Cieza & Stucki, 2005), have contributed significantly to the development of these tools and their adaptation to different cultural and social contexts.

According to Duncan (1984) and DeVellis & Thorpe (2021), measurement accuracy is a fundamental pillar of scientific research, especially when it comes to assessing health-related quality of life during childhood. In this regard, several general instruments adapted for children have been developed and are widely integrated into clinical practice, public health programs and health policy evaluations (Solans et al., 2008; Verstraete et al., 2020). Some of the most popular tools include the YQOL-R (Edwards et al., 2002; Patrick et al., 2002), the CHQ (Landgraf et al., 1998) and the KIDSCREEN questionnaire group (KIDSCREEN Group Europe, 2006).

KIDSCREEN-27 is a concise yet thorough tool developed to evaluate the health-related quality of life among children and adolescents aged 8 to 18. The instrument focuses on five main aspects: physical and emotional well-being, degree of autonomy and family ties, peer support, and experience in the school

 

environment (Budler et al., 2022). This questionnaire has been tested and validated in many languages and cultures, and has found widespread use in both education and health interventions (Ravens-Sieberer et al., 2001, 2005, 2006)

This KIDSCREEN-27 form has been evaluated for its practical importance, as it helps reduce test taker monotony (Khan et al., 2017; Ravens-Sieberer et al., 2010; Locker & Allen, 2002; Huebner et al., 2004). However, reducing the number of items in a measurement instrument requires careful psychometric evaluation, to ensure that the theoretical validity and inclusion of all key dimensions of the concept are not compromised (Pollak et al., 2006; Muehlan, 2010)

International studies have shown that the factor structure of the KIDSCREEN-27 instrument can vary depending on the cultural context and sample characteristics. For this reason, some research has suggested alternative models with more than five factors, in order to more accurately represent the latent construct of data in different populations (Jafari et al., 2012; Cilar Budler et al., 2022; Power et al., 2019; Li et al., 2024; Shannon et al., 2017; Ravens-Sieberer et al., 2014).

This study aims to evaluate the psychometric properties of the Albanian version of KIDSCREEN-27 among 11-year-old children in Kosovo, a group that has not been previously examined in validation studies.Using exploratory and confirmatory factor analyses, the study examines model fit, internal consistency, ceiling and floor effects, as well as gender differences.

 

Methods

Participants

The study involved 11-year-old boys and girls attending public primary schools across Kosovo. This age group was chosen due to its developmental importance and the need for early assessment of health-related quality of life (HRQoL).The study included 11-year-old male and female children who were regular students in public primary schools across Kosovo. The selection of participants at this age was motivated by the specific developmental characteristics of this stage and the need to undertake early assessments of HRQoL, which may inform preventive and supportive interventions.

The study’s final sample consisted of 143 pupils 82 boys and 61 girls recruited from various public primary schools in Gjilan, the capital of Kosovo. A non-probability convenience sampling method was used, and participants were included based on the following criteria: (1) parental or guardian written consent, (2) consistent school attendance, and (3) adequate cognitive capacity to comprehend and independently complete the questionnaire.

Minor children involved in the research and their legal guardians were clearly and fully informed about the purpose of the research, the voluntary nature of participation, the strict preservation of data confidentiality, and the ethical principles of the Declaration of Helsinki were respected, protecting the dignity and well-being of children participating in the research.

Measurement Instrument

The KIDSCREEN-27 questionnaire was used to assess health-related quality of life (HRQoL), where this instrument assesses five main domains of children’s quality of life – covering physical and mental health, family relationships, peer support and school experience – through 27 questions (Ravens-Sieberer et al., 2007). Ky instrument është krijuar, strukturuar, testuar dhe vërtetuar si i saktë. Responses are given on a five-point Likert scale, reflecting either frequency or intensity of experiences during the past week.

Data Analysis

For each of the five dimensions included in the KIDSCREEN-27 instrument, arithmetic means and standard deviations were calculated in order to describe the overall distribution of the results. The data were then converted into standardized T-scores following the KIDSCREEN methodological guidelines, which allows for direct comparison of these results with those of international studies and supports cross-cultural assessments of child well-being. In the evaluation if 15% of the participants scored the maximum or minimum possible score, to identify limitations in the distribution of the results.

Internal consistency of the scales was evaluated using Cronbach’s alpha coefficient, with values above

0.60 considered acceptable, particularly for scales with fewer items. To examine gender differences, one-way analyses of variance (ANOVA) were conducted for both the original and modified model dimensions, applying a significance level of p < 0.05 and interpreting effect size using partial eta squared (η²).

 

For exploratory analysis of factors (EFA) I use the Principal Axis Factoring method, together with the rotational oblique Promax, which allows the connection between factors an approach that is suitable for the psychological construct of interrelationships. The goodness of fit of this analysis was assessed through the Kaiser-Meyer-Olkin (KMO) index and Bartlett’s test of sphericity, which indicated favorable conditions for factor analysis.

Factor analysis was performed in two stages. Initially, Kaiser’s criterion (characteristic value greater than 1) was applied, which suggested the existence of seven factors. In the second step, the extraction of six factors was predicted, in accordance with the theoretical basis and the data of the confirmatory analysis. Factor loadings with values ≥ 0.30 were considered significant for interpretation.

All statistical analyses were conducted using IBM SPSS Statistics (v28). Confirmatory Factor Analysis (CFA) was performed in Jamovi (v2.4.8) using the SEM module (semLavaan) with DWLS estimation, appropriate for ordinal and categorical data.

Initially, the theoretical model with five factors was tested, which matches the original structure of KIDSCREEN-27, while an alternative model with six factors was then evaluated, based on the findings of the exploratory analysis.

Due to the sensitivity of the χ² test to sample size, model fit evaluation focused primarily on the CFI and TLI indicators. Values above 0.95 for these indices and an RMSEA ≤ 0.06 are considered indicative of a good model fit to the data. The combined analytical approach used in this study enabled an in-depth and reliable examination of the psychometric structure of the KIDSCREEN-27 instrument, assessing its suitability for 11-year-old children in the Kosovo context. The parallel use of exploratory and confirmatory analysis strengthens the interpretation of the results and provides a solid basis for decision-making about future use of the scale in similar settings.

 

Results

Results Descriptive data for the original five-factor and modified six-factor models of the KIDSCREEN-27 instrument are presented in Table 1. In the five-factor model, Cronbach’s alpha reliability coefficients ranged between 0.75 and 0.82, while the standardized T-scores were close to the normative mean (M = 50; SD = 10), reflecting good internal consistency and adequate normalization of the scores. Ceiling and floor effects were very low (<1.5%), indicating good sensitivity of the measurement tools. In the case of the six-factor model, alpha values ranged from 0.71 to 0.79, with raw score means ranging from 8.94 to 17.75 and minimal ceiling effects (up to 2.8%), indicating acceptable psychometric stability and stable distribution of responses.

Table 1. Descriptive statistics: Raw and T-scale means, standard deviations, internal consistency (Cronbach’s α), and floor/ceiling effects

Screenshot 2026-02-03 at 22.49.27

Note: Raw M = Mean of raw scores, Raw SD = Standard deviation of raw scores, T M = Mean of T-scores (standardized to M = 50, SD = 10), T SD = Standard deviation of T-scores, α = Cronbach’s alpha (internal consistency), n/a = Not applicable for the revised structure

References

Befus, E. G., Helseth, S., Mølland, E., Westergren, T., Fegran, L., & Haraldstad, K. (2023). Use of KIDSCREEN health-related quality of life instruments in the general population of children and adolescents: A scoping review. Health and Quality of Life Outcomes, 21, Article 6. https://doi.org/10.1186/s12955-023-02088-z

Budler, L. C., Pajnkihar, M., Ravens-Sieberer, U., Barr, O., & Stiglic, G. (2022). The KIDSCREEN-27 scale: Translation and validation study of the Slovenian version. Health and Quality of Life Outcomes, 20(1), 67. https://doi.org/10.1186/s12955-022-01973-3

Cieza, A., & Stucki, G. (2005). Content comparison of health-related quality of life (HRQOL) instruments based on the International Classification of Functioning, Disability and Health (ICF). Quality of Life Research, 14(5), 1225–1237. https://doi.org/10.1007/s11136-004-4773-0

DeVellis, R. F., & Thorpe, C. T. (2021). Scale development: Theory and applications (5th ed.). Sage. Duncan, O. D. (1984). Notes on social measurement: Historical and critical. Russell Sage Foundation.

Edwards, T. C., Huebner, C. E., Connell, F. A., & Patrick, D. L. (2002). Adolescent quality of life, part I: Conceptual and measurement model. Journal of Adolescence, 25(3), 275–286. https://doi.org/10.1006/jado.2002.0470

Eiser, C., & Morse, R. (2001). A review of measures of quality of life for children with chronic illness. Archives of Disease in Childhood, 84(3), 205–211. https://doi.org/10.1136/adc.84.3.205

Feeny, D., Furlong, W., Mulhern, R. K., Barr, R. D., & Hudson, M. (1999). A framework for assessing health-related quality of life among children with cancer. International Journal of Cancer, 83(Suppl. 12), 2–9. https://doi.org/10.1002/(SICI)1097-0215(1999)83:12+<2::AID-IJC2>3.0.CO;2-M

Garber, A. M., & Phelps, C. E. (1997). Economic foundations of cost-effectiveness analysis. Journal of Health Economics, 16(1), 1–31. https://doi.org/10.1016/S0167-6296(96)00506-1

Higginson, I. J., & Carr, A. J. (2001). Measuring quality of life: Using quality of life measures in the clinical setting. BMJ, 322(7297), 1297–1300. https://doi.org/10.1136/bmj.322.7297.1297

Huebner, E. S., Valois, R. F., Suldo, S. M., Smith, L. C., McKnight, C. G., Seligson, J. L., & Zullig, K. J. (2004). Perceived quality of life: A neglected component of adolescent health assessment and intervention. Journal of Adolescent Health, 34(4), 270–278 https://doi.org/10.1016/j.jadohealth.2003.07.007

Jafari, P., Bagheri, Z., & Safe, M. (2012). Item and response-category functioning of the Persian version of the KIDSCREEN-27: Rasch partial credit model. Health and Quality of Life Outcomes, 10, 127. https://doi.org/10.1186/1477-7525-10-127

Jokovic, A., Locker, D., & Guyatt, G. (2006). Short forms of the child perceptions questionnaire for 11–14-year-old children (CPQ11–14): Development and initial evaluation. Health and Quality of Life Outcomes, 4, Article 4. https://doi.org/10.1186/1477-7525-4-4

Kaplan, R. M., & Bush, J. W. (1982). Health-related quality of life measurement for evaluation research and policy analysis. Health Psychology, 1(1), 61–80. https://doi.org/10.1037/0278-6133.1.1.61

Khan, S., Tangiisuran, B., Imtiaz, A., & Zainal, H. (2017). Health status and quality of life in tuberculosis: Systematic review of study design, instruments, measuring properties and outcomes. Health Science Journal, 11(1), Article 484. https://doi.org/10.21767/1791-809X.1000484

Landgraf, J. M., Maunsell, E., Speechley, K. N., Bullinger, M., Campbell, S., Abetz, L., & Ware, J. E., Jr. (1998). Canadian-French, German and UK versions of the Child Health Questionnaire: Methodology and preliminary item scaling results. Quality of Life Research, 7, 433–445. https://doi.org/10.1023/A:1008810004694

Li, J., Zhu, Y., Zhu, G., Qiu, Z., Wang, J., Kaman, A., … & Ravens-Sieberer, U. (2024). Measuring health-related quality of life in a Chinese Mainland adolescent population: Psychometric properties of the Mandarin Chinese self-reported KIDSCREEN-27 and KIDSCREEN-10 index. BMC Psychology, 12(1), 600. https://doi.org/10.1186/s40359-024-01876-6

Locker, D., & Allen, P. F. (2002). Developing short-form measures of oral health-related quality of life. Journal of Public Health Dentistry, 62(1), 13–20. https://doi.org/10.1111/j.1752-7325.2002.tb03415.x

Michalos, A. C. (Ed.). (2014). Encyclopedia of quality of life and well-being research. Springer. https://doi.org/10.1007/978-94-007-0753-5

Muehlan, H. (2010). Developing the DCGM-12: A short-form of the DISABKIDS condition-generic module assessing health related quality of life in children and adolescents with chronic conditions [Doctoral dissertation, University of Hamburg]. Universität Hamburg. https://ediss.sub.uni-hamburg.de/handle/ediss/3344

Ng, J. Y., Burnett, A., Ha, A. S., & Sum, K. W. (2015). Psychometric properties of the Chinese (Cantonese) versions of the KIDSCREEN health-related quality of life questionnaire. Quality of Life Research, 24, 2415–2421. https://doi.org/10.1007/s11136-015-0973-z

Patrick, D. L., Edwards, T. C., & Topolski, T. D. (2002). Adolescent quality of life, part II: Initial validation of a new instrument. Journal of Adolescence, 25(3), 287–300. https://doi.org/10.1006/jado.2002.0471.

Pollak, E., Mühlan, H., Von Mackensen, S., Bullinger, M., & The Haemo-QoL Group. (2006). The Haemo-QoL Index: Developing a short measure for health-related quality of life assessment in children and adolescents with haemophilia. Haemophilia, 12(4), 384–392. https://doi.org/10.1111/j.1365-2516.2006.01292.x

Power, R., Akhter, R., Muhit, M., Badawi, N., & Khandaker, G. (2019). Cross-cultural validation of the Bengali version KIDSCREEN-27 quality of life questionnaire. BMC Pediatrics, 19, Article 19. https://doi.org/10.1186/s12887-018-1373-7 Ravens-Sieberer, U., Auquier, P., Erhart, M., Gosch, A., Rajmil, L., Bruil, J., … & European KIDSCREEN Group. (2007). The

KIDSCREEN-27 quality of life measure for children and adolescents: Psychometric results from a cross-cultural survey in 13 European countries. Quality of Life Research, 16(8), 1347–1356. https://doi.org/10.1007/s11136-007-9240-6

Ravens-Sieberer, U., Erhart, M., Rajmil, L., Herdman, M., Auquier, P., Bruil, J., … & European KIDSCREEN Group. (2010). Reliability, construct and criterion validity of the KIDSCREEN-10 score: A short measure for children and adolescents’ well-being and health-related quality of life. Quality of Life Research, 19, 1487–1500. https://doi.org/10.1007/s11136-010-9706-5

Ravens-Sieberer, U., Gosch, A., Rajmil, L., Erhart, M., Bruil, J., Duer, W., … & European KIDSCREEN Group. (2005). KIDSCREEN-52 quality-of-life measure for children and adolescents. Expert Review of Pharmacoeconomics & Outcomes Research, 5(3), 353–364. https://doi.org/10.1586/14737167.5.3.353

Ravens-Sieberer, U., Herdman, M., Devine, J., Otto, C., Bullinger, M., Rose, M., & The European KIDSCREEN Group. (2014). The European KIDSCREEN approach to measure quality of life and well-being in children: Development, current application, and future advances. Quality of Life Research, 23, 791–803. https://doi.org/10.1007/s11136-013-0428-3

Shannon, S., Ó Laoide, A., Fitzpatrick, C., & Dooley, B. (2017). Testing the psychometric properties of KIDSCREEN-27 with Irish children of low socio-economic status. Quality of Life Research, 26, 1081–1089. https://doi.org/10.1007/s11136-016-1432-1

Solans, M., Pane, S., Estrada, M. D., Serra-Sutton, V., Berra, S., Herdman, M., Alonso, J., & Rajmil, L. (2008). Health-related quality of life measurement in children and adolescents: A systematic review of generic and disease-specific instruments. Value in Health, 11(4), 742–764. https://doi.org/10.1111/j.1524-4733.2007.00293.x

Taylor, R. M., Gibson, F., & Franck, L. S. (2008). A concept analysis of health-related quality of life in young people with chronic illness. Journal of Clinical Nursing, 17(14), 1823–1833. https://doi.org/10.1111/j.1365-2702.2008.02379.x

Tengs, T. O. (2004). Cost-effectiveness versus cost–utility analysis of interventions for cancer: Does adjusting for health-related quality of life really matter? Value in Health, 7(1), 70–78. https://doi.org/10.1111/j.1524-4733.2004.71246.x

The KIDSCREEN Group Europe. (2006). The KIDSCREEN questionnaires: Quality of life questionnaires for children and adolescents. Pabst Science Publishers.

Torrance, G. W. (1997). Preferences for health outcomes and cost–utility analysis. American Journal of Managed Care, 3(Suppl.5), S8–S20. https://www.ajmc.com/view/may97-1381ps008-s020

Varni, J. W., Limbers, C. A., & Burwinkle, T. M. (2007). Impaired health-related quality of life in children and adolescents with chronic conditions: A comparative analysis of 10 disease clusters and 33 disease categories/severities utilizing the PedsQL 4.0 generic core scales. Health and Quality of Life Outcomes, 5, Article 43. https://doi.org/10.1186/1477-7525-5-43

Verstraete, J., Ramma, L., & Jelsma, J. (2020). Item generation for a proxy health related quality of life measure in very young children. Health and Quality of Life Outcomes, 18, Article 11. https://doi.org/10.1186/s12955-020-1271-1