Citation: Aguilar-Zafra, S.; del Corral, T.; Valera-Calero, J.A.; Martín-Casas, P.; Plaza-Manzano, G.; López-de-Uralde-Villanueva, I. Development of the Web-Based Spanish Version of the Barthel Index in Patients with Multiple Sclerosis. Int. J. Environ. Res. Public Health 2022, 19, 13965. https://doi.org/10.3390/ ijerph192113965 Academic Editors: Paul B. Tchounwou and Cristoforo Comi Received: 14 September 2022 Accepted: 24 October 2022 Published: 27 October 2022 Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affil- iations. Copyright: © 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https:// creativecommons.org/licenses/by/ 4.0/). International Journal of Environmental Research and Public Health Article Development of the Web-Based Spanish Version of the Barthel Index in Patients with Multiple Sclerosis Sandra Aguilar-Zafra 1,2,3, Tamara del Corral 4,5,* , Juan Antonio Valera-Calero 6 , Patricia Martín-Casas 4,5 , Gustavo Plaza-Manzano 4,5 and Ibai López-de-Uralde-Villanueva 4,5 1 Departamento de Fisioterapia, Facultad de Ciencias de la Salud, Centro Superior de Estudios Universitarios La Salle, Universidad Autónoma de Madrid, 28049 Madrid, Spain 2 Motion in Brains Research Group, Centro Superior de Estudios Universitarios La Salle, Universidad Autónoma de Madrid, 28049 Madrid, Spain 3 Téxum S.L Physiotherapy Center, 28821 Madrid, Spain 4 Department of Radiology, Rehabilitation and Physiotherapy, Faculty of Nursing, Physiotherapy and Podiatry, Universidad Complutense de Madrid, 28040 Madrid, Spain 5 Instituto de Investigación Sanitaria del Hospital Clínico San Carlos (IdISSC), 28040 Madrid, Spain 6 VALTRADOFI Research Group, Department of Physical Therapy, Universidad Camilo José Cela, 28692 Villanueva de la Cañada, Spain * Correspondence: tamdelco@ucm.es; Tel.: +34-91-394-15-17 Abstract: Background: The aims of this study were to develop a web-based Spanish form of the Barthel index (BI), to evaluate its psychometric properties and stability over time (test-retest), and to determine minimal detectable change (MDC) in patients with multiple sclerosis (MS). Methods: Participants answered the BI on two forms (web-based and face-to-face interview), 7–10 days apart. The internal consistency was evaluated using Cronbach’s alpha, and intraclass correlation (ICC) and kappa (κ) coefficients were used to investigate the agreement between both forms. Results: 143 participants were included. The Spanish web-based form of the BI showed excellent agreement between both forms for each item (κ = 0.86 (0.79 to 0.92), and for total score (κ = 0.87 (0.81 to 0.93); ICC = 0.99 (0.98 to 0.99). The internal consistency was good–excellent (Cronbach’s alpha = 0.89 (0.86–0.91)). The stability over time was adequate, the agreement of each item was κ = 0.63 (0.52–0.74)), and for total score (ICC = 0.97), determining a MDC95 of 12.09 points. Conclusions: The Spanish web-based form of the BI is a valid and reliable tool to assess functionality and can be applied in both formats in patients with MS. A total score difference of more than 12 points was found to indicate a deterioration or improvement in the patient’s functionality. Keywords: disability evaluation; activities of daily living; multiple sclerosis; web-based intervention; test-retest reliability 1. Introduction Multiple sclerosis (MS) is an inflammatory disorder characterized by demyelination of the central nervous system, which causes sensory, physical, and psychological damage, as well as impairment of functional capacities [1]. It is the most common non-traumatic disabling neurological disease in young adults, especially in women [2]. MS is associated with a substantial negative impact on quality of life and activities of daily living [3], leading to varying degrees of disability and loss of functional independence over time [4]. Both the initial disease course and the disability-related factors have been found to be predictors of the malignant course of the disease [5], which have a major impact on healthcare systems, with more substantial economic consequences than treatment [6]. Many existing scales quantify the patient’s degree of disability and measure their dependence upon others in basic daily activities. The Expanded Disability Status scale (EDSS) [7] is the most widely used tool for the measurement of disability and impairment Int. J. Environ. Res. Public Health 2022, 19, 13965. https://doi.org/10.3390/ijerph192113965 https://www.mdpi.com/journal/ijerph https://doi.org/10.3390/ijerph192113965 https://doi.org/10.3390/ijerph192113965 https://creativecommons.org/ https://creativecommons.org/licenses/by/4.0/ https://creativecommons.org/licenses/by/4.0/ https://www.mdpi.com/journal/ijerph https://www.mdpi.com https://orcid.org/0000-0002-3144-5411 https://orcid.org/0000-0002-3379-8392 https://orcid.org/0000-0002-5889-1841 https://orcid.org/0000-0003-1596-5027 https://orcid.org/0000-0001-7474-5257 https://doi.org/10.3390/ijerph192113965 https://www.mdpi.com/journal/ijerph https://www.mdpi.com/article/10.3390/ijerph192113965?type=check_update&version=1 Int. J. Environ. Res. Public Health 2022, 19, 13965 2 of 15 caused by MS. However, it might not adequately reflect the patient’s own perceptions of the impact of symptoms on their overall health status and their quality of life, given that some functional areas are not sufficiently assessed, such as mood, energy levels and quality of life [8]. The Incapacity Status scale [9] is another method of quantifying disability by testing the ability to perform activities of daily living; the functional independence measure [10] records the severity of disability. However, none of these scales are sensitive to the types of changes that occur in MS [11]. Based on these problems, the Barthel index (BI) can be considered a solution. The BI is a 10-item activities of daily living ordinal scale used primarily for disability measurement [12]. The values assigned to each item are based on the time and amount of physical assistance required for a patient to perform a common daily activity. It is highly recommended because is easy to perform, fully self-managed, and can be completed by caregivers, thus increasing user compliance; it is not dependent on an updated report from a neurologist [13]. The BI is highly correlated with the EDSS, but it is more sensitive in detecting changes [13,14]. The BI is also strongly associated with in-hospital mortality, discharge destination, and length of stay [15], and it has proven its prognostic utility [16]. The BI has been shown to be a valid tool for assessing the degree of functional dis- ability in patients with MS [13,17], as well as in patients with other neurological patholo- gies [18–20], when applied in a face-to-face interview format. However, the COVID-19 pandemic has forced all healthcare providers to be adaptive and innovative in their patient care so as to maintain adequate social distancing and to reduce the risk of disease transmis- sion, especially in vulnerable populations such as patients with MS. Among the measures taken, hospital visits have been limited to a minimum, and telematic consultations have increased [21], which emphasizes the need for non-traditional self-administered pencil and paper format assessment tools. There are validated versions of the BI adaptations for application to telephone and postal formats [22–24]. However, a web-based form of the BI could be a suitable alternative for the evaluation of patients with MS who have restricted mobility because it would consume fewer human and material resources. Currently, the Spanish version of the BI has only been validated in elderly people by means of a combined application in the face-to-face interview and postal formats [25], It is important to note that the validity of a scale is not a property of the tool itself, but of the interpretation of the assessment instrument with a specific population [26]. Thus, we considered it relevant to develop and evaluate the metric properties of a Spanish web-based form of the BI in patients with MS. The aim of this study was to develop a web-based Spanish form of the BI and to evaluate its psychometric properties in patients with MS. An additional aim was to evaluate the stability of the scale results over time (test-retest), as well as to determine the minimum difference necessary to consider that there has been a real change (minimal detectable change, MDC). 2. Materials and Methods 2.1. Study Design, Setting and Participants This was an observational and longitudinal study in accordance with the criteria established by the Consensus-based Standards for the Selection of Health Status Measure- ment Instruments guidelines [27]. The study was approved by the ethics committee of the Complutense University of Madrid (registration number: CE_20220120-09_SAL) and was conducted in accordance with the Declaration of Helsinki. The sample was recruited from the following centers in the Community of Madrid area: Móstoles Multiple Sclerosis Association, Téxum S.L Physiotherapy Centre, Parla Association of Multiple Sclerosis, Collado Villalba Association of Multiple Sclerosis and Multiple Sclerosis Foundation, using a method of consecutive sampling by convenience. The selection criteria established were as follows: clinically definite MS according to 2017 Thompson criteria [28]; at least 18 years of age; clinical stability (no relapses within 30 days prior to the inclusion in the study); ability to speak and read the Spanish language; ability Int. J. Environ. Res. Public Health 2022, 19, 13965 3 of 15 to understand the questionnaires and scales; and having internet access. Written informed consent was obtained from all the participants. 2.2. Study Procedures An independent investigator, by means of a telephone call, ensured that the patients met the inclusion criteria for the study and informed them whether they should complete the web-based form of the BI before or after attending the face-to-face interview. This assignment order was generated randomly prior to the interview. During this phone call, the investigator explained the study procedure, asked the participant to continue with their daily routine, and requested an e-mail address to send them reminders and instructions for the correct execution of the study. During the face-to-face interview, an evaluator administered the BI, the EDSS and the EuroQol-5D questionnaire (EQ-5D-5L), following a randomized order. If the patients were physically unable to respond, their caregivers did so. The examiner recorded the patient’s anthropometric and sociodemographic characteristics, as well as specific clinical characteristics (e.g., type of MS, comorbidities). For the online completion of the web-based form of the BI, an e-mail was sent to the patients that included their identification number along with a direct link to the web page where they had access to the web version of the scale. This email was sent 3–4 h before or after their face-to-face interview (during which time they were encouraged to engage in a quiet task such as reading or watching TV to prevent discussion of either scale). For the cases in which they had to complete the BI beforehand, it was a prerequisite to confirm that they had done so before proceeding to the interview. Similarly, patients who had to complete the web-based form after the interview were reminded that they would receive an e-mail after 3–4 h, in which they would have access to the scale. Finally, after 7 days, the patients were sent another reminder e-mail asking them to complete the web-based form of the scale within the next 3 days. 2.3. Outcomes 2.3.1. Barthel Index The BI is an ordinal scale comprising 10 activities of daily living (feeding, grooming, bathing, dressing, bowel and bladder care, toilet use, ambulation, transfers, and stair climbing) [12]. It was scored in steps of 5 points, for a maximum total score of 100, indicating that an individual is fully independent in physical functioning; the lowest score is 0, indicating an individual who is totally dependent for performing normal physical activities. The Spanish version of the BI presents adequate psychometric properties (Cronbach’s alpha ≥ 0.88) [25]. 2.3.2. Expanded Disability Status Scale The EDSS is a 20-step ordinal scale, grading disease severity from 0 (normal status) to 10 (death due to MS) [7]. This rating is based on the medical history and the neurological examination. The EDSS score was classified as follows: mild disability (EDSS score = 0–3.5), moderate disability (EDSS score = 4–6.5) and severe disability (EDSS score ≥ 7). Evidence supports the validity of the Spanish version of the EDSS [29]. 2.3.3. Health-Related Quality of Life To assess the patient’s quality of life, we employed the EQ-5D-5L questionnaire [30], which consists of 5 dimensions (1, mobility; 2, self-care; 3, usual activities; 4, pain/discomfort; 5, anxiety/depression), with 5 response options based on severity level, ranging from 1 to 5. Based on these 5-dimension codes, an index score is provided, ranging from 0 (death) to 1 (full health). The patients also rated their current overall health on a visual analogue scale, ranging from 0 (poorest imaginable health) to 100 (best imaginable health). Int. J. Environ. Res. Public Health 2022, 19, 13965 4 of 15 2.4. Sample Size According to the criteria of several authors, a sample size of at least 100 patients would be sufficient to determine the validity of the Spanish web-based form of the BI, given that this scale is composed of 1 factor made up of 10 items [31–33]. Other authors recommend having at least 10–15 cases per observed variable to achieve an adequate sample size [34]. Hence, a sample size of 100 patients would be sufficient to satisfy both criteria. However, we decided to reach a sample size closer to 150 patients to increase statistical power. Thus, we ultimately decided on a sample size of at least 130 patients to obtain more stable results, being less likely to be affected by outliers. 2.5. Linguistic Adaptation The linguistic adaptation of the web-based form of the BI was performed according to the usual recommendations for translating and culturally adapting questionnaires based on patient-reported measures [35]. Initially, two native Spanish speakers independently translated the paper-based form of the BI into Spanish. A prerequisite was that the original meaning of each item was pre- served, as well as the use of language that facilitated understanding. A multidisciplinary panel of neurorehabilitation experts evaluated, ratified, and merged the two Spanish trans- lations of the scale. Subsequently, two native bilingual English speakers back translated the Spanish web version of the BI into English. Both back translations were compared with the original by the committee of experts who ensured that semantic equivalence was maintained. Lastly, a pilot study with 40 patients with MS evaluated the clarity and feasibility of using the Spanish web-based form of the BI. Table S1 presents the Spanish web-based form of the BI. 2.6. Data Analysis The data were analyzed using SPSS v. 25 software (SPSS Inc., Chicago, IL, USA). The level of significance was set at p < 0.05. 2.6.1. Validity The internal consistency of the BI web-based form was evaluated using Cronbach’s alpha, with a value >0.7 being considered acceptable [36]. Percent agreement and kappa coefficients [37] were used to estimate concordance between the web-based form and the face-to-face interview (criterion validity) for each item score and for the categorical ranking of the total BI score. Kappa or weighted kappa was used for binary or multiple category scales, respectively. Kappa values were interpreted according to the Landis and Koch criteria [38]: poor agreement (<0.2), fair agreement (0.21–0.40), moderate agreement (0.41–0.60), substantial agreement (0.61–0.80) and almost perfect agreement (>0.80). Re- garding the absolute value of the BI total score, the agreement between the web-based form and the face-to-face interview was examined using the intraclass correlation coefficient (ICC): excellent (ICC ≥ 0.90); good (0.90 > ICC ≥ 0.70); fair (0.70 > ICC ≥ 0.40); and poor (ICC < 0.40) [39]. Construct validity was assessed by analyzing the correlations between the total score of the web-based form of the BI with patients’ health-related quality of life (EQ-5D-5L), as well as with their disability status (EDSS), age and clinical characteristics. Spearman’s rho correlation coefficient was used to determine correlation: low correlation (rho < 0.30), mod- erate correlation (rho = 0.30–0.60) and strong correlation (rho > 0.60) [40]. The discriminant ability of the web-based form was assessed by comparing the scores obtained for disability status and health-related quality of life between the various grades of disability according to the BI, as well as by comparison of the total scale score according to sex and number of comorbidities. The group factor was analyzed using the Kruskal–Wallis test, and multiple comparisons were performed with the Mann–Whitney U test. Int. J. Environ. Res. Public Health 2022, 19, 13965 5 of 15 2.6.2. Reliability The test-retest reliability (7–10 days) of the web-based form of the BI was assessed as follows: (1) for the score of each item and the categorical score of the total scale, the percentage of agreement and kappa coefficients (kappa or weighted kappa) were used; (2) for the absolute value of the total scale score, the ICC was used. The standard error of measurement (SEM) and the MDC as 95% of the confidence interval (MDC95) were calculated following the same criteria as a previous study [41]. 3. Results The total sample consisted of 143 patients with MS (84 women and 59 men), of whom 74 had relapsing-remitting MS, 33 had primary progressive MS, and 36 had secondary progressive MS. Most patients reported a moderate level of disability as well as the presence of at least one comorbidity. Table 1 shows the sociodemographic and clinical characteristics of the patients included in the study. A total of 22 patients did not complete the web-based form of the BI within 7–10 days of their first assessment. Thus, the test-retest reliability of the online version was examined in a total sample of 121 patients. Table 1. Sociodemographic and clinical characteristics of the participants (N = 143 [84♀, 59♂]). Outcomes N (%) Mean ± SD Min–Max Sociodemographic Characteristics Age (years) 49.77 ± 9.07 25–71 Gender (female) 84 (58.7%) Weight (kg) 70.22 ± 14.57 43–110 Height (cm) 169.10 ± 9.19 148–188 Level of education School graduate 20 (14.0%) Intermediate training cycle 38 (26.6%) Higher level training cycle 23 (16.1%) University degree 62 (43.4%) Work status Working 54 (37.8%) Not working 89 (62.2%) Clinical Characteristics Type of Multiple Sclerosis Relapsing-remitting 74 (51.7%) Primary progressive 33 (23.1%) Secondary progressive 36 (25.2%) Disability status (EDSS) 5.34 ± 2.04 0–9 Mild 30 (21.0%) Moderate 78 (54.5%) Severe 35 (24.5%) Health-related quality of Life (EQ-5D-5L) Index score (0–1) 0.519 ± 0.341 –0.400–1.000 Visual Analogue Scale (0–100) 57.66 ± 18.95 10–100 Comorbidities 0 59 (41.3%) 1–2 71 (49.6%) ≥3 13 (9.1%) Urinary disturbance (yes) 92 (64.3%) 3.1. Criterion Validity of the Web-Based Form of the Barthel Index The scores obtained in the web-based form of the BI showed almost perfect agreement with those obtained when the scale was administered by a face-to-face interview (Table 2). Specifically, the percentage of agreement between both forms for each item was ≥88%, obtaining a kappa coefficient of 0.86 (0.79–0.92). Regarding the agreement between both Int. J. Environ. Res. Public Health 2022, 19, 13965 6 of 15 forms for the total score, a kappa coefficient of 0.87 (0.81–0.93) and an ICC of 0.99 (0.98–0.99) were obtained when this score was respectively established categorically and absolutely. In addition, the internal consistency of the web-based form of the BI was good-excellent (Cronbach’s alpha = 0.89 (0.86–0.91)). Therefore, the web-based form of the BI apparently presents adequate criterion validity. Table 2. Agreement between the web-based form and the face-to-face interview of the Barthel index for each item and for the total score of the categorical ranking. Agreement for Each Item Web-Based Form Face-to-Face Interview Kappa (95%CI) % Agreement 0 Points 5 Points 10 Points 15 Points Bathing 0.92 (0.85–0.99) 96% 0 points 44 3 5 points 2 94 Stairs 0.86 (0.79–0.92) 88% 0 points 56 4 1 5 points 5 26 3 10 points 1 3 44 Dressing 0.92 (0.87–0.97) 94% 0 points 25 0 0 5 points 2 28 5 10 points 0 2 81 Mobility 0.95 (0.91–1.00) 96% 0 points 13 0 0 0 5 points 1 14 0 0 10 points 0 0 5 1 15 points 0 1 2 106 Transfer 0.99 (0.96–1.00) 99% 0 points 3 0 0 0 5 points 0 14 0 0 10 points 0 1 2 0 15 points 0 0 0 123 Feeding 0.88 (0.80–0.96) 94% 0 points 8 0 0 5 points 0 47 6 10 points 1 2 79 Toilet use 0.89 (0.81–0.97) 94% 0 points 16 1 0 5 points 1 5 3 10 points 0 3 114 Grooming 0.91 (0.78–1.00) 99% 0 points 11 1 5 points 1 130 Bladder 0.91 (0.84–0.97) 94% 0 points 52 0 2 5 points 3 5 1 10 points 2 1 77 Int. J. Environ. Res. Public Health 2022, 19, 13965 7 of 15 Table 2. Cont. Agreement for Each Item Web-Based Form Face-to-Face Interview Kappa (95%CI) % Agreement 0 Points 5 Points 10 Points 15 Points Bowels 0.92 (0.86–0.98) 96% 0 points 10 0 0 5 points 1 29 3 10 points 0 2 98 Agreement for Categorical Ranking of the Total Score Web-Based Form Face-to-Face Interview Kappa (95%CI) % AgreementPhysically Independent Mildly Disabled Moderately Disabled Severely Disabled Very Severely Disabled 0.87 (0.81—0.93) 87% Physically Indepen- dent 27 3 3 0 0 Mildly disabled 3 7 5 0 0 Moderately disabled 1 2 59 2 0 Severely disabled 0 0 0 22 0 Very severely disabled 0 0 0 0 9 3.2. Construct Validity The convergent validity of the web-based form of the BI was adequate, given that the correlational analysis showed a statistically significant relationship between the total BI score and patients’ health-related quality of life (EQ-5D-5L), as well as with their disability status (EDSS), age, and clinical characteristics (type of MS, urinary disturbance, and number of comorbidities; see Table 3). All correlations between the BI were of moderate–large magnitude, with the exception of those observed with the patients’ comorbidities, which were low (rho < 0.30). The BI score showed a particularly high correlation with disability status (EDSS; rho = 0.769). Table 3. Spearman correlations of the web-based form of the Barthel index total score with patients’ health-related quality of life, as well as with their disability status, age, and clinical characteristics. Outcomes Barthel Index Web-Based Form Health-related quality of life (EQ 5D-5L) Index score 0.687 ** Visual Analogue Scale 0.429 ** Disability Status Expanded Disability Status Scale (EDSS) 0.769 ** Age (years) –0.391 ** Gender 0.148 Type of Multiple Sclerosis –0.415 ** Urinary disturbance (yes/no) 0.426 ** Comorbidities (n) –0.247 ** EQ 5D-5L, European Quality of Life-5 Dimensions. ** p < 0.01 Int. J. Environ. Res. Public Health 2022, 19, 13965 8 of 15 The Kruskal–Wallis test showed statistically significant differences in the web-based form of the BI score for the number of comorbidities (p = 0.016), disability status (p < 0.001) and health-related quality of life (p < 0.001) of the patients with MS. Specifically, patients with two or more comorbidities scored lower compared with those without comorbidities. Likewise, there were differences in the total BI score between patients with different degrees of disability status according to the EDSS, with patients showing lower BI scores as their degree of disability in the EDSS increased. In terms of the categorical BI total score, patients classified as ‘severely disabled’ or ‘very severely disabled’ showed statistically significant deterioration in their disability status and in their health-related quality of life than those classified with lower levels of disability. Similarly, patients classified as ‘moderately disabled’ had significantly poorer health-related quality of life and disability status according to the EDSS than those classified as ‘physically independent’ (p < 0.05). Multiple comparisons are presented in Table 4. Table 4. Multiple comparisons between participants with different scores in the web-based form of the Barthel index for gender, number of comorbidities, disability status and health-related quality of life. Web-Based Form of the Barthel Index Mean ± SD Median (First Quartile–Third Quartile) Total Score (n = 143) Categorical Ranking of Total Scoring Physically independent (n = 33) a Mildly disabled (n = 15) b Moderately disabled (n = 64) c Severely Disabled (n = 22) d Very Severely Disabled (n = 9) e Gender Male (n = 59) 72.20 ± 25.33 75 (60–90) — — — — — Female (n = 84) 77.98 ± 25.87 87.5 (70–95) — — — — — Disability status (EDSS) 3.26 ± 1.92 3 (1.75–5.25) c,d,e 4.40 ± 1.67 4.5 (3–6) c,d,e 5.65 ± 1.31 5 (6–6.5) a,b,d,e 6.86 ± 0.73 7 (6–7.12) a,b,c,e 8.61 ± 0.65 9 (8–9) a,b,c,d Mild MS (n = 30) f 97.00 ± 4.47 100 (95–100) g,h — — — — — Moderate MS (n = 78) g 81.02 ± 16.40 85 (75–95) f,h — — — — — Severe MS (n = 35) h 45.14 ± 26.64 45 (20– 70) f,g — — — — — Comorbidities None (n = 60) i 80.33 ± 23.70 90 (70–100) j — — — — — 1 or 2 (n = 34) 76.62 ± 27.68 87.5 (70–95) — — — — — 2 or more (n = 49) j 69.08 ± 25.83 75 (50–87.5) i — — — — — Health-related quality of life (EQ-5D-5L) Index score (n = 143) — 0.779 ± 0.174 0.799 (0.684–0.867) b,c,d,e 0.629 ± 0.263 0.675 (0.523–0.800) a,d,e 0.560 ± 0.245 0.591 (0.502–0.738) a,d,e 0.183 ± 0.290 0.176 (0.050–0.399) a,b,c,e −0.090 ± 0.295 −0.228 (−0.289–0.092) a,b,c,d Visual Analogue Scale (n = 143) — 69.64 ± 18.33 75 (60–80) b,c,d,e 58.70 ± 15.87 60 (50–75) a,e 57.28 ± 15.73 50 (50–70) a,e 50.25 ± 19.25 50 (40–60) a,e 32.78 ± 15.02 30 (25–40) a,b,c,d EDSS, Expanded Disability Status Scale; EQ 5D-5L, European Quality of Life-5 Dimensions; MS, Multiple Sclerosis; SD Standard Deviation. Superscript letters (from “a” to “j”) indicate the groups in which statistically significant differences were found according to post-hoc comparisons using Mann-Whitney U test. 3.3. Test-Retest Reliability of the Web-Based Form of the Barthel Index The stability of the score obtained again in the web-based form of the BI at 7 days (test-retest) was almost perfect (Table 5), both when considering the score of each item separately (percent agreement ≥92%; kappa = 0.63 (0.52–0.74)) and when considering the categorical ranking of the total score (percent agreement = 86%; kappa = 0.63 (0.52–0.74)). In addition, with respect to absolute total score agreement, excellent agreement (ICC = 0.97 (0.96–0.98)) was found, determining a SEM of 4.36 points and a MDC95 of 12.09 points (relative MDC95 = 16%) for the total score of this online version. Int. J. Environ. Res. Public Health 2022, 19, 13965 9 of 15 Table 5. Test-retest reliability for each item and for the total score of the categorical classification of the web-based form of the Barthel index. Agreement for Each Item Web-Based Form Web-Based Form after 7–10 Days Kappa (95%CI) % Agreement 0 Points 5 Points 10 Points 15 Points Bathing 0.82 (0.71–0.93) 93% 0 points 32 4 5 points 5 80 Stairs 0.89 (0.82–0.96) 92% 0 points 47 1 1 5 points 1 29 2 10 points 1 4 35 Dressing 0.95 (0.91–1.00) 97% 0 points 18 0 0 5 points 0 31 1 10 points 0 3 68 Mobility 0.92 (0.85–0.99) 95% 0 points 9 0 0 0 5 points 1 12 0 0 10 points 0 0 5 0 15 points 0 2 3 89 Transfer 0.93 (0.84–1.00) 98% 0 points 3 0 0 0 5 points 0 11 0 0 10 points 0 0 2 0 15 points 0 2 0 103 Feeding 0.86 (0.77–0.95) 92% 0 points 7 0 0 5 points 0 37 5 10 points 0 5 67 Toilet use 0.86 (0.76–0.96) 93% 0 points 11 2 0 5 points 0 5 2 10 points 0 4 97 Grooming 0.89 (0.74–1.00) 98% 0 points 9 1 5 points 1 110 Bladder 0.90 (0.82–0.97) 93% 0 points 42 1 1 5 points 0 5 3 10 points 3 0 66 Bowels 0.90 (0.82–0.97) 94% 0 points 9 1 0 5 points 0 23 1 10 points 0 5 82 Int. J. Environ. Res. Public Health 2022, 19, 13965 10 of 15 Table 5. Cont. Agreement for Categorical Ranking of the Total Score Web-Based Form Web-Based Form after 7–10 days Kappa (95%CI) % AgreementPhysically Independent Mildly Disabled Moderately Disabled Severely Disabled Very Severely Disabled 0.83 (0.75–0.92) 86% Physically Indepen- dent 19 4 3 2 0 Mildly disabled 2 7 6 0 0 Moderately disabled 0 0 56 0 0 Severely disabled 0 0 0 14 0 Very severely disabled 0 0 0 0 8 4. Discussion The present study is the first to assess the validity and reliability of the Spanish web- based form of the BI in patients with MS. The web-based items of the BI showed excellent agreement with each item in the face-to-face interview. The web-based form also showed excellent internal consistency, as well as adequate construct validity, given that its score was related to scales measuring related constructs and discriminated patients with various degrees of functional disability. The stability over time of the web-based form was adequate, this being the first study to report MDC in patients with MS. Thus, the web-based form of the Spanish version of the BI appears to be a valid and useful tool in clinical practice to determine the degree of functional disability in Spanish-speaking patients with MS and could be an alternative to the application of the BI in a face-to-face interview format. The percentage of agreement for the Spanish version of the BI rating between the web- based and face-to-face interview forms was high (≥88%), with kappa values ranging from 0.86 in stairs to 0.99 in transfer. Prior studies have addressed the reliability of remote BI assessment in patients after stroke or other orthopedic conditions, most using the telephone interview [22,23,42–45], and two using the postal self-report version [23,24]. Supporting our results, most of these studies had a good agreement between conventional and remote BI scores [22,24,42–45]. A meta-analysis concluded that there was extensive evidence to show that paper and computer versions of self-reported questionnaires are equivalent [46]. The analyses of individual item scores indicate the lowest agreement on the item ‘climbing the stairs’, as in the Yeo et al. [44] study comparing the postal and conventional form in older adults, which could be attributed to differences in the meaning of the ‘flight of stairs’ item. Homes are often adapted to the needs of disabled individuals, eliminating obstacles or flights of stairs. Thus, the term ‘flight of stairs’ refers to a simple hand ladder, and its use is fairly difficult in patients with MS. Although no previous report on the web-based form of the BI was found, the internal consistency of this version is in line with other studies that evaluated remote versions of the scale by telephone interview [47,48]. It was also similar to that obtained for the conventional form of the BI by face-to-face interview in patients with MS [17] (Cronbach’s alpha = 0.89 vs. 0.86). This finding could be explained by the high agreement found between the face-to-face interview and the web-based form. However, the internal consistency was higher than the validated conventional Spanish version [25] performed in four different cohorts of older adults, which could be because the application of a scale in different populations can cause variations in its internal consistency [49]. Int. J. Environ. Res. Public Health 2022, 19, 13965 11 of 15 The construct validity of the Spanish version of the web-based form of the BI was adequate. The scale showed good correlations with patients’ health-related quality of life, disability, and clinical features. In addition, the scale discriminated between patients with various degrees of disability and quality of life, demonstrating its discriminant validity. Our study confirms the good correlation observed previously between the EDSS and the BI [13,14] and the pattern of association with patients’ health-related quality of life, age and clinical features. Of note, the highest correlation was observed with disability status (EDSS; rho = 0.769). These results could be explained by the fact that the EDSS evaluates the disability status predominantly through a set of questions regarding walking ability and functional systems, and it has similar items focusing on some mobility aspects originating from the BI. In terms of the patients’ health-related quality of life, age, and clinical characteristics (e.g., type of MS and number of comorbidities), the correlations were moderate to large in magnitude. This strong correlation was expected because the ‘usual activities’ domain of the EQ-5D-5L questionnaire evaluates the same dimensions of the BI, including the most popular activities of daily living. Limitations in a fundamental daily life activity such as walking would have an impact on quality of life in this population [50]. With respect to age and type of MS, the published data suggest that the clinical phenotype and course of MS are age dependent; thus, disability accumulation might be an effect of age [51,52]. Lastly, our results showed significant differences in the web-based form score for the number of comorbidities, which could be because comorbidities can negatively impact patients with MS, including the acceleration of disability progression [53]. All these associations are in line with the study reported by Nicholl et al. [17] for the BI validated in patients with MS and with the validity of the translated version of the BI into various languages [19,20,54] in other conditions. Thereby, the construct validity of the Spanish version is corroborated. Test-retest analyses demonstrated that the web-based form of the BI was stable for detecting and observing functional disability changes in patients over time in clinical settings. The agreement rates of the web-based form of individual items were ≥92%, which was a satisfactory level, and that of the total scores was confirmed to be high (ICC = 0.97). These results are similar to those of previous test–retest reliability studies performed in stroke survivors [55,56]. We are aware that there are many differences between these two conditions and therefore they cannot be compared. However, the patients of these two studies were all more than six months post-stroke onset and therefore it might be anticipated that their functional status would be stable over the short time between assessments similar to our clinically stable patients with MS. To our knowledge, no previous studies have established the SEM and MDC of the BI in patients with MS, so we could not compare our findings. Despite not being comparable, in other neurological pathologies, such as in patients after stroke, Yang et al. [55] reported a similar MDC to that obtained in our study (MDC = 12.09 vs. 16.2). The results of our study help us determine whether there have been real and clinically relevant changes in functional disability (as measured by the BI) in patients with MS. It is therefore possible to determine whether patients have limitations in performing daily activities and to identify the effectiveness of therapies aimed at alleviating or improving these aspects. 4.1. Clinical Implications The web-based form of the BI scale could be a suitable alternative in certain circum- stances to remotely examine and follow the disability of patients with MS, preventing unnecessary trips to outpatient clinics and/or health centers. With the rise of telemedicine, it is essential to have validated tools to assess the evolution of this pathology. The MDC established in this study will allow us to determine whether the changes produced in the disability of patients with MS are real and could have clinical repercussions. Thus, the web- based form of the BI allows telematic assessment for detecting functional disability changes in patients over time and can determine the efficacy of various interventions. In addition, the use of electronic data capture for health assessment offers data management capabilities Int. J. Environ. Res. Public Health 2022, 19, 13965 12 of 15 (data checking and analysis, reducing the number of missing values or incomplete data or out-of-range values or typing or copying errors) [57]. 4.2. Limitations As a limitation, most of our sample presented a moderate disability status and had a relapsing-remitting clinical subtype. Thus, we did not cover the full disability and type of MS range that presents in the MS population, preventing the validity of the scale from being evaluated in these groups. However, it can be confidently assumed that the current study population represents the normal variation of the disease in our country [58]. Further studies could be conducted prospectively in a sample with representative proportions of patients in terms of clinical subtypes of MS. On the other hand, the fact that the BI web version and face-to-face interview were administered on a single day could have caused some recall bias. This approach was used to minimize any change that might occur in the patient’s functional disability attributable to the electronic version assessment and the face-to-face interview being conducted on different days. As in other studies [59–61], a reasonable amount of time was left between the completion of both versions so that patients could perform other activities and minimize the recall effect. However, we cannot rule out with certainty the absence of such bias. 5. Conclusions The Spanish web-based form of the BI is a valid and reliable tool to assess the degree of functional disability in patients with MS. The Spanish version of the BI can be applied in both the web-based format and the face-to-face interview format, given that the concordance between them was excellent. In a clinical context, total score differences of more than 12 points could be considered real, indicating a deterioration or improvement in the patient’s functionality. Supplementary Materials: The following supporting information can be downloaded at: https: //www.mdpi.com/article/10.3390/ijerph192113965/s1. Table S1. The Spanish web-based form of the Barthel index. Author Contributions: S.A.-Z.: Data curation, Investigation, Resources, Visualization, Project admin- istration, Supervision, Writing original draft, Writing review & editing. T.d.C.: Conceptualization, Data curation, Investigation, Methodology, Resources, Visualization, Project administration, Supervi- sion, Writing original draft, Writing review & editing. J.A.V.-C.: Resources, Visualization, Writing original draft, Writing review & editing. P.M.-C.: Resources, Visualization, Writing original draft, Writing review & editing. G.P.-M.: Investigation, Visualization, Writing original draft, Writing review & editing. I.L.-d.-U.-V.: Conceptualization, Data curation, Formal analysis, Methodology, Project administration, Resources, Supervision, Validation, Writing original draft, Writing review & editing. All authors have read and agreed to the published version of the manuscript. Funding: This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors. Institutional Review Board Statement: This was an observational and longitudinal study in accor- dance with the criteria established by the Consensus-based Standards for the Selection of Health Status Measurement Instruments guidelines. The study was approved by the ethics committee of the Complutense University of Madrid (registration number: CE_20220120-09_SAL) and was conducted in accordance with the Declaration of Helsinki. Informed Consent Statement: Informed consent was obtained from all subjects involved in the study. Data Availability Statement: Not applicable. Acknowledgments: We would like to thank patients with MS and MS Associations. Conflicts of Interest: The authors declare no conflict of interest. https://www.mdpi.com/article/10.3390/ijerph192113965/s1 https://www.mdpi.com/article/10.3390/ijerph192113965/s1 Int. J. Environ. Res. Public Health 2022, 19, 13965 13 of 15 References 1. Dobson, R.; Giovannoni, G. Multiple Sclerosis—A Review. Eur. J. Neurol. 2019, 26, 27–40. [CrossRef] [PubMed] 2. Walton, C.; King, R.; Rechtman, L.; Kaye, W.; Leray, E.; Marrie, R.A.; Robertson, N.; La Rocca, N.; Uitdehaag, B.; van der Mei, I.; et al. Rising Prevalence of Multiple Sclerosis Worldwide: Insights from the Atlas of MS, Third Edition. Mult. Scler. J. 2020, 26, 1816–1821. [CrossRef] [PubMed] 3. Benedict, R.H.B.; Wahlig, E.; Bakshi, R.; Fishman, I.; Munschauer, F.; Zivadinov, R.; Weinstock-Guttman, B. Predicting Quality of Life in Multiple Sclerosis: Accounting for Physical Disability, Fatigue, Cognition, Mood Disorder, Personality, and Behavior Change. J. Neurol. Sci. 2005, 231, 29–34. [CrossRef] 4. Louapre, C.; Papeix, C.; Lubetzki, C.; Maillart, E. Sclérose En Plaques Chez Le Sujet Âgé. Geriatr. Psychol. Neuropsychiatr. Vieil. 2017, 15, 402–408. [CrossRef] [PubMed] 5. Gholipour, T.; Healy, B.; Baruch, N.F.; Weiner, H.L.; Chitnis, T. Demographic and Clinical Characteristics of Malignant Multiple Sclerosis. Neurology 2011, 76, 1996–2001. [CrossRef] [PubMed] 6. Ayuso, G.I. Esclerosis Múltiple: Impacto Socioeconómico y En La Calidad de Vida de Los Pacientes. Med. Clin. 2014, 143, 7–12. [CrossRef] 7. Kurtzke, J.F. Rating Neurologic Impairment in Multiple Sclerosis: An Expanded Disability Status Scale (EDSS). Neurology 1983, 33, 1444–1452. [CrossRef] [PubMed] 8. van Munster, C.E.P.; Uitdehaag, B.M.J. Outcome Measures in Clinical Trials for Multiple Sclerosis. CNS Drugs 2017, 31, 217–236. [CrossRef] 9. Sheikh, K.; Smith, D.S.; Meade, T.W.; Goldenberg, E.; Brennan, P.J.; Kinsella, G. Repeatability and Validity of a Modified Activities of Daily Living (ADL) Index in Studies of Chronic Disability. Disabil. Rehabil. 1979, 1, 51–58. [CrossRef] [PubMed] 10. Keith, R.A.; Granger, C.V.; Hamilton, B.B.; Sherwin, F.S. The Functional Independence Measure: A New Tool for Rehabilitation. Adv. Clin. Rehabil. 1987, 1, 6–18. 11. Sharrack, B.; Hughes, R.A.C. Clinical Scales for Multiple Sclerosis. J. Neurol. Sci. 1996, 135, 9. [CrossRef] 12. Mahoney, F.I.; Barthel, D.W. Functional Evaluation: The Barthel Index. Md. State. Med. J. 1965, 14, 61–65. 13. Marolf, M.; Vaney, C.; König, N.; Schenk, T.; Prosiegel, M. Evaluation of Disability in Multiple Sclerosis Patients: A Comparative Study of the Functional Independence Measure, the Extended Barthel Index and the Expanded Disability Status Scale. Clin. Rehabil. 1996, 10, 309–313. [CrossRef] 14. Thompson, A.J.; Hobart, J.C. Multiple Sclerosis: Assessment of Disability and Disability Scales. J. Neurol. 1998, 245, 189–196. [CrossRef] [PubMed] 15. Ocagli, H.; Cella, N.; Stivanello, L.; Degan, M.; Canova, C. The Barthel Index as an Indicator of Hospital Outcomes: A Retrospective Cross-Sectional Study with Healthcare Data from Older People. J. Adv. Nurs. 2021, 77, 1751–1761. [CrossRef] 16. Granger, C.V.; Dewis, L.S.; Peters, N.C.; Sherwood, C.C.; Barrett, J.E. Stroke Rehabilitation: Analysis of Repeated Barthel Index Measures. Arch. Phys. Med. Rehabil. 1979, 60, 14–17. 17. Nicholl, L.; Hobart, J.; Dunwoody, L.; Cramp, F.; Lowe-Strong, A. Measuring Disability in Multiple Sclerosis: Is the Community Dependency Index an Improvement on the Barthel Index? Mult. Scler. 2004, 10, 447–450. [CrossRef] [PubMed] 18. Wade, D.T.; Hewer, R.L. Functional Abilities after Stroke: Measurement, Natural History and Prognosis. J. Neurol. Neurosurg. Psychiatry 1987, 50, 177–182. [CrossRef] [PubMed] 19. Tofani, M.; Massai, P.; Fabbrini, G.; Berardi, A.; Pelosin, E.; Conte, A.; De Bartolo, I.; Valente, D.; Galeoto, G. Psychometric Properties of the Italian Version of the Barthel Index in Patients with Parkinson’s Disease: A Reliability and Validity Study. Funct. Neurol. 2019, 34, 145–150. [PubMed] 20. Post, M.W.M.; Van Asbeck, F.W.A.; Van Dijk, A.J.; Schrijvers, A.J.P. Nederlandse Interviewversie van de Barthel-Index Onderzocht Bij Dwarsleasiepatienten. Ned. Tijdschr. Geneeskd. 1995, 139, 1376–1380. 21. Martínez-García, M.; Bal-Alvarado, M.; Santos Guerra, F.; Ares-Rico, R.; Suárez-Gil, R.; Rodríguez-Álvarez, A.; Pérez-López, A.; Casariego-Vales, E. Monitoring of COVID-19 Patients by Telemedicine with Telemonitoring. Rev. Clin. Esp. 2020, 220, 472–479. [CrossRef] [PubMed] 22. Prasad, K.; Kumar, A.; Misra, S.; Yadav, A.K.; Johri, S.; Sarkar, R.S.; Gorthi, S.P.; Hassan, K.M.; Prabhakar, S.; Misra, U.K.; et al. Reliability and Validity of Telephonic Barthel Index: An Experience from Multi-Centric Randomized Control Study. Acta. Neurol. Belg. 2018, 118, 53–59. [CrossRef] [PubMed] 23. Heuschmann, P.U.; Kolominsky-Rabas, P.L.; Nolte, C.H.; Hünermund, G.; Ruf, H.U.; Laumeier, I.; Meyrer, R.; Alberti, T.; Rahmann, A.; Kurth, T.; et al. Untersuchung Der Reliabilität Der Deutschen Version Des Barthel-Index Sowie Entwicklung Einer Postalischen Und Telefonischen Fassung Für Den Einsatz Bei Schlaganfall-Patienten. Fortschr. Neurol. Psychiatr. 2005, 73, 74–82. [CrossRef] [PubMed] 24. Gompertz, P.; Pound, P.; Ebrahim, S. A Postal Version of the Barthel Index. Clin. Rehabil. 1994, 8, 233–239. [CrossRef] 25. González, N.; Bilbao, A.; Forjaz, M.J.; Ayala, A.; Orive, M.; Garcia-Gutierrez, S.; Las Hayas, C.; Quintana, J.M. Psychometric Characteristics of the Spanish Version of the Barthel Index. Aging. Clin. Exp. Res. 2018, 30, 489–497. [CrossRef] [PubMed] 26. Sullivan, G.M. A Primer on the Validity of Assessment Instruments. J. Grad. Med. Educ. 2011, 3, 119. [CrossRef] [PubMed] 27. Mokkink, L.B.; Terwee, C.B.; Knol, D.L.; Stratford, P.W.; Alonso, J.; Patrick, D.L.; Bouter, L.M.; De Vet, H.C. The COSMIN Checklist for Evaluating the Methodological Quality of Studies on Measurement Properties: A Clarification of Its Content. BMC Med. Res. Methodol. 2010, 10, 1–8. [CrossRef] [PubMed] http://doi.org/10.1111/ene.13819 http://www.ncbi.nlm.nih.gov/pubmed/30300457 http://doi.org/10.1177/1352458520970841 http://www.ncbi.nlm.nih.gov/pubmed/33174475 http://doi.org/10.1016/j.jns.2004.12.009 http://doi.org/10.1684/pnv.2017.0685 http://www.ncbi.nlm.nih.gov/pubmed/29081400 http://doi.org/10.1212/WNL.0b013e31821e559d http://www.ncbi.nlm.nih.gov/pubmed/21646626 http://doi.org/10.1016/S0025-7753(15)30003-8 http://doi.org/10.1212/WNL.33.11.1444 http://www.ncbi.nlm.nih.gov/pubmed/6685237 http://doi.org/10.1007/s40263-017-0412-5 http://doi.org/10.3109/03790797909164024 http://www.ncbi.nlm.nih.gov/pubmed/399767 http://doi.org/10.1016/0022-510X(95)00261-Y http://doi.org/10.1177/026921559601000408 http://doi.org/10.1007/s004150050204 http://www.ncbi.nlm.nih.gov/pubmed/9591219 http://doi.org/10.1111/jan.14708 http://doi.org/10.1191/1352458504ms1056oa http://www.ncbi.nlm.nih.gov/pubmed/15327044 http://doi.org/10.1136/jnnp.50.2.177 http://www.ncbi.nlm.nih.gov/pubmed/3572432 http://www.ncbi.nlm.nih.gov/pubmed/32453995 http://doi.org/10.1016/j.rce.2020.05.013 http://www.ncbi.nlm.nih.gov/pubmed/33994572 http://doi.org/10.1007/s13760-017-0843-2 http://www.ncbi.nlm.nih.gov/pubmed/29368116 http://doi.org/10.1055/s-2004-830172 http://www.ncbi.nlm.nih.gov/pubmed/15685491 http://doi.org/10.1177/026921559400800308 http://doi.org/10.1007/s40520-017-0809-5 http://www.ncbi.nlm.nih.gov/pubmed/28770477 http://doi.org/10.4300/JGME-D-11-00075.1 http://www.ncbi.nlm.nih.gov/pubmed/22655129 http://doi.org/10.1186/1471-2288-10-22 http://www.ncbi.nlm.nih.gov/pubmed/20298572 Int. J. Environ. Res. Public Health 2022, 19, 13965 14 of 15 28. Thompson, A.J.; Banwell, B.L.; Barkhof, F.; Carroll, W.M.; Coetzee, T.; Comi, G.; Correale, J.; Fazekas, F.; Filippi, M.; Freedman, M.S.; et al. Diagnosis of Multiple Sclerosis: 2017 Revisions of the McDonald Criteria. Lancet Neurol. 2018, 17, 162–173. [CrossRef] 29. Solà-Valls, N.; Vicente-Pascual, M.; Blanco, Y.; Solana, E.; Llufriu, S.; Martínez-Heras, E.; Martínez-Lapiscina, E.H.; Sepúlveda, M.; Pulido-Valdeolivas, I.; Zubizarreta, I.; et al. Spanish Validation of the Telephone Assessed Expanded Disability Status Scale and Patient Determined Disease Steps in People with Multiple Sclerosis. Mult. Scler. Relat. Disord. 2019, 27, 333–339. [CrossRef] [PubMed] 30. Herdman, M.; Gudex, C.; Lloyd, A.; Janssen, M.; Kind, P.; Parkin, D.; Bonsel, G.; Badia, X. Development and Preliminary Testing of the New Five-Level Version of EQ-5D (EQ-5D-5L). Qual. Life Res. 2011, 20, 1727–1736. [CrossRef] [PubMed] 31. Hair, J.F.; Black, W.C.; Babin, B.J.; Anderson, R.E. Multivariate Data Analysis: Pearson New International Edition, 7th ed.; Pearson: Essex, NJ, USA, 2014. 32. Bandalos, D.L.; Finney, S.J. Factor Analysis: Exploratory and Confirmatory. In Reviewer’s Guide to Quantitative Methods in the Social Science; Hancock, G.R., Stapleton, L.M., Mueller, R.O., Eds.; Routledge: New York, NY, USA, 2018; pp. 98–122. 33. Costello, A.B.; Osborne, J.W. Best Practices in Exploratory Factor Analysis: Four Recommendations for Getting the Most from Your Analysis. Pract. Assess. Res. And. Eval. 2005, 10, 7. 34. Worthington, R.L.; Whittaker, T.A. Scale Development Research: A Content Analysis and Recommendations for Best Practices. Couns. Psychol. 2006, 34, 806–838. [CrossRef] 35. Wild, D.; Grove, A.; Martin, M.; Eremenco, S.; McElroy, S.; Verjee-Lorenz, A.; Erikson, P. Principles of Good Practice for the Translation and Cultural Adaptation Process for Patient-Reported Outcomes (PRO) Measures: Report of the ISPOR Task Force for Translation and Cultural Adaptation. Value Health 2005, 8, 94–104. [CrossRef] 36. Cronbach, L.J. Coefficient Alpha and the Internal Structure of Tests. Psychometrika 1951, 16, 297–334. [CrossRef] 37. Cohen, J. Weighted Kappa: Nominal Scale Agreement Provision for Scaled Disagreement or Partial Credit. Psychol. Bull. 1968, 70, 213–220. [CrossRef] 38. Landis, J.R.; Koch, G.G. The Measurement of Observer Agreement for Categorical Data. Biometrics 1977, 33, 159. [CrossRef] 39. Shrout, P.E.; Fleiss, J.L. Intraclass Correlations: Uses in Assessing Rater Reliability. Psychol. Bull. 1979, 86, 420–428. [CrossRef] 40. Terwee, C.B.; Bot, S.D.M.; de Boer, M.R.; van der Windt, D.A.W.M.; Knol, D.L.; Dekker, J.; Bouter, L.M.; de Vet, H.C.W. Quality Criteria Were Proposed for Measurement Properties of Health Status Questionnaires. J. Clin. Epidemiol. 2007, 60, 34–42. [CrossRef] 41. López-de-Uralde-Villanueva, I.; Acuyo-Osorio, M.; Prieto-Aldana, M.; La Touche, R. Reliability and Minimal Detectable Change of a Modified Passive Neck Flexion Test in Patients with Chronic Nonspecific Neck Pain and Asymptomatic Subjects. Musculoskelet. Sci. Pract. 2017, 28, 10–17. [CrossRef] 42. Shinar, D.; Gross, C.R.; Bronstein, K.S.; Licata-Gehr, E.E.; Eden, D.T.; Cabrera, A.R.; Fishman, I.G.; Roth, A.A.; Barwick, J.A.; Kunitz, S.C. Reliability of the Activities of Daily Living Scale and Its Use in Telephone Interview. Arch. Phys. Med. Rehabil. 1987, 68, 723–728. [CrossRef] 43. Korner-Bitensky, N.; Wood-Dauphinee, S.; Siemiatycki, J.; Shapiro, S.; Becker, R. Health-Related Information Postdischarge: Telephone versus Face-to-Face Interviewing. Arch. Phys. Med. Rehabil. 1994, 75, 1287–1296. [CrossRef] 44. Yeo, D.; Faleiro, R.; Lincoln, N. Barthel ADL Index: A Comparison of Administration Methods. Clin. Rehabil. 1995, 9, 34–39. [CrossRef] 45. Della Pietra, G.L.; Savio, K.; Oddone, E.; Reggiani, M.; Monaco, F.; Leone, M.A. Validity and Reliability of the Barthel Index Administered by Telephone. Stroke 2011, 42, 2077–2079. [CrossRef] 46. Gwaltney, C.J.; Shields, A.L.; Shiffman, S. Equivalence of Electronic and Paper-and-Pencil Administration of Patient-Reported Outcome Measures: A Meta-Analytic Review. Value Health 2008, 11, 322–333. [CrossRef] 47. Oveisgharan, S.; Shirani, S.; Ghorbani, A.; Soltanzade, A.; Baghaei, A.; Hosseini, S.; Sarrafzadegan, N. Barthel Index in a Middle-East Country: Translation, Validity and Reliability. Cerebrovasc. Dis. 2006, 22, 350–354. [CrossRef] [PubMed] 48. Celani, M.G.; Cantisani, T.A.; Righetti, E.; Spizzichino, L.; Ricci, S. Different Measures for Assessing Stroke Outcome: An Analysis from the International Stroke Trial in Italy. Stroke 2002, 33, 218–223. [CrossRef] 49. Streiner, D.L. Being Inconsistent about Consistency: When Coefficient Alpha Does and Doesn’t Matter. J. Pers. Assess 2003, 80, 217–222. [CrossRef] 50. LaRocca, N.G. Impact of Walking Impairment in Multiple Sclerosis. Patient Patient-Cent. Outcomes Res. 2011, 4, 189–201. [CrossRef] 51. Confavreux, C.; Vukusic, S. Natural History of Multiple Sclerosis: A Unifying Concept. Brain 2006, 129, 606–616. [CrossRef] 52. Confavreux, C.; Vukusic, S. Age at Disability Milestones in Multiple Sclerosis. Brain 2006, 129, 595–605. [CrossRef] 53. Conway, D.S.; Thompson, N.R.; Cohen, J.A. Influence of Hypertension, Diabetes, Hyperlipidemia, and Obstructive Lung Disease on Multiple Sclerosis Disease Course. Mult. Scler. 2017, 23, 277–285. [CrossRef] 54. Hormozi, S.; Alizadeh-Khoei, M.; Sharifi, F.; Taati, F.; Aminalroaya, R.; Fadaee, S.; Angooti-Oshnari, L.; Saghebi, H. Iranian Version of Barthel Index: Validity and Reliability in Outpatients’ Elderly. Int. J. Prev. Med. 2019, 10, 130. [CrossRef] 55. Yang, C.M.; Wang, Y.C.; Lee, C.H.; Chen, M.H.; Hsieh, C.L. A Comparison of Test–Retest Reliability and Random Measurement Error of the Barthel Index and Modified Barthel Index in Patients with Chronic Stroke. Disabil. Rehabil. 2020, 44, 2099–2103. [CrossRef] 56. Green, J.; Young, J. A Test-Retest Reliability Study of the Barthel Index, the Rivermead Mobility Index, the Nottingham Extended Activities of Daily Living Scale and the Frenchay Activities Index in Stroke Patients. Disabil. Rehabil. 2001, 23, 670–676. [CrossRef] http://doi.org/10.1016/S1474-4422(17)30470-2 http://doi.org/10.1016/j.msard.2018.11.018 http://www.ncbi.nlm.nih.gov/pubmed/30472411 http://doi.org/10.1007/s11136-011-9903-x http://www.ncbi.nlm.nih.gov/pubmed/21479777 http://doi.org/10.1177/0011000006288127 http://doi.org/10.1111/j.1524-4733.2005.04054.x http://doi.org/10.1007/BF02310555 http://doi.org/10.1037/h0026256 http://doi.org/10.2307/2529310 http://doi.org/10.1037/0033-2909.86.2.420 http://doi.org/10.1016/j.jclinepi.2006.03.012 http://doi.org/10.1016/j.msksp.2017.01.004 http://doi.org/10.1097/00008483-198804000-00013 http://doi.org/10.1016/0003-9993(94)90275-5 http://doi.org/10.1177/026921559500900105 http://doi.org/10.1161/STROKEAHA.111.613521 http://doi.org/10.1111/j.1524-4733.2007.00231.x http://doi.org/10.1159/000094850 http://www.ncbi.nlm.nih.gov/pubmed/16888374 http://doi.org/10.1161/hs0102.100532 http://doi.org/10.1207/S15327752JPA8003_01 http://doi.org/10.2165/11591150-000000000-00000 http://doi.org/10.1093/brain/awl007 http://doi.org/10.1093/brain/awh714 http://doi.org/10.1177/1352458516650512 http://doi.org/10.4103/ijpvm.IJPVM_579_18 http://doi.org/10.1080/09638288.2020.1814429 http://doi.org/10.1080/09638280110045382 Int. J. Environ. Res. Public Health 2022, 19, 13965 15 of 15 57. Caro, J.J.; Caro, I.; Caro, J.; Wouters, F.; Juniper, E.F. Does Electronic Implementation of Questionnaires Used in Asthma Alter Responses Compared to Paper Implementation? Qual. Life Res. 2001, 10, 683–691. [CrossRef] 58. Pardo, P.J.M.; Latorre, M.A.P.; López, A.; Errea, J.M.; Modrego, P.J. Prevalence of Multiple Sclerosis in the Province of Teruel, Spain. J. Neurol. 1997, 244, 182–185. [CrossRef] 59. Robles, N.; Rajmil, L.; Rodriguez-Arjona, D.; Azuara, M.; Codina, F.; Raat, H.; Ravens-Sieberer, U.; Herdman, M. Development of the Web-Based Spanish and Catalan Versions of the Euroqol 5D-Y (EQ-5D-Y) and Comparison of Results with the Paper Version. Health Qual. Life Outcomes 2015, 13, 1–9. [CrossRef] 60. Cook, A.J.; Roberts, D.A.; Henderson, M.D.; Van Winkle, L.C.; Chastain, D.C.; Hamill-Ruth, R.J. Electronic Pain Questionnaires: A Randomized, Crossover Comparison with Paper Questionnaires for Chronic Pain Assessment. Pain 2004, 110, 310–317. [CrossRef] 61. Olajos-Clow, J.; Minard, J.; Szpiro, K.; Juniper, E.F.; Turcotte, S.; Jiang, X.; Jenkins, B.; Lougheed, M.D. Validation of an Electronic Version of the Mini Asthma Quality of Life Questionnaire. Respir. Med. 2010, 104, 658–667. [CrossRef] http://doi.org/10.1023/A:1013811109820 http://doi.org/10.1007/s004150050070 http://doi.org/10.1186/s12955-015-0271-z http://doi.org/10.1016/j.pain.2004.04.012 http://doi.org/10.1016/j.rmed.2009.11.017 Introduction Materials and Methods Study Design, Setting and Participants Study Procedures Outcomes Barthel Index Expanded Disability Status Scale Health-Related Quality of Life Sample Size Linguistic Adaptation Data Analysis Validity Reliability Results Criterion Validity of the Web-Based Form of the Barthel Index Construct Validity Test-Retest Reliability of the Web-Based Form of the Barthel Index Discussion Clinical Implications Limitations Conclusions References