Search published articles


Showing 4 results for Validity and Reliability

Jalil Kuhpayehzadeh, Sodabeh Afshar Por, Zahra Naghizadeh Mooghari,
Volume 24, Issue 159 (9-2017)
Abstract

Background: The assessing of distance education learning environments is the key to high-quality student-centered curriculum. A comprehensive, valid and reliable tool is essential in order to lead such evaluation. One of the patterns to measure the learning environment is DELES (distance education learning environments survey) measurement tool which is a specialized questionnaire to assess distance learning environment setting.

Methods: This is a descriptive and analytic study. The study population is the distance medical education students of Iran University of medical science in master of sciences. The method of collecting data on the implementation of this project was census sampling method and the sample size included 150 students. Content and face validity was evaluated with 20 experts familiar with clinical education and structural validity evaluated using factor analysis method. Reliability stability was assessed through test - retest and internal consistency reliability was measured using Cronbach's alpha co-efficiency and whole data analyzed using SPSS 16 Software.

Results: The DELES Questionnaire with an average score of 77.10 ± 17.8 (64%) of 120 was obtained good rating in the assessment. The content validity of the questionnaire was confirmed. Average content validity of the ratio (CVR) 0.30 was calculated, and 12 questions eliminated at this stage. Content validity of the Index (CVI) was calculated 0.42. In exploratory factor analysis of KMO, 0.856 was achieved, and the Bartlett test was significant: (p≤0.0001) Seven factors were confirmed that basis of a few questions was changed (coverage of variance=73.739%). Cronbach's alpha coefficient of the questionnaire was 0.937.

Conclusion: The modified "DELES" Questionnaire in Persian language including 30 questions was presented with appropriate psychometric conditions that could be applied to assess distance education learning environments in medical education students of our country.


Ahmadi Ahmadi Ghozlojeh, , Hosein Delavari, Atefeh Ramazani,
Volume 26, Issue 5 (8-2019)
Abstract

Background: Under stressful circumstances, such as confrontation with a life-threatening disease, people often make comparisons with each other, which can have effects on their psychological and physical well-being. This research aimed to evaluate the validity and reliability of Persian version of social comparisons during chronic illness scale.
Methods: The study was descriptive with a correlational design. Among the diabetic patients referring to the Goodarz and Sadoghi hospital hospitals of Yazd in 1396, 200 subjects were randomly selected. Validity of this scale was determined by using content, criterion and construct validity methods. In order to assess the construct validity, exploratory factor analysis and calculating the correlation coefficient of factors and items with total score, and to assess of criterion validity, the social support (Sohrabi et al, 2007) and world health organization's WHOQOL-BREF quality of life assessment scales as a criterion were used. Also, the reliability of the scale was evaluated using the Cronbach's alpha coefficient. Cronbach's alpha coefficient, Pearson correlation coefficient and exploratory factor analysis methods were used and data was analyzed using SPSS version 21software.
Results: Negative interpretation and Positive interpretation factors were extracted as using principal components analysis method. The correlation coefficient between the items with the total score was between 0.31 to 0.87, which were significant and confirms coefficients construct validity of the scale. Also, the correlation coefficients between this scale with social support and quality of life were 0.56 and 0.72, which confirmed the criterion validity. Cronbach's alpha coefficients of negative interpretation factor, positive interpretation factor and total scale were found to be 0.98, 0.86, and 0.92 respectively.
Conclusion: According to the results of this research, the Persian version of the social comparison scale during chronic illness can be used as a valid and reliable tool for researchers in the field of social comparison in people with chronic disease.
Alireza Mohebbi, Kimia Javadinejad, Maryam Roomiani, Hessam Jahandideh,
Volume 29, Issue 1 (3-2022)
Abstract

Background & Aims: Rhinoplasty is one of the most popular types of cosmetic surgeries performed by otorhinolaryngologists. Rhinoplasty is a challenging and complex surgery because it is designed according to the unique needs of each patient (1). In 2013, men accounted for approximately 20 percent of all rhinoplasty procedures and non-whites accounted for nearly 30 percent of the patient population. In addition, the age of candidates for rhinoplasty was wide and about half of the patients were between 19 and 34 years old and the other half of the patients were under 19 years old or older (2). The existence of tools to measure patients' satisfaction with the results of their surgery can give surgeons a better view to optimize the methods and quality of their surgeries. One of the common methods for evaluating surgical results in terms of patients satisfaction is through the quality of life questionnaires. Especially in rhinoplasty, this method of evaluation aims to examine the direct effect of surgery on patient satisfaction with self-image and consequently self-esteem (3-5). As a result, the validity of such questionnaires is significant. Researchers can use these tools to assess the quality of surgery and optimize methods based on individual characteristics (6). Rhinoplasty Outcome Evaluation (ROE) is one of the questionnaires used today to assess patients' willingness and satisfaction with rhinoplasty (7, 8). In 2021, Mulafikh et al. published a study in Arabic aimed at translating, intercultural matching, and validating the outcome of ROE. This non-randomized prospective study included 50 patients and a control group of 89 healthy individuals who underwent primary rhinoplasty from January to October 2020 in the Department of Otolaryngology, King Saud University, Riyadh, Saudi Arabia. There was a significant difference in ranking between rhinoplasty patients and the control group on both individual questions and total scores. Significant improvement in patient group ranking was observed in 2 weeks and 3 months after surgery compared to preoperative score (P <0.0001). Based on the conclusion of this study, the Arabic version ROE showed good internal consistency, reliability, and credibility and can be used to evaluate the results of rhinoplasty in the Arab population (9). The questionnaire has been translated into German, Turkish, Arabic, and many other languages, but so far in Iran, there is no scale to measure patients' satisfaction with rhinoplasty (10-12). It can be used for many Iranian patients and surgeons. This study aimed to evaluate the validity and reliability of the translated ROE Questionnaire.
Methods: The ROE questionnaire was translated by two independent translators and then it was translated back into English and was compared with the original one. With the expert panel reviews, its Content Validity Ratio (CVR) and Content Validity Index (CVI) were calculated. Then, patients who underwent rhinoplasty in Firoozgar Hospital and a private center in Tehran in 2016, for the first time and without any simultaneous facial surgeries, were included in this study, and again two weeks after the operation. This research was done with the approval of the ethics committee of the research vice-chancellor of the Iran University of Medical Sciences (IR.IUMS.FMD.REC.1399.849).
Results: Expert panel consisted of 10 experts that expressed their views on the questionnaire items. The CVR coefficient for all items except the second item was above 0.62, for which the coefficient was measured to be 0.564. The CVI coefficient was also reported to be 0.8 for all items. The mean total score of 87 patients at the first completion was 43.14 (±15.32), which two weeks later reached 41.58 (±15.60) (p > 0.05), this indicates that the Persian version of ROE has good reliability. The postoperative score was 68.48 (±12.49) which was significantly improved (p <0.05).
Conclusion: In our study, differences in gender, age, and education had did not affect postoperative satisfaction scores using ROE. The results of our study are consistent with previous studies (3, 7, 10, 11). This study had a lower item-total correlation coefficient for question 2 like the Arabic version of ROE because unlike the rest of the questions, the second question was related to the functional aspect of rhinoplasty and patients were worried about aesthetic aspects of rhinoplasty (10). Despite this, as the only question about nasal obstruction, and high total post-operative scores we found this question important and applicable for the Persian version of ROE. Izu et al. Introduced a cut-off point of 12 out of 24 or 50% for ROE to be used as a tool to evaluate surgical outcomes and to help predict outcomes (12). In our study, the mean total ROE score in individuals at the first time of completing the questionnaire and after surgery was significantly different (p-value <0.05). Patients reported a score lower than this incision point before surgery and more than 50% after surgery. This indicates the high satisfaction of patients with the surgical outcome. Other studies have used ROE to demonstrate the results of rhinoplasty and its high impact on quality of life, and have concluded that long-term follow-up increases patient satisfaction with rhinoplasty. For this reason, follow-up is important to help evaluate outcomes and long-term patient satisfaction (7, 13, 14). The limitations of the present study were the inability to examine patients in different medical centers, a relatively small sample size, and a short follow-up period. Also, the patients' satisfaction after long-term and medium-term surgery was not evaluated. To increase the accuracy of this questionnaire, this questionnaire should be repeated at different times and places. Also, the surgeon using this questionnaire should pay attention to long-term follow-up of rhinoplasty and ways to improve patients' quality of life.
So far, no tool has been introduced to measure patients' satisfaction with the shape of the nose and the outcome of surgery after rhinoplasty, in Iran. The results of our study showed that the Persian version of ROE has good reliability, validity, and credibility, and its results are comparable to ROE questionnaires that have already been translated, adapted, and published in the literature review, as well as the original ROE. Therefore, this tool can be used to evaluate the results of rhinoplasty and many applications can be imagined for it.


Mehrab Mafakheri, Kamyar Mansori, Ali Salehi, Mohsen Akbarian, Narges Saeidi,
Volume 29, Issue 4 (7-2022)
Abstract

Background & Aims: Due to the international pain association, pain is usually defined as sensory and emotional experiences associated with actual or potential tissue damage. Chronic pain: pain with unknown etiology that lasts for more than 6 months after the lesion has healed and leads to emotional distress and increased use of resources in health care systems (1). Studies conducted among the Iranian population indicating that pain is a common phenomenon (2). and also, in some groups of patients, especially patients with experience of trauma and patients with post-traumatic stress disorder (3). The literature indicates that the experience of trauma can be considered as a predisposing factor in many diseases with chronic pain (4).in addition people who experienced trauma were more likely to develop physical, psychosomatic, and psychological disorders. And this issue, in the absence of the necessary precautions, leads to huge financial and psychological costs among the affected population for recovery and treatment (9,10). According to researches, in our country, Iran, less attention has been paid to the experience of trauma in the research. Also, there is no proper tools for screening these patients to use it for early assessment and identification of injured patients. In this regard, the Life Events Checklist (LEC) tool was developed and evaluated in accordance with the fifth edition of the Diagnostic and Statistical Manual of Mental Disorders (LEC). The tool consists of 17 items and is designed to assess exposure to potentially traumatic events based on diagnostic criterion A for PTSD in accordance with the DSM-5 (9). Therefore, the researcher had two options to build a new tool or translate existing tools from the original language into Persian and determine its validity and reliability and cultural adaptation to his country and society.
Methods: The method of study is a cross-sectional descriptive and validation research. The statistical population of the study consisted of all patients that suffer from chronic pain. The sample size was determined by considering at least 300 participants for studies based on confirmatory factor analysis (15) and also using Krejcie and Morgan chart (16). The sample size was 350 participants. Three chronic pain clinics (chronic pain clinic, chronic pain clinic of Imam Khomeini, chronic pain clinic of Dr. Shariati hospital) were selected in Tehran. Due to the prevalence of COVID-19 to reduce the risk of transmission of the disease, an online questionnaire was designed to send links to the participant's cellphones, and after the necessary explanations, the individuals completed the questionnaires if they were satisfied. Inclusion criteria include age over 18 years, diagnosis of chronic pain by a chronic pain specialist, literacy and exclusion criteria include disagreement with the research conditions and having any physical disability that prevents participation in the study. Data collection was done with a life events checklist that contains 17 phrases which scored on a 6-point scale. To prepare the tool, first, items of the questionnaire was translated into Persian by two master's degree students in psychology. The validity of the content was then assessed by a faculty member in psychology. In the next step, the items were returned to English by a senior English language expert who had not previously read the original version of the questionnaire, and then the original version and the translated version of the questionnaire were reviewed by psychologists to prevent semantic difference in it. After the final version was prepared, the questionnaire was distributed among 36 participants with chronic pain as a pilot and the desired problems in some items were resolved. All participants were given written letter consent including a brief explanation of the objectives, research method, and principle of confidentiality and anonymity. After obtaining consent, participants were asked to complete a package of self-report questionnaires including a life event checklist scale, a chronic pain catastrophe scale, chronic pain self-efficacy, and life satisfaction.
Data were analyzed by SPSS software version 25 and LISREL software version 8/8. In order to analyze the data from descriptive statistics (mean, standard deviation, frequency and percentage) as well as Cronbach's alpha method and retest test to examine internal consistency, the correlation of life events checklist scale with DASS-21 questionnaires and chronic pain catastrophe To assess convergent validity and the correlation of this questionnaire with chronic pain self-efficacy and life satisfaction questionnaires was used to assess divergent validity. Confirmatory factor analysis of LISREL version 8/8 was used for construct validity. Exploratory factor analysis was also used to determine the frequency of factors.
Results: The results showed that the phrases had good internal consistency and diagnostic power, except for the seventeenth question, which was excluded from the questionnaire. The correlation of the phrases with the total score varied from 0.27 for phrase 16 to 0.66 for phrase 4 and 14, Cronbach's alpha for the whole scale was equal to 0.86, which indicates the acceptable internal consistency of this instrument. The rate of retesting the questionnaire with a sample of 40 individuals in a period of 3 weeks was equal to 0.85, which is an acceptable score. Also, by considering the KMO value equal to 0/85 and rejecting the null hypothesis in the Bartlett sphericity test (p = 0.000, df = 136, x2 = 1786.27), The results showed that the conditions are ready for factor analysis. Primary analysis indicated four factors. The Scree diagram also supported the four-factor structure. The results related to factor loads show that all expressions have a common variance and a factor load greater than 0.46, in total, the four factors explain 0.56 variance. In the study, RMSEA between 0.8 and 0.10 indicates acceptable model and 0.95 CFI≥ indicates good model fit (27). According to the obtained results and the number of indices after using CFI (comparative fit index) correction indices value 0.95 GFI (goodness of fit index) value 0.90 and (normed fit index) NFI value 0.93 and also index the standardized root error of the mean squares of the RMSEA approximation is 0.7 and the degree of freedom x2 / df is less than 3, all indicating the relative suitability of the model after reformation.
Conclusion: Findings of the study indicated that the Persian version of the scale has an acceptable internal consistency in a sample of chronic pain patients. The findings were consistent with the results of Matt Gray et al., In which Cronbach’s alpha was reported in the study (18). The findings consistent with the study of Halip Bae et al., In whose study Cronbach's alpha was reported 0.66 (12). Another study conducted in South Korea were inconsistent with our findings. In explaining this issue, the concept of culturally oriented trauma can be well justified. In other words, the phenomenon of trauma has a cultural aspect and it is the cultural beliefs of a society that determine the traumatic nature of an event (29, 30). In general, according to the results it can be concluded that the checklist of life events in the Iranian sample with chronic pain is valid and the LEC scale has acceptable psychometric properties. Therefore, therapists and specialists in the field of mental health can use this screening tool in research to diagnose and evaluate trauma in order to prevent or reduce consequences and pathological symptoms.
 

Page 1 from 1     

© 2025 CC BY-NC-SA 4.0 | Razi Journal of Medical Sciences

Designed & Developed by : Yektaweb