Assessing the Validity and Reliability of a Questionnaire for Evaluating Pharmaceutical Services at a Hospital
DOI:
https://doi.org/10.37034/medinftech.v2i2.35Keywords:
Hospital, Pharmaceutical Services, Pharmacist, Quality Evaluation, QuestionnaireAbstract
Pharmaceutical services are vital components of the healthcare system that aim to ensure the appropriate, safe, and effective use of medicines. This study aims to develop and test the validity and reliability of a questionnaire for assessing the quality of pharmaceutical services at a hospital in Jakarta. The questionnaire was designed based on five service quality dimensions: tangibles, reliability, assurance, empathy, and responsiveness. An initial set of 23 statement items was tested for content validity by calculating the Content Validity Ratio (CVR) and Content Validity Index (CVI). Several items were eliminated for not meeting the validity threshold. Subsequently, construct validity was tested by calculating Pearson product-moment correlations on data from 100 respondents who met the inclusion criteria, resulting in 13 valid statement items with r > 0.148. Reliability tests indicated Cronbach’s Alpha values above 0.6 for all dimensions, demonstrating good internal consistency of the questionnaire. Hypothesis testing results showed that all statement items had a significant relationship with the total questionnaire score (p < 0.05). Therefore, the questionnaire is valid and reliable for evaluating the quality of pharmaceutical services at a hospital in Jakarta.
Downloads
References
D. N. R. Mastuti, T. Irawan, and M. Marfuatun, “KualitasPelayanan Kesehatan pada Masa Pandemi Covid-19 di Puskesmas Tondano Kota Pekalongan,” Pena Med. J. Kesehat., vol. 12, no. 2, p. 266, 2023, doi: 10.31941/pmjk.v12i2.2684.
A. P. Sulaeman, H. Fajarini, and R. F. Balfas, “Evaluasi Pelayanan Informasi Obat di Apotek Berdasarkan Peraturan Menteri Kesehatan Republik Indonesia Nomor 73 Tahun 2016,” MOTEKAR J. Multidisiplin Teknol. dan Arsit., vol. 1, no. 2, pp. 116–125, 2023, doi: 10.57235/motekar.v1i2.1168.
M. A. Abbasi-Moghaddam, E. Zarei, R. Bagherzadeh, H. Dargahi, and P. Farrokhi, “Evaluation of service quality from patients’ viewpoint,” BMC Health Serv. Res., vol. 19, no. 1, pp. 1–7, 2019, doi: 10.1186/s12913-019-3998-0.
N. Amara, A. Y. Naser, and E. O. Taybeh, “Patient Satisfaction with Pharmaceutical Services in Jordan: A Cross-Sectional Study,” Jordan J. Pharm. Sci., vol. 16, no. 1, pp. 1–10, 2023, doi: 10.35516/jjps.v16i1.1030.
M. Kayyali, “An Overview of Quality Assurance in Higher Education: Concepts and Frameworks Manager of Higher Education Quality and Assessment Council HEQAC,” Sci. Innov. Technol. IJMSIT Rev. Pap., vol. 4, no. 2, pp. 1–04, 2023, [Online]. Available: https://ijmsit.com/volume-4-issue-2/
A. Mungmode et al., “Making Diabetes Electronic Medical Record Data Actionable: Promoting Benchmarking and Population Health Improvement Using the T1D Exchange Quality Improvement Portal,” Clin. Diabetes, vol. 41, no. 1, pp. 45–55, 2023, doi: 10.2337/cd22-0072.
A. Chowdhury, M. A. Ali, M. M. Hossain, M. M. Uddin, S. H. Naqib, and A. K. M. A. Islam, “Predicted MAX phase Sc 2 InC : Dynamical stability , vibrational and optical properties The structure of ternary layered carbide , Sc 2 InC , is shown in Fig . 1 . This MAX phase crystallizes with space group P63 / mmc ( 194 ) belonging to the hexagonal s”.
S. H. Sharkiya, “Quality communication can improve patient-centred health outcomes among older patients: a rapid review,” BMC Health Serv. Res., vol. 23, no. 1, pp. 1–15, 2023, doi: 10.1186/s12913-023-09869-8.
J. Alves and W. Yang, “Cognitive Mechanisms in Entrepreneurship Competence: Its Implication for Open Innovation,” J. Open Innov. Technol. Mark. Complex., vol. 8, no. 2, 2022, doi: 10.3390/joitmc8020065.
C. E. Chang et al., “Development and validation of a pharmaceutical assessment screening tool to prioritise patient care in a tertiary care hospital,” PLoS One, vol. 18, no. 3 March, pp. 1–15, 2023, doi: 10.1371/journal.pone.0282342.
A. ur Rahman, W. Manzoor, N. Yasmin, R. M. S. Yaqub, and M. S. Ali, “From Service Quality to Brand Loyalty: The Mediating Effect of Student Satisfaction in Public Sector Universities,” Pakistan J. Humanit. Soc. Sci., vol. 12, no. 2, pp. 1225–1240, 2024, doi: 10.52131/pjhss.2024.v12i2.2215.
L. P. F. Larasanty, M. K. A. Jaya, K. W. Astuti, and I. W. M. Santika, “Pengembangan Kuisioner Udayana untuk Penilaian Kepuasan Pasien terhadap Pelayanan Kefarmasian oleh Apoteker di Pusat Kesehatan Masyarakat,” J. Manaj. DAN PELAYANAN Farm. (Journal Manag. Pharm. Pract., vol. 11, no. 1, p. 62, 2021, doi: 10.22146/jmpf.60998.
S. Lee, O. P. Godwin, K. Kim, and E. Lee, “Predictive factors of patient satisfaction with pharmacy services in South Korea: A cross-sectional study of national level data,” PLoS One, vol. 10, no. 11, pp. 1–9, 2015, doi: 10.1371/journal.pone.0142269.
A. Ismail, Y. N. Gan, and N. Ahmad, “Factors associated with patient satisfaction towards pharmacy services among outpatients attending public health clinics: Questionnaire development and its application,” PLoS One, vol. 15, no. 11 November, pp. 1–12, 2020, doi: 10.1371/journal.pone.0241082.
W. Ayenew et al., “Assessment of community pharmacy professionals’ willingness, involvement, beliefs, and barriers to offer health promotion services: a cross-sectional study,” BMC Health Serv. Res., vol. 22, no. 1, pp. 1–9, 2022, doi: 10.1186/s12913-022-08944-w.
L. Soubra and G. Elba, “Pharmacist Role in Hypertension Management in the Community Setting: Questionnaire Development, Validation, and Application,” Patient Prefer. Adherence, vol. 17, no. February, pp. 351–367, 2023, doi: 10.2147/PPA.S394855.
H. Maulana, “Analisis Kualitas Instrumen Evaluasi Pembelajaran Menggunakan Media Digitalisasi Untuk Memotivasi Hasil Belajar Peserta Didik,” J. Pendidik. Bhinneka Tunggal Ika, vol. 1, no. 4, pp. 1–12, 2023, [Online]. Available: https://doi.org/10.51903/bersatu.v1i4.255
M. Bîrsan et al., “Healthcare Service Quality Evaluated Using the Degree of Satisfaction of Patients in Romanian Community Pharmacies,” Healthc., vol. 11, no. 23, pp. 1–16, 2023, doi: 10.3390/healthcare11233038.
M. Newman, E. Pherson, B. Burton, and E. Nemec, “Establishing the Content Validity of a Student Pharmacist Patient Counseling Competency Assessment in Oncology,” Am. J. Pharm. Educ., vol. 86, no. 6, pp. 679–684, 2022, doi: 10.5688/ajpe8708.
M. Guillot-Valdés, A. Guillén-Riquelme, and G. Buela-Casal, “Content Validity through Expert Judgment for the Depression Clinical Evaluation Test,” Int. J. Clin. Heal. Psychol., vol. 22, no. 2, 2022, doi: 10.1016/j.ijchp.2022.100292.
S. Desai and N. Patel, “Development and Validity of Questionnaire for Healthy Adult Human Participants of Early Phase Bioequivalence Pharmacokinetic Endpoint Study,” Res. J. Pharmacol. Pharmacodyn., vol. 13, no. 4, pp. 111–117, 2021, doi: 10.52711/2321-5836.2021.00023.
P. B. Tchounwou, “Environmental Research and Public Health,” Int. J. Environ. Res. Public Health, vol. 1, no. 1, pp. 1–2, 2004, doi: 10.3390/ijerph2004010001.
H. Alhamad and P. Donyai, “The Validity of the Theory of Planned Behaviour for Understanding People’s Beliefs and Intentions toward Reusing Medicines,” Pharmacy, vol. 9, no. 1, p. 58, 2021, doi: 10.3390/pharmacy9010058.
S. R. Carter, R. Ng, S. El-Den, and C. R. Schneider, “A patient-reported experience measure for community pharmacy including development of a short-form: The perceived service quality scale,” Res. Soc. Adm. Pharm., vol. 18, no. 8, pp. 3369–3378, 2022, doi: 10.1016/j.sapharm.2021.11.011.
T. Gizaw, M. Bogale, and T. Gudeta, “Investigating the effect of pharmaceutical logistics service performance on customer satisfaction: a two-step approach with structural equation modeling,” J. Pharm. Policy Pract., vol. 14, no. 1, pp. 1–12, 2021, doi: 10.1186/s40545-021-00351-6.
Agustien, G. Septiani, E. Suhardina, and F. Sidik, “Analisis Tingkat Kepuasan Pasien Rawat Jalan terhadap Pelayanan Farmasi Klinis di Puskesmas Bungursari Tasikmalaya,” Poltekkes Kemenkes Tasikmalaya, pp. 104–112, 2022.
J. Davda, H. Kibet, E. Achieng, L. Atundo, and T. Komen, “Assessing the acceptability, reliability, and validity of the EORTC Quality of Life Questionnaire (QLQ-C30) in Kenyan cancer patients: a cross-sectional study,” J. Patient-Reported Outcomes, vol. 5, no. 1, 2021, doi: 10.1186/s41687-020-00275-w.
K. Jokiniemi, A. M. Pietilä, and S. Mikkonen, “Construct validity of clinical nurse specialist core competency scale: An exploratory factor analysis,” J. Clin. Nurs., vol. 30, no. 13–14, pp. 1863–1873, 2021, doi: 10.1111/jocn.15587.
H. Taherdoost, “Validity and Reliability of the Research Instrument; How to Test the Validation of a Questionnaire/Survey in a Research,” SSRN Electron. J., vol. 5, no. 3, pp. 28–36, 2018, doi: 10.2139/ssrn.3205040.
Y. F. Zakariya, “Cronbach’s alpha in mathematics education research: Its appropriateness, overuse, and alternatives in estimating scale reliability,” Front. Psychol., vol. 13, no. December, pp. 1–6, 2022, doi: 10.3389/fpsyg.2022.1074430.
I. Kusmaryono, D. Wijayanti, and H. R. Maharani, “Number of Response Options, Reliability, Validity, and Potential Bias in the Use of the Likert Scale Education and Social Science Research: A Literature Review,” Int. J. Educ. Methodol., vol. 8, no. 4, pp. 625–637, 2022, doi: 10.12973/ijem.8.4.625.
M. Amirrudin, K. Nasution, and S. Supahar, “Effect of Variability on Cronbach Alpha Reliability in Research Practice,” J. Mat. Stat. dan Komputasi, vol. 17, no. 2, pp. 223–230, 2020, doi: 10.20956/jmsk.v17i2.11655.
E. Druică, R. Ianole-Călin, C. Băicuș, and R. Dinescu, “Determinants of satisfaction with services, and trust in the information received in community pharmacies: A comparative analysis to foster pharmaceutical care adoption,” Healthc., vol. 9, no. 5, 2021, doi: 10.3390/healthcare9050562.
O. NNEOMA and E. OBINNA, “Development of Quality Indicators for Pharmaceutical Care Performance Assessment in Nigerian Community Pharmacies: a Delphi Panel,” Int. J. Pharm. Pharm. Sci., vol. 13, no. 2, pp. 50–55, 2021, doi: 10.22159/ijpps.2021v13i2.39179.
D. A. Juwita, N. Q. Desri, and D. Permatasari, “Patient Satisfaction with Pharmaceutical Services at a Hospital Outpatient Pharmacy in West Sumatra, Indonesia,” J. Farm. Dan Ilmu Kefarmasian Indones., vol. 10, no. 3, pp. 324–330, 2023, doi: 10.20473/jfiki.v10i32023.324-330.
R. Harrison, B. Jones, P. Gardner, and R. Lawton, “Correction to: Quality assessment with diverse studies (QuADS): an appraisal tool for methodological and reporting quality in systematic reviews of mixed- or multimethod studies (BMC Health Services Research, (2021), 21, 1, (144), 10.1186/s12913-021-06122-y),” BMC Health Serv. Res., vol. 21, no. 1, pp. 1–20, 2021, doi: 10.1186/s12913-021-06261-2.
R. Roy, G. M. Sukumar, M. Philip, and G. Gopalakrishna, “Face, content, criterion and construct validity assessment of a newly developed tool to assess and classify work–related stress (TAWS– 16),” PLoS One, vol. 18, no. 1 January, pp. 1–11, 2023, doi: 10.1371/journal.pone.0280189.
S. Park et al., “Validation of a questionnaire for patient awareness and the need for a community-based outpatient antimicrobial stewardship program (O-asp): A pilot study,” Antibiotics, vol. 10, no. 4, pp. 1–13, 2021, doi: 10.3390/antibiotics10040441.
J. C. Fernández-Domínguez, A. Sesé-Abad, J. M. Morales-Asencio, P. Sastre-Fullana, S. Pol-Castañeda, and J. E. De Pedro-Gómez, “Content validity of a health science evidencebased practice questionnaire (HS-EBP) with a web-based modified Delphi approach,” Int. J. Qual. Heal. Care, vol. 28, no. 6, pp. 764–773, 2016, doi: 10.1093/intqhc/mzw106.
M. S. B. Yusoff, “ABC of Content Validation and Content Validity Index Calculation,” Educ. Med. J., vol. 11, no. 2, pp. 49–54, 2019, doi: 10.21315/eimj2019.11.2.6.
