Development Two Tier Multiple Choice for Measure Students' Higher-Order Thinking Skills in Physics Learning
Abstract
The two-tier multiple-choice question comprises two levels: the initial level centers on understanding the materials' notion. Conversely, the second tier elucidates the rationale for the correctness of the response provided in the first tier. Higher-order thinking skills can be assessed using a two-tier multiple-choice format. This study aims to create a set of two-tier multiple-choice questions that can effectively assess students' advanced cognitive abilities in physics. The research development employed the ADDIE development model, encompassing the five phases of analysis, design, development, implementation, and evaluation. The two-tier multiple-choice test comprises 21 questions assessing the capacity to analyze, evaluate, and generate knowledge on sound waves. The participant group comprised 99 eleventh-grade students from Senior High School in Bandung. The content validity was assessed using the Aiken formula, while the empirical validity and reliability were analyzed using the Rasch model through the Winstep Application. The two-tier multiple-choice assessment method is applicable and viable for evaluating higher-order thinking skills (HOTS) in sound wave content.
References
Aiken, L. R. (1980). Content validity and reliability of single items or questionnaires. Educational and Psychological Measurement, 40(4), 955–959.
Andriyatno, I., Zulfiani, Z., & Mardiati, Y. (2023). Higher Order Thinking Skills: Student Profile Using Two-Tier Multiple Choice Instrument. International Journal of STEM Education for Sustainability, 3(1), 111–124. https://doi.org/10.53889/ijses.v3i1.79
Aviory, K., & Susetyawati, M. M. . (2021). KUALITAS SOAL HOTS (HIGH ORDER THINKING SKILL) PADA PESERTA DIDIK SMP KELAS VII. AKSIOMA, 10(2), 639–647.
Azizah, A., Wahyuningsih, S., Kusumasari, V., Asmianto, A., & Setiawan, D. (2021). Validity and reliability of mathematical instruments in online learning using the Rasch measurement model at UM lab school. AIP Conference Proceedings, 2330(March). https://doi.org/10.1063/5.0043356
Dewi, N. P., Rahmi, Y. L., Alberida, H., & Darussyamsu, R. (2020). Validitas dan reliabilitas instrumen penilaian kemampuan berpikir tingkat tinggi tentang materi hereditas untuk peserta didik SMA/MA [The validity and reliability of the high-order thinking ability assessment instrument on heredity material for senior high school students]. Jurnal Eksakta Pendidikan (Jep), 4(2), 138.
Hubers, M. D. (2022). Using an Evidence-Informed Approach to Improve Students’ Higher Order Thinking Skills. Education Sciences, 12(11). https://doi.org/10.3390/educsci12110834
Istiyono, E., Dwandaru, W. S. B., Setiawan, R., & Megawati, I. (2020). Developing of computerized adaptive testing to measure physics higher order thinking skills of senior high school students and its feasibility of use. European Journal of Educational Research, 9(1), 91–101. https://doi.org/10.12973/eu-jer.9.1.91
Kahar, M. S., Syahputra, R., Arsyad, R. Bin, Nursetiawan, N., & Mujiarto, M. (2021). Design of Student Worksheets Oriented to Higher Order Thinking Skills (HOTS) in Physics Learning. Eurasian Journal of Educational Research, 2021(96), 14–29. https://doi.org/10.14689/ejer.2021.96.2
Obeidat, F. A. A., & Saleh, S. (2022). The Relationship of Fluid Intelligence Level with Higher-order Thinking Skills in Work and Energy among Sixth-grade Students in Jordan. Journal of Curriculum and Teaching, 11(4), 224–234. https://doi.org/10.5430/jct.v11n4p224
Pusat Penilaian Pendidikan Balitbang Kemendikbud. (2019). Pendidikan di Indonesia Belajar dari Hasil PISA 2018. Pusat Penilaian Pendidikan Balitbang Kemendikbud, 021, 1–206.
Ramadhan, S., Mardapi, D., Prasetyo, Z. K., & Utomo, H. B. (2019). The development of an instrument to measure the higher order thinking skill in physics. European Journal of Educational Research, 8(3), 743–751. https://doi.org/10.12973/eu-jer.8.3.743
Siregar, P. S., Hatika, R. G., & Hayadi, B. H. (2023). Multiple Choice Question Difficulty Level Classification with Multi Class Confusion Matrix in the Online Question Bank of Education Gallery. Journal of Applied Data Sciences, 4(4), 392–406. https://doi.org/10.47738/jads.v4i4.132
Sumintono, B., & Widhiarso, W. (2014). Aplikasi Model Rasch untuk Penelitian Ilmu-Ilmu Sosial (1st ed.). Trim Komunikata.
Sumintono, B., & Widhiarso, W. (2015). Aplikasi Pemodelan Rasch pada Assessment Pendidikan (1st ed.). Trim Komunikata.
Suprapto, E., Saryanto, S., Sumiharsono, R., & Ramadhan, S. (2020). The Analysis of Instrument Quality to Measure the Students’ Higher Order Thinking Skill in Physics Learning. Journal of Turkish Science Education, 17(4), 520–527. https://doi.org/10.36681/tused.2020.42
Tanudjaya, C. P., & Doorman, M. (2020). Examining higher order thinking in Indonesian lower secondary mathematics classrooms. Journal on Mathematics Education, 11(2), 277–300. https://doi.org/10.22342/jme.11.2.11000.277-300
Widyaningsih, S. W., Yusuf, I., Prasetyo, Z. K., & Istiyono, E. (2021). The development of the hots test of physics based on modern test theory: Question modeling through e-learning of moodle lms. International Journal of Instruction, 14(4), 51–68. https://doi.org/10.29333/iji.2021.1444a
Yusuf, I., & Widyaningsih, S. W. (2022). Higher Order Thinking Skills Oriented Student Worksheet of E-learning Model in Electric Circuit Topic. TEM Journal, 11(2), 564–573. https://doi.org/10.18421/TEM112-10
Copyright (c) 2024 ICEETE Conference Series
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
All rights reserved. No part of this publication may be reproduced, distributed, or transmitted in any form or by any means, including photocopying, recording, or other electronic or mechanical methods, without the prior written permission of the publisher, except in the case of brief quotations embodied in critical reviews and certain other noncommercial uses permitted by copyright law. For permission requests, write to the publisher at the address below.
The ICEETE Conference Series on Economy, Education, Technology, and Environment retains the copyright of all published papers. Any unauthorized reproduction or distribution of the conference papers will be considered a violation of copyright. Permission to use the content of this conference series for any purpose must be obtained from the copyright owner.
