Specific Open-Ended Assessment: Assessing Students' Critical Thinking Skill on Kinetic Theory of Gases

Riki Perdana, Riwayani Riwayani, Jumadi Jumadi, Dadan Rosana, Soeharto Soeharto

Abstract


The test of critical thinking skills in specific topics in physics is still rarely. This study aimed to develop a specific test in critical thinking skills in the kinetic theory of gases (CTKTG) and also to assess the students' critical thinking skills. This study used the 4D method (Define, Design, Develop, and Disseminate). The CTKTG test was initially tested in four sample groups: interviews with an expert review (N = 3), professional physics teachers (N = 2), and graduate school students (N = 2), students from secondary schools (N = 29). The test was modified based on the revised results in the initial test. After that, the test was given to a group of students in class XI, who were science students (N = 55). The results showed that internal consistency from the CTKTG test was α = .89 (good). The implementation strategies and tactics are the most difficult aspect of critical thinking skill with a mean of 1.37 (very low) and basic classification is easiest with a mean of 2.84 (average). So, the findings showed that the CTKTG test can be used to measure students' critical thinking skills on the topic of the kinetic theory of gases.

Keywords


Critical Thinking Skill; Kinetic Theory of Gases; Open-Ended

Full Text:

PDF

References


Ayre, C., & Scally, A. J. (2014). Critical Values for Lawshe’s Content Validity Ratio: Revisiting the Original Methods of Calculation. Measurement and Evaluation in Counseling and Development. https://doi.org/10.1177/0748175613513808

Azis, A., Muhammad Aqil Rusli, A., & Yusuf, M. (2016). Critical Thinking Skill of Student Through Top Down Approach in Physics Learning. ICMSTEA 2016.

Bai, X., & Ola, A. (2017). A Tool for Performing Item Analysis to Enhance Teaching and Learning Experiences. Issues in Information Systems, 18(1), 128–136.

Bai, Xue, & Ola, A. (2017). A Tool for Performing Item Analysis to Enhance Teaching and Learning Experiences. Issues in Information Systems, 18(1), 128–136.

Carter, A. G., Creedy, D. K., & Sidebotham, M. (2016). Development and Psychometric Testing of the Carter Assessment of Critical Thinking in Midwifery (Preceptor/Mentor version). Midwifery. https://doi.org/10.1016/j.midw.2015.12.002

Cheng, P. G. F., Ramos, R. M., Bitsch, J. A., Jonas, S. M., Ix, T., See, P. L. Q., & Wehrle, K. (2016). Psychologist in a Pocket: Lexicon Development and Content Validation of a Mobile-Based App for Depression Screening. JMIR MHealth and UHealth. https://doi.org/10.2196/mhealth.5284

Davenport, E. C., Davison, M. L., Liou, P. Y., & Love, Q. U. (2015). Reliability, Dimensionality, and Internal Consistency as Defined by Cronbach: Distinct Albeit Related Concepts. Educational Measurement: Issues and Practice. https://doi.org/10.1111/emip.12095

El Masri, Y. H., Ferrara, S., Foltz, P. W., & Baird, J. A. (2017). Predicting Item Difficulty of Science National Curriculum Tests: The Case of Key Stage 2 Assessments. Curriculum Journal. https://doi.org/10.1080/09585176.2016.1232201

Fuad, N. M., Zubaidah, S., Mahanal, S., & Suarsini, E. (2017). Improving Junior High Schools’ Critical Thinking Skills Based on Test Three Different Models of Learning. International Journal of Instruction, 10(1), 101–116.

Gelerstein, D., Río, R. del, Nussbaum, M., Chiuminatto, P., & López, X. (2016). Designing and Implementing A Test for Measuring Critical Thinking in Primary School. Thinking Skills and Creativity. https://doi.org/10.1016/j.tsc.2016.02.002

Ghazivakili, Z., Norouzi Nia, R., Panahi, F., Karimi, M., Gholsorkhi, H., & Ahmadi, Z. (2014). The Role of Critical Thinking Skills and Learning Styles of University Students in Their Academic Performance. Journal of Advances in Medical Education & Professionalism.

Gurel, D. K., Eryilmaz, A., & McDermott, L. C. (2015). A Review And Comparison of Diagnostic Instruments to Identify Students’ Misconceptions in Science. Eurasia Journal of Mathematics, Science and Technology Education, 11(5), 989–1008. https://doi.org/10.12973/eurasia.2015.1369a

Hajcak, G., Meyer, A., & Kotov, R. (2017). Psychometrics and the Neuroscience of Individual Differences: Internal Consistency Limits Between-Subjects Effects. Journal of Abnormal Psychology. https://doi.org/10.1037/abn0000274

Harjo, B., Kartowagiran, B., & Mahmudi, A. (2019). Development of Critical Thinking Skill Instruments on Mathematical Learning High School. International Journal of Instruction, 12.(4), 149–166.

Hashim, A., & Samsudin, N. S. B. (2019). Level of Critical Thinking Skills Among Students of Tahfiz School. International Journal of Academic Research in Business and Social Sciences, 9(1). https://doi.org/10.6007/IJARBSS/v9-i1/5491

Hu, W., Jia, X., Plucker, J. A., & Shan, X. (2016). Effects of a Critical Thinking Skills Program on the Learning Motivation of Primary School Students. Roeper Review. https://doi.org/10.1080/02783193.2016.1150374

Huber, C. R., & Kuncel, N. R. (2015). Does College Teach Critical Thinking? A Meta-Analysis. Review of Educational Research. https://doi.org/10.3102/0034654315605917

Hwang, G. J., & Chen, C. H. (2017). Influences of an Inquiry-Based Ubiquitous Gaming Design on Students’ Learning Achievements, Motivation, Behavioral Patterns, and Tendency Towards Critical Thinking and Problem Solving. British Journal of Educational Technology. https://doi.org/10.1111/bjet.12464

Kettler, T. (2014). Critical Thinking Skills Among Elementary School Students: Comparing Identified Gifted and General Education Student Performance. Gifted Child Quarterly. https://doi.org/10.1177/0016986214522508

Khairani, A. Z., & Shamsuddin, H. (2016). Assessing Item Difficulty and Discrimination Indices of Teacher-Developed Multiple-Choice Tests. In Assessment for Learning Within and Beyond the Classroom. https://doi.org/10.1007/978-981-10-0908-2_35

Klavir, R., & Hershkovitz, S. (2014). Teaching and Evaluating ‘Open - Ended’ Problems. ResearchGate.

Kong, S. C. (2014). Developing Information Literacy and Critical Thinking Skills Through Domain Knowledge Learning in Digital Classrooms: An Experience of Practicing Flipped Classroom Strategy. Computers and Education. https://doi.org/10.1016/j.compedu.2014.05.009

Lee, W., & Lutz, B. D. (2016). An Anchored Open-Ended Survey Approach in Multiple Case Study Analysis. ASEE Annual Conference & Exposition. New Orleans: Louisiana.

Lee, Y. H. (2018). Scripting to Enhance University Students’ Critical Thinking in Flipped Learning: Implications of The Delayed Effect on Science Reading Literacy. Interactive Learning Environments. https://doi.org/10.1080/10494820.2017.1372483

Liu, O. L., Mao, L., Frankel, L., & Xu, J. (2016). Assessing Critical Thinking in Higher Education: The Heightentm Approach and Preliminary Validity Evidence. Assessment and Evaluation in Higher Education. https://doi.org/10.1080/02602938.2016.1168358

Loukina, A., Yoon, S., Sakano, J., Wei, Y., & Sheehan, K. M. (2016). Textual Complexity as a Predictor of Difficulty of Listening Items in Language Proficiency Tests. Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers.

Mapeala, R., & Siew, N. M. (2015). The Development and Validation of a Test of Science Critical Thinking for Fifth Graders. SpringerPlus. https://doi.org/10.1186/s40064-015-1535-0

Matsun, M., Sunarno, W., & Masykuri, M. (2017). Penggunaan Laboratorium Riil dan Virtuil pada Pembelajaran Fisika dengan Model Inkuiri Terbimbing ditinjau dari Kemampuan Matematis dan Keterampilan Berpikir Kritis. Jurnal Pendidikan Fisika. https://doi.org/10.24127/jpf.v4i2.541

Nasution, N. E. A., Harahap, F., & Manurung, B. (2017). The Effect of Blended Learning on Student’s Critical Thinking Skills in Plant Tissue Culture Course. International Journal of Science and Research. International Journal of Science and Research (IJSR), 6(11), 1469 – 1473. https://doi.org/https://doi,org/ 10.21275/ART20171836

Pascarella, E. T., Martin, G. L., Hanson, J. M., Trolian, T. L., Gillig, B., & Blaich, C. (2014). Effects of Diversity Experiences on Critical Thinking Skills Over 4 Years of College. Journal of College Student Development. https://doi.org/10.1353/csd.2014.0009

Perkins, K., & Frank, E. (2018). An Item Analysis and a Reliability Estimate of a Classroom Kinesiology Achievement Test. Online Submission-ERIC.

Popping, R. (2015). Analyzing Open-ended Questions by Means of Text Analysis Procedures. BMS Bulletin of Sociological Methodology/ Bulletin de Methodologie Sociologique. https://doi.org/10.1177/0759106315597389

Purwati, R., Hobri, H., & Fatahillah, A. (2016). Analisis Kemampuan Berpikir Kritis Siswa dalam Menyelesaikan Masalah Persamaan Kuadrat pada Pembelajaran Model Creative Problem Solving. KadikmA, 7(1), 84–93.

Quaigrain, K., & Arhin, A. K. (2017). Using Reliability and Item Analysis to Evaluate a Teacher-Developed Test in Educational Measurement and Evaluation. Cogent Education. https://doi.org/10.1080/2331186X.2017.1301013

Rowland, K., Lovelace, M. J., Saunders, M. J., Caruso, J. P., & Israel, N. (2016). Citizen Science: The Small World Initiative Improved Lecture Grades and California Critical Thinking Skills Test Scores of Nonscience Major Students at Florida Atlantic University. Journal of Microbiology & Biology Education. https://doi.org/10.1128/jmbe.v17i1.1011

Schonlau, M., & Couper, M. P. (2016). Semi-Automated Categorization of Open-Ended Questions. Doi.Org. https://doi.org/10.18148/srm/2016.v10i2.6213

Shin, S., Jung, D., & Kim, S. (2015). Validation of a Clinical Critical Thinking Skills Test in Nursing. Journal of Educational Evaluation for Health Professions. https://doi.org/10.3352/jeehp.2015.12.1

Siregar, T. P., Surya, E., & Syahputra, E. (2017). Quality Analysis of Multiple Choice Test and Clasical Test at X Grade Students of Senior High School. Jurnal IJARIIE University of Medan, 3(2), 2153–2159.

Stupple, E. J., Maratos, F. A., Elander, J., Hunt, T. E., Cheung, K. Y., & Aubeeluck, A. V. (2017). Development of the Critical Thinking Toolkit (CriTT): A measure of student attitudes and beliefs about critical thinking. Thinking Skills and Creativity, 23, 91–100. https://doi.org/https://doi.org/10.1016/j.tsc.2016.11.007

Szenes, E., Tilakaratna, N., & Maton, K. (2015). The Knowledge Practices of Critical Thinking. In The Palgrave Handbook of Critical Thinking in Higher Education. https://doi.org/10.1007/978-1-137-37805-7_34

Tasca, G. A., Cabrera, C., Kristjansson, E., MacNair-Semands, R., Joyce, A. S., & Ogrodniczuk, J. S. (2016). The Therapeutic Factor Inventory-8: Using Item Response Theory to Create a Brief Scale for Continuous Process Monitoring for Group Psychotherapy. Psychotherapy Research. https://doi.org/10.1080/10503307.2014.963729

Tiruneh, D. T., De Cock, M., Weldeslassie, A. G., Elen, J., & Janssen, R. (2017). Measuring Critical Thinking in Physics: Development and Validation of a Critical Thinking Test in Electricity and Magnetism. International Journal of Science and Mathematics Education. https://doi.org/10.1007/s10763-016-9723-0

Tomak, L., Bek, Y., & Cengiz, M. A. (2016). Graphical Modeling for Item Difficulty in Medical Faculty Exams. Nigerian Journal of Clinical Practice. https://doi.org/10.4103/1119-3077.173701

Tran, V. T., Porcher, R., Falissard, B., & Ravaud, P. (2016). Point of Data Saturation was Assessed Using Resampling Methods in a Survey with Open-Ended Questions. Journal of Clinical Epidemiology. https://doi.org/10.1016/j.jclinepi.2016.07.014

Vieira, R. M., & Tenreiro-Vieira, C. (2016). Fostering Scientific Literacy and Critical Thinking in Elementary Science Education. International Journal of Science and Mathematics Education. https://doi.org/10.1007/s10763-014-9605-2

Wang, F. (2017). Research on the Construction of Test Questions Bank Based on Educational Measurement Theory. International Conference on Frontiers in Educational Technologies and Management Sciences, 341–344.

Wismath, S., Orr, D., & Zhong, M. (2014). Student Perception of Problem Solving Skills. Transformative Dialogues: Teaching & Learning Journal.

Yan, K., Yamada, H., Takagaki, M., & Koizumi, R. (2019). Status of Mathematics Tests in the National Center Test for University Admissions in Japan and How to Improve It. Juntendo Medical Journal, 65(3), 255–260.




DOI: http://dx.doi.org/10.24042/jipfalbiruni.v8i2.3952

Refbacks

  • There are currently no refbacks.


Creative Commons License

Jurnal ilmiah pendidikan fisika Al-Biruni is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.