Exploring Methods for Assessing Critical Thinking:
Insights from Qualitative Study Al-Rashiff Hamjilani Mastul 1.
Dwi Sulisworo 2* Western Mindanao State University.
Normal Road.
Baliwasan Zamboanga City.
Philippines Universitas Ahmad Dahlan.
Yogyakarta.
Indonesia, 55166 Corresponding: Al-Rashiff.
mastul@deped.
* Correspondence: dwi.
sulisworo@uad.
ABSTRACT
Received: 29 March 2024 Accepted: 31 May 2024 Published: 7 July 2024 Citation: Mastul.
, & Sulisworo, .
Exploring Methods for Assessing Critical Thinking: Insights from Qualitative Study.
Qomaruna Journal of Multidisciplinary Studies, 1.
, 1Ae9.
This article explores the various methodologies and approaches used in assessing critical thinking skills within the educational field The study employed secondary data sourced from readily accessible online literature related to education, which was analyzed qualitatively.
This study identified four main issues in assessment:
regarding four main issues in assessment: Observation.
Evidence Evaluation.
Problem-Solving Tasks, and Decision-Making Exercises.
Through descriptive analysis, the importance of integrating relevant measurement techniques into questions that focus on critical thinking skills is explained.
The findings of this study underscore the important role of a comprehensive evaluation approach in equipping individuals with the essential critical thinking skills necessary to navigate the complexity of modern challenges and make informed decisions in diverse contexts.
Keywords: Observation.
Evidence Evaluation.
Problem-Solving Tasks, and Decision-Making Exercises ABSTRAK Copyright: A 2023 by the authors.
Submitted for possible open access publication under the terms and conditions of the Creative Commons Attribution (CC BY) .
ttps://creativecommons.
org/license s/by/4.
0/).
Artikel ini mengeksplorasi beragam metodologi dan pendekatan yang digunakan dalam penilaian kemampuan berpikir kritis.
Kajian dilakukan dengan memanfaatkan data sekunder yang diperoleh dari sumber literatur yang mudah diakses di internet yang dibahas secara kualitatif terkait empat isu utama dalam penilaian: Observasi.
Evaluasi Bukti.
Tugas Pemecahan Masalah, dan Latihan Pengambilan Keputusan.
Melalui analisis deskriptif, dijelaskan pentingnya mengintegrasikan teknik pengukuran yang relevan ke dalam pertanyaan yang berfokus pada keterampilan berpikir kritis.
Temuan kajian ini menggarisbawahi peran penting pendekatan evaluasi komprehensif dalam membekali individu dengan keterampilan berpikir kritis penting yang diperlukan untuk menavigasi kompleksitas tantangan modern dan membuat keputusan berdasarkan informasi dalam beragam konteks.
Kata kunci: Observasi.
Evaluasi Bukti.
Tugas Pemecahan Masalah, dan Latihan Pengambilan Keputusan Introduction In today's rapidly changing world, the significance of critical thinking skills cannot be However, effective evaluation of these skills poses a significant challenge.
To ensure that QOMARUNA Journal of Multidisciplinary Studies 2024.
Vol.
No.
02, pp.
individuals can analyze, evaluate, and make informed decisions across various contexts, a comprehensive assessment approach is essential.
This approach encompasses a variety of methods, including standardized tests, performance-based tasks, self-assessment tools, and metacognitive aspects (Abrami et al.
, 2.
Standardized tests, such as the California Critical Thinking Skills Test and the Cornell Critical Thinking Test, offer structured evaluations tailored to measure cognitive proficiency.
These tests provide a quantitative measure of critical thinking ability.
On the other hand, performance-based tasks immerse individuals in real-world scenarios, requiring them to apply critical thinking to problem solving and decision making, offering a more qualitative assessment of their skills (Indrawatiningsih.
Self-assessment tools and questionnaires play a crucial role in providing insight into individuals' perceptions of their critical thinking skills.
By incorporating self-assessment, individuals can reflect on their strengths and areas of improvement, contributing to a more holistic evaluation (Julian et al.
, 2.
Moreover, a comprehensive assessment should focus not only on cognitive aspects, but also on metacognitive dimensions.
Metacognition involves individuals' awareness and control of their thinking processes, including the monitoring and regulation of their thoughts.
By integrating metacognitive aspects into assessments, we can nurture individuals who can adapt, innovate, and excel in today's complex global landscape (Changwong et al.
Educators and researchers have emphasized the significance of critical thinking in various fields such as education, psychology, and linguistics.
Studies have shown that critical thinking is a fundamental skill that enhances problem-solving, decision making, and overall cognitive abilities (Myers & Dyer, 2.
The development of critical thinking skills is crucial in preparing individuals to meet the demands of a rapidly changing world.
By incorporating critical thinking into educational curricula and assessment practices, we can empower individuals to think analytically, make informed judgments, and thrive in diverse environments (Kamali & Fahim, 2.
Assessing individuals' critical thinking abilities requires a multifaceted approach that combines standardized tests, performancebased tasks, self-assessment tools, and metacognitive aspects.
By employing a comprehensive evaluation strategy, we can gain a deeper understanding of individuals' critical thinking proficiencies and foster a generation of thinkers equipped to navigate the complexities of the modern world.
In science education, assessing critical thinking skills poses a significant challenge for educators.
Critical thinking goes beyond memorization.
it involves the ability to analyze, evaluate, and make reasoned judgments.
This complexity is akin to capturing fleeting breezes (Guzey et al.
, 2.
Educators face the dilemma of accurately measuring students' critical thinking abilities, which is as challenging as trying to gauge the depth of an ocean using a yardstick (Guzey et al.
, 2.
Furthermore, the elusive nature of metacognitionAethe awareness and control of one's thought processesAeadds another layer of complexity to assessment (Soicher & Gurung, 2.
Metacognition is the silent orchestrator of critical thinking, making it difficult to assess students' awareness of their thinking processes, much like trying to grasp a shadow (Soicher & Gurung, 2.
Integrating critical thinking assessment seamlessly into science education is a goal for educators, but it comes with constraints, such as limited time and resources (Guzey et al.
, 2.
Balancing assessment within a packed curriculum is a delicate act akin to walking a tightrope, which requires precision and skill (Guzey et al.
, 2.
Despite these challenges, educators persist in their quest for solutions, recognizing that unlocking the puzzle of critical thinking assessment is crucial for nurturing scientifically adept minds prepared for future challenges (Guzey et al.
, 2.
To address the assessment of critical thinking, some studies have focused on interventions such as exam wrappers to enhance metacognition and performance (Soicher & Gurung, 2.
However, challenges persist in defining models for assessing critical thinking and problem-solving skills in specific disciplines such as dental education (Everett et al.
, 2.
The integration of explicit critical thinking curricula has been proposed to improve studentsAo critical thinking skills (Cone et al.
, 2.
Additionally, the impact of metacognitive awareness on student performance in subjects such as chemistry has been studied, showing a positive correlation between metacognitive awareness and academic success (Rahman et al.
QOMARUNA Journal of Multidisciplinary Studies 2024.
Vol.
No.
02, pp.
In conclusion, assessment of critical thinking in science education remains a complex and multifaceted issue.
Educators continue to navigate this challenge by seeking innovative approaches to effectively integrate critical thinking assessments into the curriculum.
By addressing the elusive nature of metacognition and exploring interventions to enhance critical thinking skills, educators aim to equip students with the necessary tools to excel in scientific endeavors.
The objective of this study is to explore various methods and approaches for evaluating critical thinking abilities.
In doing so, it underscores the pressing requirement for a comprehensive evaluation This approach is vital to ensure that individuals possess the requisite critical thinking skills that are essential for navigating multifaceted challenges and making informed decisions across diverse Methods In this study, we employed several steps in the Methods section as follows:
Literature Search and Selection The data for this study were gathered through a comprehensive review of secondary literature sources available on the Internet.
The search included scholarly articles, reports, and educational resources focused on critical thinking assessment.
Keywords such as "observation," "evaluation of evidence," "problem-solving tasks," and "decision-making exercises" were used to identify the relevant Identification of Primary Issues This review identifies four primary issues in critical thinking assessment.
Observation: Involves systematic watching and recording of student behaviors in educational settings to assess the application of critical thinking skills.
Evaluation of Evidence: Examines students' abilities to gather, interpret, and analyze data to support their conclusions or decisions.
Problem-Solving Tasks: Assess students' skills in identifying problems, generating solutions, and evaluating outcomes.
Decision-Making Exercises: Evaluate students' ability to make informed choices based on the critical analysis of information.
Qualitative Analysis Each issue was qualitatively examined to understand its theoretical foundations, practical applications, and potential challenges.
C Theoretical Underpinnings: Reviewed educational theories supporting each assessment C Practical Applications: Explored examples and case studies of each method in educational C Potential Challenges: Analyzed factors affecting the reliability and validity of the assessments.
Synthesis of Key Insights and Findings A systematic review synthesizes key insights and findings, providing a comprehensive overview of the current methodologies and approaches.
This synthesis highlights the strengths, weaknesses, and recommendations for future research and practice in critical thinking assessment.
Results and Discussion Observation Observations in educational settings play a crucial role in understanding student behaviors, interactions, and problem-solving processes.
By directly observing students, educators can gain valuable insights into their critical thinking abilities, such as asking probing questions, evaluating information, and making reasoned judgments in real-time.
This method of assessment through QOMARUNA Journal of Multidisciplinary Studies 2024.
Vol.
No.
02, pp.
observation provides continuous data on student performance, allowing educators to monitor and support their development effectively (Kogan et al.
, 2.
Observation is not limited to traditional classroom settings but extends to various fields, such as medical education, special education, and early childhood education.
Studies have shown that direct observation in clinical practice and emergency medicine education can lead to positive behavioral changes when feedback is provided during the observation process (Craig 2.
Furthermore, observation has been highlighted as a key component in evaluating special education teachers, with systems such as Charlotte Danielson's Framework for Teaching commonly used for this purpose (Jones & Brownell, 2.
In the context of teacher evaluation, classroom observations are a primary source of data that influence decisions related to teacher development and human capital management (Jones et al.
, 2.
The use of observations in special education has been subject to validation studies to ensure the reliability and effectiveness of observation tools (Pua et al.
, 2.
Additionally, observational studies in special education play a significant role in informing policies, practices, and scholarships for students with disabilities (Rodgers et al.
, 2.
Observation is not only valuable for assessing students and teachers, but also for advancing research on children's self-regulation and learning processes.
Observational measures have been used to study children's behaviors in educational settings, providing insights into their self-regulatory skills and informing educational practices (Eberhart et al.
, 2.
Observation serves as a powerful tool in education, allowing educators to gain real-time insights into student performance, inform teaching practices, and contribute to the continuous improvement of educational systems across disciplines.
Evaluation of Evidence Critical thinking is a fundamental skill that involves the ability to evaluate evidence and arguments effectively.
Educators can employ the Evaluation of Evidence method to assess students' critical thinking skills by creating tasks that necessitate the analysis and critique of sources, identification of biases and logical fallacies, and drawing informed conclusions based on the evidence Numerous studies have investigated the correlation between critical thinking and the evaluation of evidence across various fields.
Squires et al.
emphasized critical thinking as a key factor influencing research utilization by nurses, underscoring its significance in effectively assessing and utilizing research.
Abrami et al.
conducted a meta-analysis on instructional interventions impacting critical thinking skills, introducing tools like the Critical Thinking Application Test to evaluate reasoning abilities.
Firdaus et al.
discussed how critical thinking skills in mathematics encompass identification, interpretation, analysis of information, and evaluation of evidence and Bensley et al.
defined critical thinking as reflective thinking involved in evaluating evidence pertinent to a claim to draw well-founded conclusions.
Tsui Wu .
described critical thinking as a set of cognitive skills used by students to identify issues, assumptions, and relationships, make inferences, evaluate evidence, and draw conclusions.
Collectively, these studies stress the importance of critical thinking in assessing evidence across diverse contexts.
Moreover, the study by Stowe & Cooper .
highlighted the importance of formulating and critiquing evidence-based claims for medical professionals and scientists.
Raines .
discussed how practicing nurses engage in evaluating and applying research-based evidence in their practice, emphasizing the practical application of critical thinking skills in healthcare settings.
The amalgamation of these references underscores the vital role of critical thinking in evaluating evidence across different disciplines.
Educators can leverage the Evaluation of Evidence methods to enhance students' critical thinking skills by assigning tasks that require them to analyze, critique, and draw conclusions based on the evidence Problem-Solving Tasks Critical thinking is a fundamental skill that is closely intertwined with problem-solving abilities.
Educators often assess students' aptitude for logical reasoning, creative thinking, and analytical skills QOMARUNA Journal of Multidisciplinary Studies 2024.
Vol.
No.
02, pp.
by presenting them with intricate problems or scenarios across various disciplines (Sun, 2.
The relationship between critical thinking and problem solving has been extensively studied in different contexts, such as nursing education (Ahmady & Shahbazi, 2020.
Bayram et al.
, 2022.
Kelleci et al.
, 2.
agricultural science (Friedel et al.
, 2.
, computer engineering .
nzyurt, 2.
, mathematics education (Sindani et al.
, 2.
, vocational education (Wulansari & Nabawi, 2021.
Sharif et al.
, 2021.
Pradana & Sundawa, 2022.
Lestari et al.
, 2.
, and medical education (Shrivastava & Shrivastava, 2.
These studies consistently highlight the importance of critical thinking in effective problem-solving.
Research indicates that structured training programs focusing on problem solving can enhance critical thinking, cognitive problem solving, and decision-making skills (Ahmady & Shahbazi, 2.
addition, the development of problem-solving skills is crucial for fostering critical thinking abilities (Susetyo et al.
Studies have shown that critical thinking is directly related to the problem-solving process .
nzyurt, 2.
and textbook examples play a significant role in influencing students' problemsolving approaches (Lee et al.
, 2.
Furthermore, the application of problem-based learning models is considered effective for nurturing students' critical thinking skills (Dupri et al.
Educators face the challenge of adequately measuring and assessing critical thinking and problem-solving skills (Sadhu and Laksono 2.
Efforts to improve these skills through various instructional methods, such as problem-based integrated computer-assisted instruction, have been explored in vocational education (Wulansari and Nabawi 2.
Moreover, the use of innovative learning media, such as android-based adventure games, has been suggested to enhance studentsAo critical thinking skills (Lestari et al.
, 2.
In conclusion, the synthesis of these studies underscores the intrinsic link between critical thinking and problem solving skills across diverse educational domains.
Effective teaching methods, structured training programs, and innovative approaches are essential for cultivating these skills among students to prepare them for the complexities of real-world problem-solving scenarios.
Decision-Making Exercises Critical thinking is a multifaceted skill essential for decision-making processes, enabling individuals to make well-reasoned choices based on a thorough analysis of available information (Carter, 2.
Educators can create decision-making exercises that simulate real-world scenarios, challenge students to evaluate various options, predict outcomes, and justify their decisions using logical reasoning and evidence (Hayati et al.
, 2.
The core of critical thinking in decision making involves actively and skillfully perceiving, analyzing, synthesizing, and evaluating information to make informed choices (Papathanasiou et al.
This mental process includes questioning assumptions, weighing reasons, and engaging in deep reflection before reaching a decision .
nzelyi & yNalikan, 2.
Critical thinking is integral to cognitive processes, such as clinical judgment, decision-making, and clinical reasoning, in fields such as medicine and nursing (Jenicek et al.
, 2011.
Rashwan, 2016.
Lee et al.
, 2.
Research highlights the importance of critical thinking in improving studentsAo decision-making skills (Karahan et al.
, 2.
Critical thinking is recognized as a fundamental competency for managers, guiding cognitive processes and actions in leadership positions (Knap-Stefaniuk & Ambrozovy, 2.
Moreover, the deliberate and systematic processing of decisions through critical thinking influences the quality of decisions made ("Modeling the Relationships between School AdministratorsAo Creative and Critical Thinking Dispositions with Decision-Making Styles and Problem Solving Skills,Ay 2.
Educators and researchers have investigated the relationship between critical thinking and decision-making abilities, particularly in professions such as nursing, where critical thinking skills are crucial for evidence-based practice (Reji and Saini 2.
Developing critical thinking skills is vital for promoting socially responsible decision making and critically evaluating information (Linina & Vevere.
Widjanarko et al.
, 2.
Additionally, integrating critical thinking into the curriculum can lead to improved ethical decision-making outcomes (DeSimone 2.
Educators play a crucial role in nurturing critical thinking skills to empower students to navigate complex decision-making scenarios across disciplines.
QOMARUNA Journal of Multidisciplinary Studies 2024.
Vol.
No.
02, pp.
Implications Several implications have emerged based on the results and discussion.
First, continuous observational assessments can enhance teacher development by providing timely feedback and improving instructional strategies.
Second, integrating critical thinking and evidence evaluation into curricula prepares students for real-world challenges that require analytical skills.
Third, adopting problem-based learning and technology-enhanced tools fosters studentsAo critical thinking and problemsolving skills.
Finally, improving real-world decision-making exercises in education helps students practice making well-reasoned choices and preparing them for complex future scenarios.
Conclusion The exploration of various methods and approaches for assessing critical thinking abilities underscores the multifaceted nature of this endeavor.
Through a qualitative examination of four key issuesAiObservation.
Evaluation of Evidence.
Problem-Solving Tasks, and Decision-Making ExercisesAiwe have gained valuable insights into the complexities of critical thinking assessment.
The findings emphasize the importance of integrating relevant measurement techniques into studies focused on critical thinking skills.
From observing students' thought processes to evaluating their ability to solve problems and make informed decisions, each aspect of assessment plays a crucial role in gauging critical thinking proficiency.
Furthermore, the analysis highlights the inseparable link between assessment methodologies, instructional techniques, and the technologies utilized in educational Educators must employ a holistic approach that integrates assessment practices with innovative instructional strategies to effectively nurture critical thinking skills.
This study had several limitations.
First, we relied on secondary data collection, which may limit the depth of analysis and ability to capture the most current practices and trends in critical thinking Future studies should incorporate primary data collection methods, such as interviews, surveys, and direct observations, to complement secondary data along with quantitative study designs.
Additionally, the design of observational methods can introduce subjectivity, as the interpretation of student behaviors and interactions may vary among educators, potentially affecting the consistency and reliability of the findings.
Furthermore, the findings may not be fully generalizable across all educational settings and disciplines because of variability in how critical thinking skills are taught and Future research should expand its scope to include various educational settings and Declaration of Conflict of Interest The authors declare no potential conflicts of interest related to the research, writing, and/or publication of this article.
References