Psychology. Evaluation, and Technology in Educational Research , 2024, 213-223 Available Online: http://petier. org/index. php/PETIER The effectiveness of flipped classroom based blended learning on students critical thinking skills Occe Luciana 1, a *. Widya Andayani Rahayu 2, b. Normansyah Normansyah 3, c. Suyahman Suyahman 4, d. Rusmawan Rusmawan 5, e. Anwar Manahor 6, f STIE Wibawa Karta Raharja. Jl. Jenderal A Yani No 21. Purwakarta 41114. Indonesia Politeknik Enjinering Indorama. Kembangkuning. Ubrug. Purwakarta, 41552. Indonesia STIKIP PGRI Nganjuk. Jl. Saleh No. Nganjuk, 64411. Indonesia Universitas Veteran Bangun Nusantara. Jl. Letjend Sujono Humardani 1. Sukoharjo, 57521. Indonesia Universitas Sanata Dharma. Jl. Mrican Tromolpos 29 . Sleman, 55281. Indonesia International Islamic University Malaysia. Jl. Gombak, 53100 Kuala Lumpur. Malaysia lucianaocce@gmail. b widya890@gmail. c hanasarah433@gmail. suyahman@gmail. e rusmawan187511@gmail. f anwarm@iium. * Corresponding Author. Received: 21 December 2023. Revised: 8 April 2024. Accepted: 5 May 2024 Abstract: This study aims to determine the effectiveness of flipped classroom-based blended learning on students' critical thinking skills. This study is a type of meta-analysis research. Data sources come from 14 national and international journals published in 2018-2023. The process of finding data sources comes from Google Scholar. ERIC. DOAJ. EBSCO. ProQuest. ScienceDirect and PLoS ONE. Keywords search for blended learning data, blended learning based on flipped classroom, and the effectiveness of blended learning based on flipped classroom on students' critical thinking skills. Data analysis techniques with the help of JSAP applications. The results of the study concluded that the average value of effect size (ES = 0. high sizeeffect category and standard error of 0. These findings explain that the flipped classroom-based blended learning model has a positive influence on students' critical thinking skills. Keywords: Blended Leaning. Flipped Classroom. Critical Thinking. Meta-analysis How to Cite: Luciana. Rahayu. Normansyah. Suyahman. Rusmawan. , & Manahor. The effectiveness of flipped classroom based blended learning on students critical thinking skills. Psychology. Evaluation, and Technology in Educational Research, 6. , 213223. https://doi. org/10. 33292/petier. INTRODUCTION Students need to be able to think critically in order to deal with the effects of the industrial In order to face the industrial revolution, students need to be able to think from 0 to 5. 0 in terms of society. 0 moving society toward 5. 0 Critical (Warsah et al. , 2. (Palavan, 2. (Zulyusri et al. , 2. One of the most essential things critical thinking does for pupils is assist them solve problems (Yulitriana et al. , 2. (Tuaputty et al. , 2. The goal of critical thinking abilities is to offer answers for resolving difficult issues. (Chimmalee & Anupan, 2. Critical thinking abilities enable students to assess the accuracy of the information they have been given (Priyambodo et al. , 2. (Jamaludin et al. , 2. Students that possess critical thinking skills find it easier to comprehend the things they are studying (Ercan & Hakkoymaz, 2. (Haciolu & Gylhan, 2. This is an open access article under the CCAeBY-SA license. 33292/petier. Psychology. Evaluation, and Technology in Educational Research, 6 . , 2024, 214 Occe Luciana. Widya Andayani Rahayu. Normansyah Normansyah. Suyahman Suyahman. Rusmawan Rusmawan. Anwar Manahor However, kids' critical thinking abilities are actually rather low in the classroom. Because learning activities are teacher-centered, it is challenging for pupils to comprehend the subject matter (Rahman et al. , 2. (Suryono et al. , 2. (Zulkifli et al. , 2. (Kuncoro et al. Teachers do not actively involve pupils in the learning process (Al-Fikry et al. , 2. (Bahar et al. , 2. because learning is only possible to the extent that low-level thinking can reach cognitive limits (Kurniahtunnisa et al. , 2. Additionally, the findings of the TIMSS study Students' critical thinking abilities in science and math had a score of 396 in 2015, which was lower than the global average of 500 (Miterianifa et al. , 2. (Utomo et al. , 2. Furthermore, the OECD's PISA 2018 results revealed that Indonesian pupils' literacy levels are remained comparatively low when compared to those of other member nations (Ichsan et al. Hudha et al. , 2. The use of unsuitable learning models has an impact on pupils' limited critical thinking abilities as well (Sihaloho et al. , 2. One type of learning that can help students develop their critical thinking abilities is blended learning (Korkmaz & Karaku, 2. (Ernawati & Sari, 2. With the use of certain technologies, blended learning is a learning paradigm that may be used both online and offline (Nida et al. , 2. (Yapici & Akbayin, 2. Students may study autonomously, creatively, and endlessly with the support of blended learning (Fazal & Bryant, 2. (Wuxue, (Supriyadi et al. , 2. In addition, blended learning trains students to learn more actively both inside and outside the classroom (Setiawan et al. , 2. Additionally, blended learning with a flipped classroom can help students become more adept at critical and creative thinking (Zulhamdi et al. , 2. (SyaAoroni et al. , 2. Students' learning process is made more engaging with blended learning and flipped classroom abscissa (Rahmani & Samira Zitouni, 2. Moreover, flipped classroom-based blended learning is an innovative approach to education that facilitates the completion of learning tasks by teachers and students (Low et al. , 2. (Guicai et al. , 2. Using a blended learning strategy that is based on flipped classrooms helps students become more creative and collaborative learner (Tan et al. , 2. (Ahmad & Lukmanul Akhsani, 2. Flipped classrooms, the foundation of blended learning, can encourage student motivation during the learning process (Atmojo & Ismaniati, 2. Furthermore, (Schmid et al. , 2. Flipped classroom instruction has the potential to boost students' selfesteem. Many research findings are connected to the use of blended learning with flipped however, meta-analysis is required to ascertain the impact size of using the This serves as the foundation for the study's goal of evaluating how well blended learning based on flipped classrooms affects students' critical thinking abilities. METHODS The This research is a meta-analysis. One kind of study that can statistically derive a broad conclusion from earlier primary research is meta-analysis. nztop, 2. (Razak et al. (Hidayah et al. , 2. (Tademir, 2. The stages in the meta-analysis, according to Borenstein et al. , . establishing inclusion criteria, . The steps involved in the meta-analysis include selecting inclusion criteria, compiling and arranging study data, evaluating the quality of the research, and doing statistical analysis. Literature Search A search of the databases Google Scholar. ERIC. DOAJ. EBSCO. ProQuest. ScienceDirect, and PLoS ONE was conducted in order to gather data for the meta-analysis. The terms "flipped classroom-based blended learning," "critical thinking skills," and "blended learning" Copyright A 2023. Psychology. Evaluation, and Technology in Educational Research. ISSN 2622-5506 Psychology. Evaluation, and Technology in Educational Research, 6 . , 2024, 215 Occe Luciana. Widya Andayani Rahayu. Normansyah Normansyah. Suyahman Suyahman. Rusmawan Rusmawan. Anwar Manahor are the keywords. Table 1 shows the results of 445 related studies that were found through a journal database search. Additionally, the PRISMA 2020 methodAiwhich consists of identification, screening, eligibility, and includedAiwas used to choose the data. Table 1. Data sources from journal databases Database Google Scholar ERIC EBSCO DOAJ ProQuest ScienceDirect Plos ONE Total Sum Percentage (%) 2,02 Inclusion Criteria In order to get high-quality papers that are relevant to study variables sourced from journal databases, inclusion criteria must be established. Table 2 displays the inclusion criteria used in this meta-analysis. Table 2. Inclusion Criteria No. Inclusion Criteria Research published in 2018-2023 Research comes from Sinta and Scopus indexed journals or proceedings Research related to blended learning based on flipped classrooms in experimental classes and conventional learning control classes Open access research Research can report complete data to calculate the value of effect size Statistical Analysis The impact size value of each study, assessing heterogeneity and selecting estimate models, publication bias verification, and p-value calculation for testing research hypotheses are among the statistical analyses included in this meta-analysis (Borenstein et al. , 2. Statistical analysis of tests with the help of JSAP software. Furthermore, the effect size category is guided by the (Cohen et al. , 2. can see Table 3. Table 3. Effect Size Value Category Effect Size 00 O ES O 0. 20 O ES O 0. 50 O ES O 0. 80 O ES O 1. ES Ou 1. Information Ignored Low Medium High Very High RESULTS AND DISCUSSION Result After doing a literature search on Google Scholar, 445 papers regarding the impact of blended learning with flipped classrooms on students' critical thinking abilities were found in databases including ERIC. DOAJ. EBSCO. ProQuest. ScienceDirect, and PLoS ONE. Only 1:1 Copyright A 2023. Psychology. Evaluation, and Technology in Educational Research. ISSN 2622-5506 Psychology. Evaluation, and Technology in Educational Research, 6 . , 2024, 216 Occe Luciana. Widya Andayani Rahayu. Normansyah Normansyah. Suyahman Suyahman. Rusmawan Rusmawan. Anwar Manahor research, nevertheless, were able to satisfy the preset inclusion requirements. Table 4 displays the computed effect size values for the data that satisfy the inclusion criteria. Table 4. Article Effect Size Analysis No. Writer (Radiah, 2. (Nurhayati et al. , 2. (Sari et al. , 2. (Zulhamdi et al. , 2. (Neat et al. , 2. (Mohebbi et al. , 2. (Astawa et al. , 2. (Purba, 2. (Pattimukay et al. , 2. (Fulgueras & Bautista, 2. (Sukma et al. , 2. Country Indonesian Indonesian Indonesian Indonesian Indonesian Iran Indonesian Indonesian Indonesian Philippines Indonesian Effect Size Standard Error Table 4, shows the effect size analysis results from 11 journals. The standard error value ranges from 0. 17 to 0. 52 while the effect size values range from 0. 39 to 1. There are three different effect sizes: low category . = . , medium criterion . = . , and high criteria . = . Testing heterogeneity and choosing estimate models from the 11 journals that were part of the meta-analysis came next. Table 5. displays the outcomes of the heterogeneity test and the estimating models that were used. Table 5. Heterogeneity Test Results Omnibus test of Coefficients Mode Test of Residual Heterogeneity < 0. < 0. Table 5, the heterogeneity test findings showed a value (Q = 114. higher than the value of 45. These findings indicate that there is unequal distribution of the effect size. The mean effect size of the 11 articles under analysis may be found using the random effect The next step is to test Rosenthal Fail Safe N and use the funnel plot to check for publication bias. Figure 1 shows the outcomes of using the funnel plot to check publication bias in 11 papers. Figure 1. Funnel Plot Standard Error Copyright A 2023. Psychology. Evaluation, and Technology in Educational Research. ISSN 2622-5506 Psychology. Evaluation, and Technology in Educational Research, 6 . , 2024, 217 Occe Luciana. Widya Andayani Rahayu. Normansyah Normansyah. Suyahman Suyahman. Rusmawan Rusmawan. Anwar Manahor Figure 1. Using funnel plots for publishing bias analysis, the shape's symmetry or asymmetry cannot be determined. The Rosenthal fail safe N test must therefore be carried out. Displays the outcomes of the safe N file test Table 6. Table 6. Rosenthal Fail Safe N Test Results Rosenthal Fail Safe N Target Significance Observed Significance < 0. Based on Table 6, 331,000 is the safe N file result, while 0. 050 is the significance value. The results demonstrated that there was no publication bias in 11 of the articles examined in the meta-analysis. The final phase entails conducting a hypothesis test to ascertain how well students' critical thinking abilities are affected by the blended learning paradigm based on flipped classrooms. Test the meta-analysis hypothesis with mean effect size can be seen in Table 7. Table 7. Mean Effect Size Results Coeficient Intercept Effect Size Standard Error 95 %Confidence interval Lower Upper Table 7. Results for the mean effect size yielded a 95% confidence interval with a lower of 626 and an upper of 1. Additionally, based on the high criteria of mean effect size (ES = 0. and value . = 7. p < 0. , the blended learning paradigm based on flipped classrooms has a noteworthy impact on students' critical thinking abilities. Consequently, the blended learning paradigm that utilizes flipped classrooms is successful in enhancing students' critical thinking abilities during the learning process. Discussion Students' critical thinking abilities in the classroom can be effectively enhanced by implementing a mixed learning paradigm that is based on flipped classrooms. The mean effect size value (ES = 0. SE = 0. p < 0. is visible. This result is consistent with (Listiqowati et al. , 2. Students' critical thinking abilities are effectively enhanced by learning based on the flipped classroom model. Students' critical thinking abilities are effectively encouraged by the blended learning paradigm that is based on flipped classrooms (Orhan, 2. Flipped classrooms, which are the foundation of blended learning, encourage students to learn more autonomously and creatively (Garcia-Ponce & Mora-Pablo, 2. (Qutieshat et al. , 2. Furthermore, blended learning has the potential to boost students' self-assurance in their ability to learn, hence promoting critical thinking skills (Bruggeman et , 2. Moreover, online and in-person blended learning based on flipped classrooms is possible (RaduloviN et al. , 2. (Sujannah et al. , 2. (Katasila & Poonpon, 2. Students' enthusiasm in learning and their ability to solve problems can be developed through the blended learning methodology (Budhyani et al. , 2. Furthermore, students may find it simpler to access learning resources thanks to the blended learning paradigm based on the flipped classroom (Alajmi, 2. nzyer & Altnsoy, 2. (Yimer, 2. Nakr et al. , 2. According to (Ataizi & Kymyr, 2. In order to create a more engaging learning environment, the blended learning model might encourage students to persevere in their Students can master technology learning through the use of the blended learning paradigm based on flipped classrooms. In a flipped classroom, students watch videos that Copyright A 2023. Psychology. Evaluation, and Technology in Educational Research. ISSN 2622-5506 Psychology. Evaluation, and Technology in Educational Research, 6 . , 2024, 218 Occe Luciana. Widya Andayani Rahayu. Normansyah Normansyah. Suyahman Suyahman. Rusmawan Rusmawan. Anwar Manahor have been provided by the teacher to help them develop their critical thinking abilities (Diningrat et al. , 2. (Saira et al. , 2. (Sengul & Bostanci, 2. (Suryono et al. , 2. Students' capacity for critical thought is crucial in helping them make the best decisions while solving difficulties. As stated by (Yulitriana et al. , 2. Students who possess critical thinking abilities can reach conclusions more quickly and easily. Because of this, teachers can greatly benefit from the existence of a blended learning model based on flipped classrooms in order to help students develop their critical thinking abilities. CONCLUSION The meta-analysis yielded the following conclusions: the effect size category's average value (ES = 0. is large, and the standard error is 0. These results provide an explanation for the beneficial effects of the blended learning paradigm based on flipped classrooms on students' critical thinking abilities. Through the use of technology, the flipped blended learning paradigm empowers students to learn more autonomously and creatively. Students learn without time constraints using a blended learning strategy based on flipped Teachers can use this knowledge to build blended learning methods in the classroom according to the findings. ACKNOWLEDGMENT In this research, the researcher would like to thank other researchers who have contributed to completing this article so that it can provide important information for the advancement of educational science. REFERENCES