Journal of Natural Science and Integration P-ISSN: 2620-4. E-ISSN: 2620-5092 Vol. No. April 2026, pp 84-96 Available online at: http://ejournal. uin-suska. id/index. php/JNSI DOI: 10. 24014/jnsi. Measuring Changes in StudentsAo Science Literacy through EModule-Based Physics Learning Using Rasch Analysis Abdurrohman Khotim Nugraha1*. Chaerul Rochman2. Dindin Nasrudin2. Fajriati Ramadhini Nur Mileniati3. Siti Rahaimah binti Ali4. Sitti Maesuri Patahuddin5. Mosaddek Hossain6. DatoAo Norsabrina Mohd Noor7 Department of Physics. Universitas Negeri Semarang. Indonesia Department of Physics Education. UIN Sunan Gunung Djati. Indonesia Department of Nutrition Science. UIN K. Abdurrahman Wahid. Indonesia Department of Mathematics Education. Universiti Pendidikan Sultan Idris. Malaysia Department of Mathematics Education. University of Canberra. Australia Kidzana Creative Centre. Bangladesh World Youth Foundation. Malaysia *Correspondence Author: Khotim. abdurrohman@gmail. ABSTRACT This study aims to measure changes in students' scientific literacy in physics learning through e-modules focused on momentum and impulse, using the stacking and racking Rasch model techniques. The study used a one-group pretestposttest design involving 30 10th-grade students at a high school in Bandung. Data were analyzed using the stacking and racking Rasch model techniques to identify changes in students' scientific literacy and in item difficulty levels on the logit scale. Stacking analysis results showed that e-module-based learning could increase students' scientific literacy 90 logits, while racking results indicated a decrease in item difficulty levels by -1. 90 logits, suggesting that the improvement in scientific literacy directly affects how students respond to the measurement instruments. These findings indicate that integrating stacking and racking techniques provides a comprehensive view of the effectiveness of e-modulebased physics learning, both in terms of changes in students' abilities and the functioning of test items. This study confirms that the Rasch model is a relevant approach for examining changes in science literacy in physics learning. Keywords: e-module, physics. Rasch model, scientific literacy, science education INTRODUCTION Scientific literacy refers to the ability to recognize, identify, and explain various scientific phenomena that occur in the world around us. This skill empowers individuals to analyze information critically and make informed decisions based on facts and solid scientific evidence (OECD, 2. By being scientifically literate, people can navigate complex issues and contribute thoughtfully to discussions about science-related topics in their daily lives. This competency plays an important role in shaping individuals who can make accurate and rational decisions while also developing critical thinking, problem-solving, innovation, creativity, and adaptability to the development of science and technology (Cahyaningtyas, 2024. Costa et al. , 2021. Sari et al. , 2. Therefore, scientific literacy becomes a fundamental competence that students must possess to adapt to the dynamics of science and technology and participate in responsible, sustainabilityoriented decision-making. However, various empirical findings indicate that the level of scientific Journal of Natural Science and Integration. Vol. No. April 2026, pp 84-96 | 84 Measuring Changes in StudentsAo Science Literacy through E-Module-Based Physics Learning Using Rasch Analysis literacy among students in Indonesia is not yet optimal (Budiwati et al. , 2025. Bungawati, 2024. Takda et al. , 2023. Zulaiha & Meisadewi, 2. A recent report from the Organisation for Economic Co-operation and Development (OECD), utilizing data from the Program for International Student Assessment (PISA), reveals a concerning trend in the science literacy of Indonesian students. Over the past decade, their scores have not only declined but have consistently remained below the global average, highlighting significant challenges in the educational landscape of Indonesia (OECD, 2. This nationwide trend aligns with preliminary findings from a public high school in Bandung. Based on the results of the studentsAo science literacy performance tests, it was identified that their science literacy achievement is low. This situation indicates that science education, particularly in schools, has not yet fully fostered studentsAo science literacy. Learning strategies are needed to strengthen science literacy, one of which is learning via electronic modules . -module. as an interactive, adaptive physics learning medium tailored to studentsAo diverse characteristics and learning styles (Kristina et , 2. Several studies have shown that the use of e-modules in physics instruction improves studentsAo science literacy (Andriani & Masykuri, 2021. Kurniawati et al. , 2023. Nasrudin. Rochman. Zakiyah, et al. , 2. Measurement of changes in students' science literacy is generally conducted using the ngain . ormalized gai. and classical statistical tests (Andriani & Masykuri, 2021. Kurniawati et al. Nasrudin. Rochman. Zakiyah, et al. , 2024. Serepinaha et al. , 2026. Syamsudin et al. , 2. However, both tests have limitations, namely that their scores are ordinal. The n-gain test is highly dependent on pretest scores . retest gain correlatio. , which can lead to measurement bias for individuals who have high pretest achievements (McKagan et al. , 2022. Nissen et al. , 2. addition, classical statistical tests based on group-mean analysis tend to obscure individual differences in ability (Erfan et al. , 2020. Jafar et al. , 2. These limitations can lead to interpretive bias and inaccurate information about changes in students' science literacy. Therefore, another measurement method is needed that can accommodate the limitations of the n-gain test and classical statistical tests, namely the Rasch model. The Rasch model is a measurement method that analyzes test scores based on the relationship between an individual's ability and the difficulty of test items, expressed in logit units (Linacre & Wright, 1. This unit is obtained by transforming ordinal data into interval data, allowing for the accurate measurement of changes in individual ability and avoiding measurement bias (Linacre & Wright, 1. In measuring changes in students' science literacy, the Rasch model's stacking and racking techniques are used to identify changes in students' abilities and shifts in item difficulty levels before and after learning interventions (Linarce, 1. Stacking reflects changes in science literacy through positive changes in logit values, while racking indicates changes in item difficulty through negative changes in logit values (Laliyo et al. , 2022. Wright, 2. The combination of both provides a comprehensive indicator of learning effectiveness. Although the Rasch model has been used in physics education to assess the validity of test instruments (Maqruf et al. , 2025. Samsudin et al. , 2. and instructional materials (Nurdini et al. , a recent literature review indicates a significant research gap. Most physics education research still measures learning effectiveness using classical statistical tests or n-gain tests, which are prone to bias (Nasrudin. Rochman, & Diningsih, 2024. Nugraha et al. , 2022. Solehayati et al. Additionally, stacking and racking techniques have been used in previous studies to measure changes in conceptual understanding (Laliyo et al. , 2022. Utami et al. , 2. and studentsAo learning experiences (Ramadhani et al. , 2. The use of stacking and racking techniques has not yet been specifically examined to measure changes in science literacy. Recognizing a significant gap in existing research, this study introduces a novel approach by employing advanced Rasch model stacking and racking techniques. These methods are utilized to thoroughly investigate the longitudinal changes in studentsAo science literacy over time. Journal of Natural Science and Integration. Vol. No. April 2026, pp 84-96 | 85 Abdurrohman Khotim Nugraha. Chaerul Rochman. Dindin Nasrudin. Fajriati Ramadhini Nur Mileniati. Siti Rahaimah binti Ali. Sitti Maesuri Patahuddin. Mosaddek Hossain. DatoAo Norsabrina Mohd Noor analyzing these dynamics, the study effectively differentiates between variations in individual studentsAo abilities and fluctuations in the difficulty levels of the assessment items. This distinction allows for a more nuanced understanding of how students evolve in their science literacy skills and how the challenges presented by the assessment itself may shift over time. Therefore, this study aims to measure changes in studentsAo science literacy in e-module-based physics learning on the topics of momentum and impulse. It is hoped that the findings of this study will provide diagnostic solutions to address gaps in physics education evaluation methods and serve as a practical foundation for the reliability of the Rasch model as a more precise alternative to classical statistics in measuring studentsAo science literacy and the quality of assessment instruments. METHODOLOGY To measure changes in studentsAo science literacy through e-module-based physics instruction using the stacking and racking techniques of the Rasch model, this study employs a quantitative, one-group pre-posttest pre-experimental design (Creswell, 2. This research design was specifically chosen because it allows for the longitudinal assessment of changes in studentsAo science literacy before and after the intervention within a single learning group, without involving a comparison group, within a consistent measurement framework (Fraenkel & Wallen, 2. The intervention was conducted over two 90-minute sessions . total of 180 minute. , during which all students received the same physics instruction through an e-module on momentum and impulse. This study took place at a public high school in Bandung. West Java. The participants were all 10th-grade students in the MIPA (Mathematics. Physics, and Chemistr. track, which included 12 classes. The sample was selected using purposive sampling, yielding a single class as the study sample, comprising 30 students . males and 20 female. This class was selected based on a specific characteristic: it had the lowest average physics grade among all other classes. Selecting a class with this characteristic was highly relevant because it provided an optimal baseline for measuring, evaluating, and contrasting the effectiveness of using e-modules in stimulating improvements in science literacy. In addition to students as research subjects, this study also involved two Physics Education lecturers from a state Islamic university in Bandung, who served as e-module validators to ensure the suitability of the learning instruments before the intervention was carried out. The research instruments consist of an e-module designed as a medium for physics education and a science literacy assessment tool. The e-module underwent a preliminary feasibility evaluation, conducted by both media and content experts, to validate its effectiveness as an educational resource. The science literacy assessment comprises 12 multiple-choice questions, each offering five answer options, which are aligned with the indicators set forth in the PISA 2018 framework for science literacy. The item distribution for the science literacy test is detailed in Table Table 1. Distribution of Test Item Questions for Science Literacy Instrument Competency Explaining scientific phenomena Designing and evaluating scientific Competency Indicator Recalling and applying appropriate scientific knowledge Identifying and creating explanatory models and Making and justifying correct predictions Formulating clear hypotheses Identifying problems that can be investigated and studied Distinguishing problems that can be studied scientifically Explaining and evaluating to ensure the reliability of scientific data/information and objects Question Number Journal of Natural Science and Integration. Vol. No. April 2026, pp 84-96 Measuring Changes in StudentsAo Science Literacy through E-Module-Based Physics Learning Using Rasch Analysis Competency Question Number Competency Indicator Interpreting scientific data and Explaining and evaluating to ensure the reliability of scientific data/information and objects Interpreting data from one form of representation to Analyzing and interpreting data to draw accurate Distinguishing arguments based on scientific facts and evidence from arguments based on other considerations Evaluating scientific arguments The feasibility analysis of the e-module and the quality of the science literacy test instruments in this study were conducted using the Rasch model with the same validity criteria. The instruments are considered valid if they meet: . variance explained by Rasch measures (VERM) of at least 20%. Mean Square (MnS. value of 0. 5 Ae 1. Z-Standard (ZSt. value 0 to 2. Point Measure Correlation (PtMea Cor. value of 0. 4 Ae 0. 85 (Boone et al. , 2014. Sumintono, 2. The results of the feasibility test of the physics learning e-module on the topic of momentum and impulse are presented in Table 2 Table 2. E-Module Feasibility Test Results Feasibility Aspect Component Test Dimensionality Display Validity Dimensionality Content Validity Assessment Indicator Variance Rasch measures (VERM) Outfit MnSq Outfit ZStd Outfit PtMea Corr Variance Rasch measures (VERM) Outfit MnSq Outfit ZStd Outfit PtMea Corr Result Criteria Description Unidimensionality Valid Valid Valid Unidimensionality Valid Valid Valid Worthy Worthy Meanwhile, the results of the instrument quality assessment for the science literacy test are presented in Table 3 below. Table 3. Results of the Science Literacy Instrument Quality Test Component Test Indicator Results Criteria Dimensionality Variance explained by Rasch measures (VERM) 22,5% Unidimensionality Outfit MnSq Outfit ZStd Outfit PtMea Corr Item reliability 0,7 Ae 1,6 -1,7 Ae 2,4 0,2 Ae 0,6 Valid Valid Valid Good Cronbach Alpha (KR-. Good Validity Reliability Journal of Natural Science and Integration. Vol. No. April 2026, pp 84-96 Description Can measure one The test instrument is able to measure scientific literacy The test instrument has good consistency in measuring scientific | 87 Abdurrohman Khotim Nugraha. Chaerul Rochman. Dindin Nasrudin. Fajriati Ramadhini Nur Mileniati. Siti Rahaimah binti Ali. Sitti Maesuri Patahuddin. Mosaddek Hossain. DatoAo Norsabrina Mohd Noor Research data were collected through pre- and posttests to measure students' science literacy before and after the learning intervention. Students completed the test instruments on the provided answer sheets under the teacher's supervision for 45 minutes. All student response data were collected directly and compiled after the test. The research data analysis was conducted using the Rasch model with MINISTEP 5. The pretest and posttest data, initially ordinal, were converted into interval data in logit units. Changes in students' science literacy were measured using the stacking technique, while changes in item characteristics were analyzed using the racking An increase in science literacy is indicated by a positive shift in students' ability logit scores on the posttest. In contrast, changes in item characteristics are shown by a negative shift in item difficulty logit scores. Both techniques allow the analysis of changes in students' abilities and item characteristics to be conducted within a consistent measurement framework. The research procedure began with the preparation of a physics e-module on momentum and impulse, as well as a science literacy test instrument. The e-module was first tested for feasibility, and the science literacy test instrument was evaluated for quality. After the e-module was deemed feasible and the instrument met the measurement quality criteria, the research proceeded with a pretest to assess the students' initial science literacy. Next, the physics learning intervention based on the e-module was carried out. After the intervention, the students were given a posttest using the same instrument as the pretest. The pretest and posttest data were then analyzed using stacking and racking techniques to measure changes in students' science literacy. The research procedure flowchart is presented in Figure 1. Figure 1. Research Flow Diagram Journal of Natural Science and Integration. Vol. No. April 2026, pp 84-96 Measuring Changes in StudentsAo Science Literacy through E-Module-Based Physics Learning Using Rasch Analysis RESULT AND DISCUSSION In line with the objective of this study, which is to explicitly measure changes in studentsAo science literacy in e-module-based physics learning on the topics of momentum and impulse using the stacking and racking techniques of the Rasch model, the results of the analysis provide comprehensive empirical evidence. The logit calculation results from these two techniques directly address the research objectives by dissecting studentsAo science literacy levels under two measurement conditions namely, before and after the learning intervention as detailed below. The stacking technique was used to measure changes in students' science literacy across two measurement conditions: pretest . efore the interventio. and posttest . fter the interventio. Table 4 presents the average pretest and posttest scores for students' science literacy, along with the logit differences from the Rasch model analysis. Table 4. Average Science Literacy Score of Students Number of Students Average Pretest Score . 0,33 Average Posttest Score . 2,23 Difference of Average Posttest-Pretest . 1,90 Based on Table 4, the average science literacy score of 30 students before the e-module-based physics learning intervention was 0. 33 logits, while the average score after the intervention was 2. The difference in the average of 1. 90 logits indicates an improvement in students' science literacy after the learning intervention. Meanwhile, changes in each student's science literacy are shown in the pre-posttest scatter plot in Figure 2. Figure 2. Scatter Plot Graph of Students' Science Literacy Pre- and Post-Test Based on Figure 2, students are represented by blue dots on the scatter plot. the equation of the line defines the boundary for changes in students' science literacy. On the vertical axis, the size of science literacy results from the posttest is in the range of 0 to 4. 5 logits. In contrast, on the horizontal axis, the size of science literacy results from the pretest is in the range of -1 to 1. 5 logits. The analysis showed that 19 students exceeded the change threshold, with student 7 having the largest pre-posttest logit difference (>4 logit. , indicating the greatest increase in science literacy after the e-module-based physics learning intervention. Meanwhile, 11 students were below the change boundary line, with students 3 and 13 showing a minimal pre-posttest logit difference, indicating that the increase in science literacy was relatively insignificant. The changes observed in science literacy, which were identified using stacking techniques, can be understood as a direct result of physics learning interventions. These interventions utilized Journal of Natural Science and Integration. Vol. No. April 2026, pp 84-96 | 89 Abdurrohman Khotim Nugraha. Chaerul Rochman. Dindin Nasrudin. Fajriati Ramadhini Nur Mileniati. Siti Rahaimah binti Ali. Sitti Maesuri Patahuddin. Mosaddek Hossain. DatoAo Norsabrina Mohd Noor electronic modules specifically designed to address the concepts of momentum and impulse, highlighting their effectiveness in enhancing studentsAo understanding of these fundamental topics in physics. The e-module presents the concepts of momentum and impulse through learning activities that require students to identify phenomena in everyday life contexts, conduct simple experiments, analyze observation and measurement data, and draw conclusions based on the obtained evidence. These learning activities align with the core competencies of science literacy. This study's results are consistent with research by Susilawati et al. , . and Kates et al. , . which reported that the use of activity- and context-based e-modules can improve students' science Thus, the stacking results confirm that physics learning through e-modules leads to functional and contextual changes in students' science literacy, rather than merely improving learning achievement. Although e-module-based learning generally shows a positive effect on science literacy, students' positions relative to the change threshold indicate heterogeneous responses. As many as 19 students are above the change line, indicating their ability to engage in activities such as phenomenon identification, experimentation, and data analysis to improve science literacy. Meanwhile, 11 students are below the threshold, which does not entirely reflect the ineffectiveness of learning but is influenced by several factors, including limitations in scientific reasoning (Gardner et al. , 2. , difficulty interpreting data (Ghaleb & Vui, 2. , low learning independence and limited time (Ghaleb & Vui, 2. , also teacher competence (Ekmekci & Serrano, 2. On the other hand, students with high initial science literacy, such as students 3 and 13, showed no significant improvement due to the ceiling effect (Garin, 2014. Medvedev & Krygeloh, 2. The racking technique was applied to assess the difficulty of test items under two conditions: before and after the learning intervention. Through this technique, changes in the difficulty level of test items can be identified as students' science literacy evolves over the course of the intervention. A summary of the average test item difficulty in the pretest and posttest, along with the differences in logit scores from the Rasch model ranking analysis, is presented in Table 5 Table 5. Average Item Difficulty Level Number of Questions Average Score Difficulty Level of Questions during Pretest . 0,63 Average Score Difficulty Level of Questions during Posttest . -1,27 Average Difference Posttest Pretest . -1,90 Table 5 illustrates the changes in the difficulty level of science literacy test items after the implementation of e-module-based physics learning. The average difficulty level of 12 test items in the initial measurement . 63 logits, then shifted to -1. 27 logits in the final measurement . This average shift of -1. 90 logits indicates a decrease in test item difficulty, suggesting an improvement in students' science literacy after the learning intervention. Meanwhile, the changes in the difficulty level of each test item are shown in the scatter plot graph in Figure 3 Journal of Natural Science and Integration. Vol. No. April 2026, pp 84-96 Measuring Changes in StudentsAo Science Literacy through E-Module-Based Physics Learning Using Rasch Analysis Figure 3. Scatter Plot Graph of Pre-Posttest Item Difficulty Levels The scatter plot illustrated in Figure 3 vividly displays the variations in the difficulty levels of science literacy items, highlighting how these levels change and relate to one another. An orange dot represents each item. The equation line serves as a reference for identifying shifts in item difficulty between the pretest and posttest. The range of difficulty levels on the posttest, shown on the vertical axis, is -4 to 1 logits, while those on the pretest, shown on the horizontal axis, range from -2 to 3. 5 logits. The analysis shows that 4 items, namely Q3. Q6. Q7, and Q8, are below the reference line, indicating a decrease in difficulty levels after the physics learning intervention based on e-modules. Conversely, the other 8 items are above the reference line, indicating that the decrease in difficulty was not very significant. The application of the racking technique enables systematic interpretation of changes in item difficulty between pretest and posttest conditions within a consistent measurement scale. The shift in item difficulty after instructional intervention indicates that improvements in students' science literacy directly affect how students respond to the measurement instrument (Laliyo et al. In the context of physics learning through e-modules on momentum and impulse, activities such as phenomenon identification, simple experiments, and data analysis not only enhance students' science literacy but also make tasks that previously required high-level reasoning easier to This aligns with research by Gardner et al. , . Pertiwi et al. , . Suwarna & Zulfiani, . Thus, racking indicates that changes in the difficulty level of test items are not due to changes in the instrument's characteristics, but instead to increased students' science literacy. These findings affirm that racking complements stacking by providing a two-way perspective, namely, changes in students and in test items within a unified measurement framework. Although the test items generally became easier after the learning intervention, the racking analysis showed that 8 of 12 items decreased in difficulty. However, the change was not significant because they were above the change line. This condition is observed in items Q1. Q2. Q3, and Q4, which already had high pretest response rates. These three items measure competence in explaining scientific phenomena, which are generally easier for students to understand because they relate to everyday life contexts, thereby limiting the increase in difficulty. This is known as the ceiling effect (Garin, 2014. Medvedev & Krygeloh, 2. In contrast, item Q5, which measures competence in designing and evaluating scientific investigations, shows the smallest decline in difficulty. This is due to the cognitive complexity of this competence, which requires the ability to design experimental procedures, identify variables, and evaluate measurement data, thus necessitating guidance and supervision from teachers during experiments (Szalay et al. , 2023. van Riesen et al. Journal of Natural Science and Integration. Vol. No. April 2026, pp 84-96 | 91 Abdurrohman Khotim Nugraha. Chaerul Rochman. Dindin Nasrudin. Fajriati Ramadhini Nur Mileniati. Siti Rahaimah binti Ali. Sitti Maesuri Patahuddin. Mosaddek Hossain. DatoAo Norsabrina Mohd Noor The results of the discussion highlight a significant enhancement in students' science literacy through the incorporation of e-modules in physics education, specifically focusing on the concepts of momentum and impulse. This improvement is evident not only in studentsAo overall capabilities but also in the characteristics of the measurement instruments used to assess their A stacking analysis further reveals a notable transition toward higher levels of science literacy among the students. Moreover, a racking analysis indicates that as science literacy improves, there is a corresponding decrease in the complexity of assessment items. This suggests that the test questions become more accessible, allowing students to respond with greater ease. Overall, the findings underscore the positive impact of e-modules on educational outcomes in the realm of These findings are in line with Amin et al. , . and Khine, . , who affirmed the Rasch model's ability to objectively separate changes in respondents' abilities from the instrument's The integration of stacking and racking provides a two-way perspective on the effectiveness of learning interventions, namely the development of students' science literacy and changes in item difficulty within a complete measurement framework (Bode & Wright, 1. Thus, this study reinforces stacking and racking as valid and comprehensive analytical approaches to examine improvements in science literacy in physics learning. The significance of this study lies in its innovative approach to providing a precise diagnostic tool for evaluating the effectiveness of science education, particularly in physics. It aims to address the limitations and biases inherent in traditional statistical testing methods. The study's novelty is showcased through the application of advanced Rasch model stacking and racking techniques, specifically used to analyze the intricate dynamics of science literacy within a robust, comprehensive measurement framework. By leveraging these methodologies, the research establishes a new, objective framework that educators and researchers can use to discern genuine changes in studentsAo capabilities, distinguishing them from mere fluctuations in item difficulty. This endeavor has significant practical implications, as it encourages policymakers to adopt Rasch model-based evaluations for assessing science literacy. Additionally, it recommends the use of emodules that incorporate contextual experimental activities, which are validated and effective learning tools. Nevertheless, it is essential to acknowledge the study's limitations. These include the relatively brief intervention duration, the lack of a control group to allow a direct comparison of outcomes, and the focus on a single school with a low baseline in science literacy among its To strengthen future research, it is strongly advised to implement a quasi-experimental design with a control group, extend the intervention duration, and increase the sample size to include participants from diverse backgrounds and demographics. This would enhance the reliability of the findings and help confirm their consistency across varied contexts. CONCLUSION In response to the research objectives, it can be concluded that implementing e-modulebased physics instruction on momentum and impulse has been proven to effectively and measurably improve studentsAo science literacy. This enhancement goes beyond a simple increase in it can be thoroughly understood through a detailed analysis of the stacking and racking techniques utilized within the Rasch model. These methods not only contribute to more accurate measurements but also provide a nuanced insight into the underlying patterns and relationships among the data. The stacking analysis results show a positive shift in student ability of 1. 90 logits, indicating meaningful cognitive reconstruction, with contextual experimental activities within the e-module successfully facilitating better problem solving of scientific phenomena. This scientific significance is closely aligned with the racking results, which show a negative shift in item difficulty 90 logits. This decrease in difficulty level demonstrates that improved science literacy directly breaks down cognitive barriers in test items, making previously high-reasoning-demand Journal of Natural Science and Integration. Vol. No. April 2026, pp 84-96 Measuring Changes in StudentsAo Science Literacy through E-Module-Based Physics Learning Using Rasch Analysis instruments easier to solve thanks to the development of studentsAo cognitive schemas. In this context, the use of stacking and racking techniques demonstrates their sharp methodological contribution not merely as a measurement metric, but as a comprehensive diagnostic tool that presents a two-way picture of studentsAo abilities and item functions integrated within a single, consistent measurement system. REFERENCES