Prisma Sains: Jurnal Pengkajian Ilmu dan Pembelajaran Matematika dan IPA IKIP Mataram https://e-journal. id/index. php/prismasains/index e-mail: prismasains. pkpsm@gmail. July 2023. Vol. No. p-ISSN: 2338-4530 e-ISSN: 2540-7899 The Development of Critical Thinking Skills Assessment Instrument Based on Nearpod in Junior High School Science Learning Rohmatul Maghfiroh, *Sri Wahyuni. Zainur Rasyid Ridlo Science Education Study Program. Department of Mathematics and Natural Sciences Education. Faculty of Teacher Training and Education. Jember University. Jl. Kalimantan No. Jember 68121. Indonesia. *Corresponding Author e-mail: sriwahyuni. fkip@unej. Received: May 2023. Revised: June 2023. Published: July 2023 Abstract Critical thinking skills are one of the skills needed in the 21st century, where to be able to assess critical thinking skills, assessment instruments are required. The aim of the research is development critical thinking skills instrument based on nearpod in junior high school science learning that meets valid, reliable, difficult, and practical criteria as well as critical thinking skills analysis. This research is a Research and Development research (R&D) with the GLAI model. The validity of the product is assessed by three validators consisting of one lecturer and two science teachers. Testing of assessment instruments was carried out on 125 grade VII students. The average product validity assessment of the three validators was 81. 70% with valid criteria. Based on the field tests conducted, it is known that 10 items are valid with a reliability score of 0. At the difficulty level, the product has 1 easy item, 8 sufficient items, and 1 difficult item. In practicality, 97. 66% was obtained with very practical criteria. In the analysis of critical thinking skills, the results of interpretation were obtained by 28. ery lo. , analysis by 31. 20% . ery lo. , inference by 43. 44% . ery lo. , and explanation by 47. 80 % . So it is known that the critical thinking skills instrument based on nearpod in junior high school science learning was developed was valid, reliable, difficult levels, practical, and effective in measuring critical thinking skills. Keywords: Development, assessment instrument, critical thinking skills, nearpod, junior high school, science How to Cite: Maghfiroh. Wahyuni. , & Ridlo. The Development of Critical Thinking Skills Assessment Instrument Based on Nearpod in Junior High School Science Learning. Prisma Sains : Jurnal Pengkajian Ilmu dan Pembelajaran Matematika dan IPA IKIP Mataram, 11. , 706-718. doi:https://doi. org/10. 33394/j-ps. https://doi. org/10. 33394/j-ps. CopyrightA 2023. Maghfiroh et al. This is an open-access article under the CC-BY License. INTRODUCTION Critical thinking skills come from three words, namely skill, thinking, and critical. Skill is the ability to do a job easily and meticulously (Ridlo et al. , 2. In the 21st century, students are not only expected to have a master of theoretical knowledge but students are also expected to master specific skills in the 21st century (Ekayanti et al. , 2022. Zubaidah Siti, 2. 21stcentury skills include Communication. Critical Thinking. Collaboration, and Creativity . C skill. (Redhana, 2. One of the necessary 21st-century skills is critical thinking skills (Bilad et al. , 2. Thinking according to Lismaya . is a cognitive process activity to absorb various forms of information obtained so that it can make a decision related to the problem at hand. Critical thinking according to (Facione, 2. is self-regulation in making decisions that produce interpretation, analysis, evaluation, and conclusions as well as explaining a fact, concept, methodology, parameter, or contextual consideration that is used as a reference in decision making (Ridlo et al. , 2. Critical thinking skills are cognitive processes carried out by students, where students analyze the problems faced in sequence and specifically to find solutions to solve problems (Sulianto et al. , 2. Critical thinking skills Prisma Sains: Jurnal Pengkajian Ilmu dan Pembelajaran Matematika dan IPA IKIP Mataram. July. Vol. No. | 706 Maghfiroh et al. The Development of Critical Thinking a. are fundamental to problem-solving. This skill is important for students to get to the root of the problem and how to get to the root of the problem so that the right solution to the problem at hand can be found. The application of critical thinking skills can be done in a variety of Teachers play an important role in developing and developing learning programs that focus more on strengthening these skills (Ridlo et al. , 2. Therefore, teachers who act as facilitators must be good at making learning more meaningful for students (Ridlo et al. Research conducted by (Rosmalinda et al. , 2. shows that the critical thinking skills of SMP Negeri 1 Belitang i students are still low with a percentage of 58. This is seen from the ability of students who have not met the criteria for critical thinking in solving PISAtype questions. The results of research conducted by Rosmalinda et al. are supported by research conducted by Hartini and Sukardjo . which states that instruments in the form of critical thinking skills are still not widely used. The results of an interview with one of the science teachers of SMPN 4 Jember obtained information that also stated that SMPN 4 Jember had never been given questions to measure critical thinking skills. The low implementation of critical thinking skills assessment will have an impact on graduates having low critical thinking skills both at the elementary school to tertiary levels (Reta, 2. According to Sani . , assessment is an effort carried out systematically to collect valid and reliable data or information, where assessment is used as a benchmark for making policies related to an education program. The assessment in the independent curriculum on learning outcomes consists of three domains, namely cognitive, psychomotor, and affective. The assessment standards contained in Permendikbud no. 21 of 2022 article 9 state that the assessment of student learning outcomes consists of two forms, namely formative and summative. Formative assessment aims to monitor and improve the learning process and evaluate the achievement of learning objectives. With formative assessments, information will also be obtained about learning difficulties and student development. Meanwhile, summative assessment is carried out to assess students as a reference to determine class advancement and graduation from educational units. Critical thinking skills include cognitive domains that can be assessed using formative Formative tests to measure critical thinking skills can be multiple-choice objective tests. In addition to multiple-choice questions, the cognitive realm can be assessed using essay questions (Martanti et al. , 2. However, the fact is that the assessments that have been carried out by teachers are still mostly oriented toward cognitive assessments in the form of multiple choice objective tests that are oriented to knowledge only and have not referred to critical thinking skills (Nyoman Putriadi & dkk, 2. This is reinforced by (Putra et al. , 2. who stated that the question items given by teachers are still not classified as question items that can develop critical thinking skills. According to (Jember et al. , 2. , in addition to using methods and models that can familiarize critical thinking skills, teachers must also provide questions that familiarize students to think critically. The solution offered to overcome the problems mentioned is to develop an assessment instrument for critical thinking skills. The development of critical thinking skills assessment instruments is needed because, with critical thinking skills assessment instruments, teachers can find out the level of critical thinking of students which can be used as a reference for the preparation of learning plans to be implemented (Setiana, 2. Assessment instruments that are well arranged and based on the level of student thinking ability will improve students' thinking power, especially critical thinking skills (Fika Amalia & Endang Susilaningsih, 2. The assessment using paper that has been carried out so far is less effective because it requires a lot of costs and also a long time (Nugroho & Airlanda, 2. In addition to requiring a lot of money and also a long time, paper assessments are also not environmentally friendly. Test sheets and answer sheets will accumulate more and more and pollute the environment. The solution to replace paper-based assessments is to use computerized assessments online. One platform that can be used to conduct computerized assessments is nearpod. The difference Prisma Sains: Jurnal Pengkajian Ilmu dan Pembelajaran Matematika dan IPA IKIP Mataram. July. Vol. No. | 707 Maghfiroh et al. The Development of Critical Thinking a. between this study and previous research is that this study uses the nearpod platform and the questions developed contain subskills, indicators of critical thinking skills in materials substances, and changes. Substance material and its changes are one of the class VII science materials in the independent curriculum. In previous studies, research has been carried out related to the development of science literacy-based assessment instruments using Quizizz to measure hots by Azizah et al. on circulatory system material in humans. Then the research that has been carried out by Hamidah and Wulandari . is the development of hots-based assessment instruments using the Quizizz application on fluid materials and harmonic vibrations. Nearpod is a website-based application, and to access it students do not need to install applications on their devices. This Nearpod has several advantages including that it can be operated both on laptops and devices (Nurhamidah, 2. Besides being easy to operate both on laptops and devices, student answers can also be written in pdf form which will make it easier for teachers to correct essay answers. Nearpod is one such software that supports learning especially assessment. In the nearpod, there are activity features that can be used for assessment, such as interactive quizzes, multiple-choice tests, memory tests, tests with long answers, tests with short answers, and students can answer on the nearpod with pictures (Minalti & Erita, 2. This study aims to develop critical thinking skills instruments based on nearpod in junior high school science learning that meet valid, reliable, difficult, and practical criteria as well as critical thinking skills analysis. METHOD This research is included in the type of Research and Development (R&D) development research that uses the GLAI development model. GLAI is a design used to develop assessment instruments proposed by Bowling et al. which consists of six stages, namely defining content, developing and selecting test items, review by experts, focus group interviews, pilot study data collection, and evaluation. The more detailed steps of the GLAI development model, it is presented in the following Figure 1. Figure 1. Research Design Prisma Sains: Jurnal Pengkajian Ilmu dan Pembelajaran Matematika dan IPA IKIP Mataram. July. Vol. No. | 708 The Development of Critical Thinking a. Maghfiroh et al. The research subjects in this study were grade VII students of SMPN 4 Jember with details on a limited trial consisting of 30 students and a field test consisting of 125 students. Data obtained in this study were obtained from interviews, observations, and expert validation as well as analysis from limited trials and field tests. Meanwhile, data analysis techniques use expert validation analysis, question item analysis, assessment implementation analysis, and critical thinking skills analysis. The analysis of question items consists of analyzing the validity of the question items, reliability, and level of difficulty. In this research, the data analysis techniques used include expert validity, empirical validity, practicality tests, and effectiveness tests of critical thinking skills assessment instruments based on nearpod. The data analysis techniques used are described as follows. Expert validity To find out the magnitude of the value of validity, experts can use the following formula. Information: ycNycIya ycOyca = ycNycIya = Expert validation TSE = Total score achieved TSM = Total expected score Furthermore, the percentage results of each validator are averaged and criterion based on the following Table 1. Table 1. Criteria validity instrument Validity Criteria (%) Validity Categories Very valid 01 < ycu O 100. Valid 01 < ycu O 90. Less valid 01 < ycu O 70. Not valid 00 < ycu O 50. (Wahyuni* et al. , 2. Empirical validity Empirical validity is known when the developed question items have been used to make Empirical validity in research includes analysis of question items ranging from question item validity tests to difficulty tests. Validity of question items The validity of the problem in the form of a description is calculated using the product moment correlation formula proposed by Karl Pearson as follows. ycu Oc ycuyc Oe (Oc yc. (Oc y. ycycuyc = Oo. cu Oc ycu 2 Oe (Oc y. 2 }. cu Oc yc 2 Oe Oc yc 2 } ycycuyc = correlation coefficient of question item score and total score ycu = grain score yc = Total score ycu = number of samples Hadil calculations using the above formula are then criterion based on the following criteria in Table 2. Table 2. Criteria for the validity of question items rcalculate > rtable rcalculate O rtable Question Item validity criteria Valid Not Valid (Hamidah & Wulandari, 2. Prisma Sains: Jurnal Pengkajian Ilmu dan Pembelajaran Matematika dan IPA IKIP Mataram. July. Vol. No. | 709 The Development of Critical Thinking a. Maghfiroh et al. Reliability In this study, researchers calculated the reliability of the assessment instrument developed to determine its efficacy. The assessment instrument developed is in the form of essay questions so that to calculate its reliability can be calculated using the Alpha formula as Oc yuayca2 yco ycycn = ( ). Oe 2 ) ycoOe1 yuayc Remarks : = Instrument Reliability = number of question items Oc yuayca = Number of grain variances yuayc2 = total variance Based on Guiltford's reference, reliability criteria are categorized as follows in Table 3. Table 3. Question item reliability criteria Reliability Coefficient Category Very High High Sufficient Low Very low (Hamidah & Wulandari, 2. Difficulty level The difficulty level of the question item is shown in the form of a number called the question item difficulty index. To determine the level of difficulty, subjective test items in the form of descriptions or essays are as follows. ycUI ycE= ycUycoycaycu ycE = The difficulty level of the question item ycU = Average score ycUycoycaycu = Maximum score on a specific question item The value obtained from the calculation can be interpreted with the following criteria in Table 4. Table 4. Criteria for the difficulty level of the question item Difficulty Index Criterion Difficult Sufficient Easy (Wahyuni* et al. , 2. Practicality Test The research conducted in its implementation was assessed by three observers to know the practicality of the implementation of the assessment. To find out the percentage of implementation of the assessment is calculated using the following formula. Prisma Sains: Jurnal Pengkajian Ilmu dan Pembelajaran Matematika dan IPA IKIP Mataram. July. Vol. No. | 710 The Development of Critical Thinking a. Maghfiroh et al. = ycu y 100% ycu Information: = implementation of assessment ycu = Total number of scores obtained = Total overall score The score results obtained from the calculation are then criterion based on the following Table 5. Practicality criteria Implement ability (%) Category k Ou 90 Very practical 80 O k < 90 Practical 70 O k < 80 Quite practical 60 O k < 70 Less practical k < 60 Very impractical (Wahyuni* et al. , 2. Effectiveness Test The effectiveness of the critical thinking skills assessment instrument based on nearpod can be seen from the result of the analysis of critical thinking skills. The percentage of students' critical thinking skills can be known from the acquisition of calculations using the following ycNycuycycayco ycycaycuycyce ycEyceycycayceycuycycayciyce = y 100% ycAycaycuycnycoycyco ycIycaycuycyce The percentage acquisition of critical thinking skills is further categorized based on the following criteria in Table 6. Table 6. Criteria for Critical Thinking Skills Interpretation (%) Category 25 < X O 100 Very high 5 < X O 81. High 5 < X O 71. Sufficient 75 < X O 62. Low 0 < X O 43. Very low (Wahyuni* et al. , 2. RESULTS AND DISCUSSION Development research that has been carried out produces a product in the form of a critical thinking skills assessment instrument based on nearpod. The resulting critical thinking skills assessment instrument is in the form of 10 essays with indicators of critical thinking The development stage of this assessment instrument uses the GLAI development model which consists of 6 stages, namely defining content, developing and selecting test items, review by experts, focus group interviews, pilot study data collection, and evaluation. Defining content The initial stage carried out before the content definition stage is to analyze problems and needs to be related to assessment. Problem analysis is carried out by conducting literature study activities related to assessment instruments in previous studies. Then the needs analysis was carried out by observation and also an interview with one of the science teachers at SMPN 4 Jember. From the interviews that have been conducted, information was obtained that SMPN 4 Jember has never been given questions to find out students' critical thinking skills, and also the assessment carried out previously only used Google form when online and also used paper when offline. Prisma Sains: Jurnal Pengkajian Ilmu dan Pembelajaran Matematika dan IPA IKIP Mataram. July. Vol. No. | 711 The Development of Critical Thinking a. Maghfiroh et al. At the stage of defining content, researchers identify concepts to be tested using Researchers at this stage create a wedge between learning objectives and subskills indicators of critical thinking skills. After obtaining the slice, researchers use it as a reference in developing critical thinking skills assessment instruments. Development and selection of test items At this stage, researchers create questions based on slices of learning objectives and subskills indicators of critical thinking skills that have been created in the previous stage. The development and selection of test items consist of determining the form of questions adjusted to the slices that have been made, determining the number of questions, and also scoring questions, making question cards as well as inputting questions on the nearpod. The results of the development that have been made can be seen in Figure 2. Figure 2. Result of the development assessment instrument Expert reviews At this stage, researchers validate experts to find out the validity of the assessment instruments that have been made. In this validation, experts provide assessments, comments, and also suggestions on assessment instruments that have been developed. In the validation sheet, there is also a decision from experts regarding the validity of the instrument whether it needs to be revised, or whether the assessment instrument can be directly tested on a limited The results of expert validation are presented in the Table 7. Table 7. Expert validation Assessed aspects Validator Validator Average percentage Score criteria Material Construction Language Validator Average Valid Based on the analysis that has been carried out on the validation results, it can be seen that the critical thinking skills assessment instrument based on nearpod in junior high school science learning is included in the valid score category. Even though it has been classified as a valid score, there still needs to be an improvement from comments and suggestions from validators. Comments and suggestions from validators in detail can be seen in Table 8. Prisma Sains: Jurnal Pengkajian Ilmu dan Pembelajaran Matematika dan IPA IKIP Mataram. July. Vol. No. | 712 The Development of Critical Thinking a. Maghfiroh et al. Table 8. Validator comments and suggestions Validator Validator 1 Validator 2 Validator 3 Validator comments and suggestions The questions should represent indicators of critical thinking More specific question description In the review stage of experts, each validator provides a decision regarding the feasibility of the instrument developed by the researcher. The validator's decision regarding the feasibility of the instrument is that the three validators stated that the instrument developed by the researcher was suitable for research with minor revisions. Focus group interviews The focus group interview phase was conducted after conducting a limited trial. For the limited trial, researchers used one class and at this stage, researchers conducted interviews with 5 students. From the interviews that have been conducted, information was obtained that the sentences used in the questions can be understood by students. Pilot study data collection In the collection phase of the pilot study, researchers conducted a limited trial on 30 students of grade VII D SMPN 4 Jember. Data obtained from limited trials are then collected for analysis ranging from validity, reliability, level of difficulty, practicality of instruments, and analysis of critical thinking skills. The acquisition of validity tests in limited trials after being processed using the SPSS application can be seen in Table 9. Table 9. Limited trial validity results Question Number r calculate r table Information Valid Valid Valid Valid Valid Valid Valid Valid Valid Valid Determination of the validity of question items can be seen from the correlation between the r table and also r count. If the r table is greater than the r table then the question item is declared invalid and if the r table is smaller than the r count then the question item is declared In a limited test conducted by researchers with n = 30, where n is obtained from the number of students who take part in the limited trial. From the research that has been done by researchers, it is known that questions number 1, 2, 3, 4, 5, 6,7, 8, 9, and 10 are declared valid. In the next stage, the questions that are declared valid can be used for field tests. The second question point analysis is the reliability analysis of assessment instruments. Reliability according to the reliability obtained by researchers from limited trials conducted is The reliability value of the limited trial was then criterion based on Sumardi's . criteria, namely in the range of 0. 79 included in the high-reliability criteria. Based on limited test results, it is known that the assessment instruments developed by researchers have high reliability. So that if the assessment instrument is used, the same results will be obtained, even though the subject and time are different. Prisma Sains: Jurnal Pengkajian Ilmu dan Pembelajaran Matematika dan IPA IKIP Mataram. July. Vol. No. | 713 The Development of Critical Thinking a. Maghfiroh et al. The next analysis is the analysis of the level of difficulty of each question. The results of the calculation of the difficulty level in limited trials are presented in the following Table 10. Table 10. Limited trial difficulty Question Number Difficulty Level Information Sufficient Sufficient Sufficient Sufficient Difficult Sufficient Sufficient Sufficient Sufficient Difficult The results of obtaining the level of difficulty are interpreted based on Kurniawan's criteria . From the interpretation carried out by the researcher, it is known that questions number 1, 2, 3, 4, 6, 7, 8, and 9 are classified as questions that have a moderate level of difficulty because in the difficult test that has been carried out, the difficulty level results on these numbers in the range of 0. 3 < the difficulty level < 0. As for numbers 5 and 10, it is quite difficult because the test of the level of success on these numbers is located in the range of difficulty levels < 0. The limited trial in its implementation was observed by three observers, where each observer assessed the implementation sheet on a scale of 1-5. The results of the assessment conducted by the three observers are presented in the following Table 11. Table 11. The practicality of limited trials Activities Preliminary activities Receive a question link Do the problem Collect answers Concluding activities Overall average Category Meeting (%) 93,33 Very practical Average (%) Furthermore, the results of obtaining assessment data by observers were criterion according to (Wahyuni* et al. , 2. criteria, namely in small group tests, an implementation score of 97. 66% was obtained, so if the implementation score is the criterion, it is classified as very practical. Based on small group tests that have been conducted, it can be seen that critical thinking skills assessment instruments based on nearpod can be used in assessment activities because of their very practical use. Researchers at the pilot study stage analyzed students' critical thinking skills. Analysis of critical thinking skills is detailed on each critical thinking The results of obtaining critical thinking skills analysis are presented in the following Table 12. Table 12. Analysis of students' critical thinking skills on limited trials Indicators of critical thinking skills Interpretation Analysis Percentage Criterion Very Low Very Low Prisma Sains: Jurnal Pengkajian Ilmu dan Pembelajaran Matematika dan IPA IKIP Mataram. July. Vol. No. | 714 The Development of Critical Thinking a. Maghfiroh et al. Indicators of critical thinking skills Inference Explanation Percentage Criterion Very Low Low The indicators of critical thinking skills used by researchers to create assessment instruments are critical thinking indicators proposed by Facione . including interpretation, analysis, inference, and explanation. However, not all indicators from Facione are used in making question items. This is because based on the slices that have been made, researchers at the stage of defining content for evaluation and self-regulation indicators do not enter the wedge between the subskills of critical thinking indicators and the learning objectives of the substance material and its changes. So that for the analysis of critical thinking skills, indicators of evaluation and self-regulation cannot be raised. Then the results of the analysis in the table above are criteria based on the criteria of Setyowati . , namely for interpretation, analysis, and inference classified as very low criteria, and for explanation classified as low criteria. Evaluation Researchers at the evaluation stage analyze the question items that have been developed, their practicality when used in field tests, and analysis of students' critical thinking skills. For analysis of questions, items include tests of validity, reliability, and level of difficulty. As for the results of the validity of the question items, they are presented in the following Table 13. Table 13. Field Validity Test Question Number r calculate r table Information Valid Valid Valid Valid Valid Valid Valid Valid Valid Valid The validity of the field test can be known from the correlation between the r table and the r count. If the r table is greater than the r count then the question item is declared invalid and if the r count is greater than the r table then the question item is declared valid. To be able to interpret the question items as valid or not can be seen in Table 13. From table 13 it is known that questions number 1, 2, 3, 4, 5, 6, 7, 8, 9, and 10 are declared valid because r is calculated on each question item more than r in table 0. To find out r table from this study can be seen from n. n is the number of students who took the field test. The results of the difficulty level in the field test, it is presented in the following Table 14. Table 14. Field Test Difficulty Level Question Number Difficulty Level 0,57 0,35 0,85 0,29 0,31 0,34 0,47 Information Sufficient Sufficient Easy Sufficient Sufficient Sufficient Sufficient Prisma Sains: Jurnal Pengkajian Ilmu dan Pembelajaran Matematika dan IPA IKIP Mataram. July. Vol. No. | 715 The Development of Critical Thinking a. Maghfiroh et al. Question Number Difficulty Level 0,29 0,40 0,29 Information Difficult Sufficient Sufficient Based on field tests that have been conducted by researchers, it is known that questions number 1, 2, 4, 6, 7, 9, and 10 are classified as questions that have a moderate level of difficulty because the difficult test that has been carried out the results of the difficulty level on these numbers in the range of 0. 3 < the difficulty level <0. 7 and for question number 3 has an easy level of difficulty because in the difficulty level test that has been carried out the difficulty level on the number is more than 0. As for number 8, it is classified as difficult because the difficulty level test on these numbers is located in the range of difficulty levels less than 0. Field tests in its implementation were observed by three observers, where each observer assessed the implementation sheet on a scale of 1-5. The results of the assessment by the three observers on the implementation sheet are presented in the following Table 15. Table 15. The practicality of field tests Activities Preliminary activities Receive a question link Do the problem Collect answers Concluding activities Overall average Category Observer (%) Very practical Average (%) Furthermore, the results of obtaining assessment data by observers were criterion according to (Wahyuni* et al. , 2. criteria, namely in field tests, an implementation score of 33% was obtained, so if the implementation score is the criterion, it is classified as very Based on small group tests that have been conducted, it can be seen critical thinking skills assessment instruments based on nearpod can be used in assessment activities because of their very practical use. Data on student scores in field tests are then analyzed based on indicators of critical thinking skills. The results of the analysis of students' critical thinking skills are presented in the following Table 16. Table 16. Analysis of Students' critical thinking skills on field tests Indicators of critical thinking skills Interpretation Analysis Inference Explanation Percentage Criterion Very Low Very Low Very Low Low From the acquisition of data on students' critical thinking skills test results after analysis, it is known that indicators of critical thinking skills have different magnitudes, namely for interpretation by 28. 68%, analysis by 31. 20%, inference by 43. 44%, and explanation by Then the results of the analysis are criteria based on the criteria of Setyowati et al. , namely for interpretation, analysis, and inference classified as very low criteria, and for explanation classified as low criteria. Prisma Sains: Jurnal Pengkajian Ilmu dan Pembelajaran Matematika dan IPA IKIP Mataram. July. Vol. No. | 716 Maghfiroh et al. The Development of Critical Thinking a. CONCLUSION The instrument developed by researchers consisting of 10 questions is classified as valid when reviewed from the validation of experts and the validity of the question items. Then the instrument developed is also classified as a reliable instrument with a level of difficulty dominated by medium questions with details in limited trials consisting of 2 difficult questions and 8 medium questions. While the field test consists of 1 difficult question, 1 sufficient question, and 9 medium questions. RECOMMENDATION The development of the questions pays more attention to the proportion of difficulty level and in future research it is expected to choose schools with good internet access. ACKNOWLEDGMENT Thank you to the bachelor of science education University of Jember and the supervisors, both the main supervisor and member supervisors who have guided the preparation of the article from start to finish so that this article can be published. REFERENCES