Prisma Sains: Jurnal Pengkajian Ilmu dan Pembelajaran Matematika dan IPA IKIP Mataram http://ojs.
id/index.
php/prismasains/index e-mail: prismasains.
pkpsm@gmail.
June 2020.
Vol.
No.
p-ISSN: 2338-4530 e-ISSN: 2540-7899 Development of the Test Instrument for Measuring Students' Critical Thinking skills on Fluid Material Ni Nyoman Sri Putu Verawati, 2*Saiful Prayogi, 2Muhammad Yusril Yusup, 3Hafsah Taha Physics Education Department.
Universitas Mataram.
Jl.
Majapahit No.
Mataram, 83125.
Indonesia Physics Education Department.
Universitas Pendidikan Mandalika.
Jl.
Pemuda No.
Mataram, 83126.
Indonesia Faculty of Sciences and Mathematics.
Sultan Idris Education University.
Proton City, 35900.
Malaysia *Corresponding Author e-mail: saifulprayogi@ikipmataram.
Received: April 2020.
Revised: June 2020.
Published: June 2020 Abstract This study aimed to develop a test instrument to measure students' critical thinking skills on fluid material.
Characteristics of the instrument and its validity estimation are also described.
This research and development study employed five stages of research, namely information collecting .
iterature review and preparation of the subject matte.
, planning .
efining and formulating objective.
, developing preliminary form of the test instrument, preliminary field testing .
xpert validatio.
, and main product revision .
n accordance with the recommendations in the preliminary field testin.
The content and construct validity were estimated by expert Results of the instrument validation showed average scores for each component .
ontent validity index 63 and construct validity of 4.
, both of which are in the very valid category.
The final result of the instrument validation is 4.
ery valid if: Va > 4.
, with 98.
7% reliability.
Description of the study result is presented further in this article.
Keywords: Test instrument.
Critical thinking skills.
Fluid material How to Cite: Verawati.
Prayogi.
Yusup.
, & Taha.
Development of the Test Instrument for Measuring Students' Critical Thinking Abilities on Fluid Material.
Prisma Sains: Jurnal Pengkajian Ilmu dan Pembelajaran Matematika dan IPA IKIP Mataram, 8.
, 46-56.
doi:https://doi.
org/10.
33394/j-ps.
https://doi.
org/10.
33394/j-ps.
CopyrightA 2020.
Verawati et al This is an open-access article under the CC-BY License.
INTRODUCTION
One measure of progress for a nation is the quality of education and one of the important aspects of quality education, namely students who can compete globally and are able to solve problems in daily life (Megawati et al.
, 2.
In terms of global competitiveness, the quality of Indonesian education seems to be still low.
The results of the Program for International Student Assessment (PISA) study conducted by the Organization for Economic Cooperation and Development (OECD) in 2015.
Indonesia ranked 62 out of 70 countries.
Indicators of PISA assessment included the ability of students to solve problems and higher-order thinking skills (OECD, 2.
The results of the 2015 Trends in International Mathematics and Science Study (TIMSS) study showed that Indonesia ranked 46 out of 51 countries in science achievements (Mullis et al.
, 2.
In addition, studies other than PISA and TIMSS have long reported that in order to face the challenges and developments of the modern age, it is necessary not just conceptual knowledge, but the skill to apply knowledge and various thinking skills called 21st Century Skills (Partnership for 21st Century Skills, 2.
One of the skills contained in 21st Century skills, namely critical thinking (Prayogi et al.
, 2.
Critical thinking is basically a Prisma Sains: Jurnal Pengkajian Ilmu dan Pembelajaran Matematika dan IPA IKIP Mataram.
June 2020.
Vol.
No.
| .
Verawati et al Development of the test instrument for a.
detailed description of several characteristics which include the process of interpretation, analysis, evaluation, inference, explanation and self-regulation (Facione, 2.
One famous contributor in the tradition of critical thinking is Robert Ennis.
Ennis .
provide the definition about the concept of critical thinking, namely critical thinking as sensible and reflective thinking that focuses on deciding what to believe or do.
Improving the quality of education delivery is marked by curriculum reform.
For example.
Finland is a developed country in the field of education that has long placed critical thinking as one of the goals of learning in its curriculum content (Horn & Veermans, 2.
Indonesia, curriculum content which is oriented towards the development of a variety of thinking skills, especially critical thinking skills, has begun to be noticed with the implementation of the Curriculum-2013 (K-.
(Prayogi et al.
, 2.
In several other developing countries critical thinking is one of the high-level skills most often discussed and linked to educational goals, because it is believed to play a central role in logical thinking, problem solving, an in decision making (Butler, 2.
Various factors can contribute to achieving learning goals towards increasing critical thinking skills, one of which is the ability of teachers to carry out and utilize the critical thinking assessment process itself, because it can stimulate students to develop critical thinking skills (Herpiana & Rosidin, 2.
The learning objectives towards training students' critical thinking are contained in K-13 in Indonesia.
However, learning in reality there are still many that are oriented solely on efforts to develop and test students 'memory so that students' thinking abilities are reduced and simply understood as the ability to remember (Herpiana & Rosidin, 2.
, whereas they should be oriented towards achieving thinking and solving skills the problem is in accordance with the contents of the 2013 Curriculum.
The impact is an evaluation tool used to measure aspects of ordinary cognitive abilities.
In other cases, it was also found that although the learning process aimed at training students' critical thinking, in the assessment process the teacher did not use the instrument of critical thinking to measure learning outcomes according to the learning process intended (Sudrajat et al.
, 2.
Whereas learning assessment is one of the elements in learning used to determine the extent of the achievement of student competencies and the effectiveness of the learning process undertaken to achieve learning objectives (William.
Assessment is an inseparable part of the learning process.
Learning assessment is important so that students know what they have learned or show what they have not learned (Jabbarifar, 2.
Test instruments to measure critical thinking skills have been developed by experts and researchers before, including.
California Critical Thinking Skill Test (Facione, 1.
California Critical Thinking Disposition Inventory (Facione & Facione, 1.
Watson-Glaser Critical Thinking Appraisal (Watson & Glaser, 1.
Ennis-Weir Critical Thinking Essay Test (Ennis & Weir, 1.
Cornell Critical Thinking Test (Ennis.
Millman, & Tomko, 1.
Halper Critical Thinking Assessment Manual (Halpern, 2.
, and many others.
However, to date the multivariate nature of the definitions offered for critical thinking, the assessment of critical thinking, their level of generality or specificity, and their practical impact on broader academic achievement is still being debated (Liu et al.
, 2.
According to Lai .
, these instruments vary greatly in purpose and format, and critical thinking assessments tend to be general in nature.
Norris .
has long argued that the facts about the level of uniqueness in critical thinking have not been resolved because of the many theories in different views, making measurement and evaluation of critical thinking difficult.
First, the type of a person's conclusions is still unclear to the extent that researchers cannot agree whether critical thinking is a general or special subject.
Second, it is difficult to assess the transfer of critical thinking with other subjects, because transfer to other contexts may be different from the specificity of knowledge in critical thinking.
Thus, despite the fact that previous researchers or experts have identified critical thinking skills or abilities and dispositions that differ from one another, it turns out to describe separate effects and the use of difficult judgments in practice (Prayogi.
Therefore, the measurement of critical thinking in a more specific context needs to be Prisma Sains: Jurnal Pengkajian Ilmu dan Pembelajaran Matematika dan IPA IKIP Mataram.
June 2020.
Vol.
No.
| .
Development of the test instrument for a.
Verawati et al done and the instrument used as an important measurement tool to be developed, in this study is the instrument for measuring critical thinking skills in fluid material.
The instrument for measuring critical thinking skills developed was tested for its validity .
ontent and construc.
, and its reliability.
The purpose of this study, namely: .
describe the characteristics of test instruments for the measurement of students 'critical thinking skills on fluid material, and .
describe the validity and reliability of instruments measuring students' critical thinking skills on fluid The test instrument was developed based on critical thinking indicators that have been used by researchers previously, namely in the aspects of analysis, inference, evaluation, and decision making (Prayogi et al.
, 2017.
Prayogi et al.
, 2018.
Prayogi et al.
, 2019.
Prayogi, 2019.
Wahyudi et al.
, 2019.
Verawati et al.
, 2.
The results of this study can be a reference in the development of test instruments to measure critical thinking skills.
METHOD
This research and development (R & D) study aimed to develop an instrument to measure students' critical thinking skills.
According to Borg and Gall .
, a R & D study involves 10 stages of research, that are research and information collecting, planning, develop preliminary form of product, preliminary field testing, main product revision, main field testing, operational product revision, operational field testing, final product revisions, and In accordance with the needs of this research, adaptation and modification are carried out into 5 stages of research, namely: .
information collecting, includes literature review and preparation of the subject matter.
planning, includes defining and formulating .
develop preliminary form of instrumen test product.
preliminary field testing .
xpert validatio.
main product revision in accordance with the recommendations in the preliminary field testing.
The research phase is summarized in Figure 1.
: action : selection : sequence : cycle : result Figure 1.
The research stage is the development of the test instrument Information collecting includes reviewing the literature, preliminary observations, and determination of the subject matter, this is done to determine the learning needs associated with the plan to develop instruments for measuring students' critical thinking abilities.
The instrument development planning includes defining and formulating objectives.
Next, the researcher designed the draft of test instrument in Bahasa Indonesia to measure students' critical thinking skills and then validated it.
Validation contains two elements of validity, namely content validity and construct validity.
The instrument developed was validated by 2 validators, with the validator criteria experts in the field of physics and at least had conducted studies on Prisma Sains: Jurnal Pengkajian Ilmu dan Pembelajaran Matematika dan IPA IKIP Mataram.
June 2020.
Vol.
No.
| .
Verawati et al Development of the test instrument for a.
critical thinking.
Suggestions and input from the validator in the next will be followed up to improve the instruments developed.
The validity of the instrument by experts shows the quality of the instrument in terms of content and construct validity.
Content validity refers to the extent to which the test measures the domain of content to be measured.
There are three aspects of content validity: domain definition .
perational definition of the content domai.
, domain representation .
test match between content and cognitive specification.
, and domain relevance .
elevance of test items to content domain.
(Sireci, 1.
While the construct validity refers to the extent to which the operationalization of the construct is defined by a theory (Cronbach & Meehl, 1.
Reliability tests were also conducted and calculated using the equation of percentage of agreement by Emmer and Millett in Borich .
, the instrument is said to be reliable if it has a match percentage of Ou 75%.
If the match percentage is high, then the instrument is said to be reliable.
Reliability shows the level of consistency of the instrument based on observers' judgment in this context is the validator.
A-B
Percentage of Agreement =100.
A B A = The frequency of the aspects observed by the observer by giving a high frequency B = The frequency of the aspects observed by other observers by giving a low frequency The data of validation result were analyzed descriptively qualitatively, that is, by averaging the scores obtained from the validators.
Validity assessment uses a scale of 5 .
ighest score 5, lowest score .
Scores obtained from expert judgment are then converted into qualitative data and categorized as in Table 1.
Table 1.
Conversion of quantitative data into categories (Prayogi, 2.
Interval Score
Category X > Xi 1,8 Sbi
X > 4,21
very good
Xi 0,6 Sbi < X O Xi 1,8 Sbi
3,40 < X O 4,21
Xi - 0,6 Sbi < X O Xi 0,6 Sbi
2,60 < X O 3,40
Xi - 1,8 Sbi < X O Xi - 0,6 Sbi
1,79 < X O 2,60
X O Xi Oe 1,8 Sbi
X O 1,79
not good annotation: X .
mpirical scor.
Xi .
ean idea.
Sbi .
deal deviation standar.
The level of validity (V.
is determined by calculating the average score of indicators and aspects for each expert, by adapting the interval of values in Table 1, then the level of instrument validity as in Table 2.
Table 2.
Level of instrumen validity (Prayogi, 2.
Interval Score Category Va > 4,21 very valid 3,40 < Va < 4,21 2,60 < Va < 3,40 enought valid 1,79 < Va < 2,60 less valid Va < 1,79 not valid The instrument for measuring critical thinking skills is said to have a good degree of validity, if the minimum level of validity achieved is valid.
If the achievement level of validity is under valid, a revision is necessary.
RESULTS AND DISCUSSION
Characteristics of test instruments for the measurement of critical thinking skills Characteristics of test instruments for the measurement of critical thinking skills in this study are based on theoretical studies from experts who develop high-level thinking In general, the preparation of assessment instruments generally involves three Prisma Sains: Jurnal Pengkajian Ilmu dan Pembelajaran Matematika dan IPA IKIP Mataram.
June 2020.
Vol.
No.
| .
Verawati et al Development of the test instrument for a.
things, namely: .
clearly determining what will be assessed.
arrange test assignments or and .
determine the criteria for mastery of the thing being assessed.
In this study the assessed context, test questions, and mastery criteria were judged to focus on critical thinking skills.
Furthermore, according to Brookhart .
, in the preparation of high-level thinking assessment instruments, there are three things that need to be considered, namely: .
using stimulus.
use a new context.
distinguish between the level of difficulty and complexity of the thought process.
Test instruments to measure high-level thinking according to Scully .
can be arranged by taking into account the following matters: .
manipulation of target verbs in accordance with the aspects measured, .
item flipping, meaning items simple questions can be modified .
for example by presenting specific examples in the problem bar, and asking respondents to identify the rules or concepts underlying them, .
the use of high quality distractors, and .
tapping multipple neurons, meaning presenting several items content where the instrument can be a stimulus that allows the interconnection between Elaboration of existing theories, the determination of the characteristics of the critical thinking skills test instrument in this study refers to the following things.
The suitability of the content domain to be measured and assessed.
This research has determined the critical thinking skill as an aspect to be measured in fluid material, namely on the indicators of analysis, inference, evaluation, and decision making.
Operationally the skill to think critically on the aspect of analyzing is the process of actually identifying the relationship between statements, concepts, and descriptions of a situation or phenomenon, and describing reasons as a form of representation to express opinions and beliefs.
Referencing is the process of concluding information correctly using logical reasoning from data, statements, principles, concepts, or other forms of representation.
Evaluating is the process of evaluating the credibility of a statement, description, experience, situation, or opinion, as well as describing the reasons for the evaluation.
Making a decision is the process of choosing choices or actions between a set of alternatives based on criteria or Item compatibility with critical thinking indicators.
14 questions were developed for fluid matter to accommodate the critical thinking indicators that are used as a reference for the preparation of items.
One example problem to measure the critical thinking skill on the indicator analysis as in Figure 2.
Give a stimulus in which the problem presented is closely related to the real-world context.
On the subject of fluid matter, for example, in rivers, objects are often found in a floating position on the water, partially submerged, floating in water, and even submerged entirely in the riverbed.
This case is then elaborated into the idea of preparing critical thinking skills items that measure analytical skills in the sub-subject matter of density, where students are asked to analyze the state of objects immersed in water with different conditions based on their density and determine the position of each object immersed.
This problem requires the critical thinking skill in this context of analysis, because it is not possible for students to determine the position of each object if it cannot analyze the state of an object based on its density.
The item construction of the critical thinking skill instrument in the aspect of analysis as in Figure 2.
Figure 2.
The example of test instrumen in analysis aspect Prisma Sains: Jurnal Pengkajian Ilmu dan Pembelajaran Matematika dan IPA IKIP Mataram.
June 2020.
Vol.
No.
| .
Verawati et al Development of the test instrument for a.
The validity and reliability of the test instruments measure critical thinking skills The critical thinking skills test instrument that has been compiled is tested for its validity and reliability.
Validity test includes content validity and construct validity.
Content validity according to Sireci .
, i.
"Arefers to the degree to which a test measures the content domain it purports to measure".
There are three aspects of content validity: domain definition .
perational definition of content domai.
, domain representation .
ow well a test matches its content and cognitive specipicatio.
, and domain relevance .
elevance of each test item to the content domai.
Content validity refers to the extent to which the test measures the domain of content to be measured.
While the construct validity according to Cronbach and Meehl .
, e "Arefers to the extent to which operationalizations of a construct are defined by a theory," its means that the construct validity refers to the extent to which the operationalization of the construct is defined by a theory.
Reliability shows the level of consistency of the instrument based on observers' judgment in this context is the validator.
Reliability is calculated using the percentage of agreement equation.
The validation sheets are developed as Figure 3.
Figure 4.
Figure 5, and Figure 6 .
xamples for analysis indicator.
Figure 3 explains the critical thinking skills test instrument.
Figure 4 and Figure 5 explain aspects of content validity, and Figure 6 explain of construct validity.
Figure 3.
Critical thinking skills test instrument for analysis aspect The aspects to be assessed: Content validity .
omain definitio.
The test instrument presents statements, data, phenomena, facts, or laws that enable students to conduct an analysis .
he process of actually identifying the relationship between statements, concepts, and descriptions of a situation or phenomenon, and describing reasons as a form of representation to express opinions and belief.
Prisma Sains: Jurnal Pengkajian Ilmu dan Pembelajaran Matematika dan IPA IKIP Mataram.
June 2020.
Vol.
No.
| .
Development of the test instrument for a.
Verawati et al Figure 4.
The validation sheet in the aspect of content validity .
omain definitio.
The aspects to be assessed: Content validity .
omain relevance and representatio.
The test instruments that was developed are relevant and represent the content of the Figure 5.
The validation sheet in the aspect of content validity .
omain relevance and The aspects to be assessed: Construct validity The test instrument that was developed factually contains the correctness of the concept in terms of theory.
Figure 6.
The validation sheet in the aspect of construct validity The results of the validity and reliability tests of the instrumen that was developed are presented in Table 3.
Table 3.
The results of the validity and reliability tests of the instrumen Content Validity Construct Mean Mean Indicator Validity Items DRR Analysis Prisma Sains: Jurnal Pengkajian Ilmu dan Pembelajaran Matematika dan IPA IKIP Mataram.
June 2020.
Vol.
No.
| .
Development of the test instrument for a.
Verawati et al Indicator Inference Evaluation Decision Content Validity DRR Items mean score mean score of each item validity mean score of validity (V.
Percentage of agreement Construct Validity Mean 69 .
ery vali.
98,7% .
Mean annotation: DD .
omain definitio.
DRR .
omain representation and relevanc.
V .
In recent years, there has been increased recognition of the role of measuring instruments in the assessment process in education.
That is, in addition to providing evaluative information about a student, assessment can and must also function as a mechanism to assist learning to achieve desired learning goals (Wiliam, 2.
As specific objectives are established in learning, specific instruments are developed for the intended purpose.
For example, learning objectives towards learning outcomes of critical thinking skills, the measurement and assessment instruments must also be oriented towards critical thinking skills.
In compiling an instrument, it is not enough just to determine the topic or material to be assessed, but it is also necessary to determine more specifically what thought processes will be assessed for certain Criteria for measuring critical thinking instruments have been established in this study, namely the suitability of the content domain to be measured and assessed in critical thinking, the suitability of the item items with indicators of critical thinking, and the instrument items can provide a stimulus in which the questions presented are closely related to the real world context .
Critical thinking skills criteria are set in this research, namely on aspects of analysis, inference, evaluation, and making decisions.
Furthermore, the instrument item construction format is in the form of essay questions, this is in accordance with the suggestion from Brookhart .
that the measurement of high-level thinking including critical thinking can use two item item formats, namely essay questions or performance assessment.
Explanation in students' answers can provide more valid information about their critical thinking abilities, so that the evaluator in this case the teacher can give an interpretation of the level of critical thinking students.
Accommodating the criteria for the preparation of instruments for measuring critical thinking skills as explained earlier, the instrument for thinking critical thinking skills has been Prisma Sains: Jurnal Pengkajian Ilmu dan Pembelajaran Matematika dan IPA IKIP Mataram.
June 2020.
Vol.
No.
| .
Verawati et al Development of the test instrument for a.
developed and compiled in the form of essay questions.
A total of 14 test items were developed to accommodate the four indicators of critical thinking set in this study.
The instruments compiled were then validated .
ontent and construc.
by two validators.
Validation results show the average score for each component, namely the content validity of 4.
63 and construct validity of 4.
The average score which is the final result of the instrument validation is 4.
categorized as very valid .
ery valid if: Va> 4.
, a percentage of agreement rating of the validators is 98.
7% with reliable criteria.
The average score of content validity on aspects of analysis, inference, evaluation, and making decisions in a row is 4.
56, 4.
75, 4.
5, and 4.
75, all with very valid criteria.
These results indicate that the instrument is able to measure the content domain to be measured, in this context is the content of critical thinking.
A more specific meaning is that the test instruments developed are in accordance with the operational definitions of the aspects of critical thinking that are measured as well as, are relevant and represent questions of critical thinking.
The average construct validity score on aspects of analysis, inference, evaluation, and making decisions in a row of 5, 4.
63, 4.
63, and 4.
75, all with very valid criteria.
That is, the operationalization of the instrument item developed construct is based on theory.
The developed instrument has also been reliable, this is indicated by the percentage of compatibility by two validators of 98.
In accordance with the objectives to be achieved, the instrument has been developed in measuring the critical thinking skill and has been declared valid and CONCLUSION The instrument for measuring critical thinking skills was developed with criteria.
the suitability of the content domain to be measured and assessed in critical thinking, .
the suitability of the item items with the critical thinking indicator, and .
the instrument items can provide a stimulus where the questions presented are closely related to the real world context.
The measurement instruments of critical thinking skills developed have been valid in content and construct, as well as reliable based on the validator's instrument rating.
Therefore, it can be used to measure students' critical thinking skills on fluid material.
RECOMMENDATION
The instruments developed need to be empirically tested in class in high school students and their empirical validity is calculated, the results will be a strong support for the results of the content and construct validity tests that have been obtained previously.
ACNOWLEDGEMENT
This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors.
REFERENCES