International Journal of Electrical and Computer Engineering (IJECE) Vol. No. February 2017, pp. ISSN: 2088-8708. DOI: 10. 11591/ijece. Decision-Making Model for Student Assessment by Unifying Numerical and Linguistic Data Sri Andayani1. Sri Hartati2. Retantyo Wardoyo3. Djemari Mardapi4 Doctoral program of Computer Science. Universitas Gadjah Mada. Yogyakarta Indonesia Department of Computer Science and Electrical. Universitas Gadjah Mada. Yogyakarta Indonesia Study Program of Educational Research and Evaluation. Graduate School. Yogyakarta State University. Indonesia Article Info ABSTRACT Article history: Learning assessment deals with the process of making a decision on the quality or performance of student achievement in a number of competency In the process, teacherAos preferences are provided through both test and non-test, generally in a numeric value, from which the final results are then converted into letters or linguistic value. In the proposed model, linguistic variables are exploited as a form of teacherAos preferences in nontest techniques. Consequently, the assessment data set will consist of numerical and linguistic information, so it requires a method to unify them to obtain the final value. A model that uses the 2-tuple linguistic approach and based on matrix operations is proposed to solve the problem. This study proposed a new procedure that consists of four stages: preprocessing, transformation, aggregation and exploitation. The final result is presented in 2-tuple linguistic representation and its equivalent number, accompanied by a description of the achievement of each competency. The value of 2-tuple linguistic in the final result and in the description of each competency becomes meaningful information that can be interpreted as a comparative ability one student has related to other students, and shows how much potential is achieved to reach higher ranks. The proposed model contributes to enrich the learning assessment techniques, since the exploitation of linguistic variable as representation preferences provides flexible space for teachers in their assessments. Moreover, using the result with respect to studentsAo levels of each competency, studentsAo mastery of each attribute can be diagnosed and their progress of learning can be estimated. Received Mar 24, 2016 Revised Aug 24, 2016 Accepted Sep 10, 2016 Keyword: Multi criteria decision making Student assessment The linguistic 2-tuple Unifying linguistic and numeric Copyright A 2017 Institute of Advanced Engineering and Science. All rights reserved. Corresponding Author: Sri Andayani. Department of Mathematics Education. Faculty of Mathematics and Natural Sciences Yogyakarta State University. Jl. Colombo. No. 1 Karangmalang. Yogyakarta. Indonesia. Email: andayani_uny@yahoo. com, andayani@uny. INTRODUCTION Decision-making in education have evolved to help people in many purposes, such as for instructional decision, curricular decision, selection decision, placement or classification decision and personal decision . An example of educational decision is selection of courses in the higher education . These purposes are implemented in many types of educational decision-making. one of them is Credentialing and Certification Decisions that decides whether or not students have met certain standards . This opinion is supported by . which states that the assessment of education related to the process of giving a decision on the quality or performance of studentAos achievement. This decision-making is done through a process of learning assessment on a number of competency standards. Journal homepage: http://iaesjournal. com/online/index. php/IJECE IJECE ISSN: 2088-8708 Generally, assessment method is designed to evaluate many competencies but the final result is merely a grade without any description about studentAos achievement in every competency. The method can be unfair if not considering many specializations of a specific competency. Mossin et al . have proposed a model of evaluation method based on fuzzy sets which can determine the capabilities and the deficiencies of a student in different areas of knowledge in industrial automation. The assessment process is conducted through various techniques, both test and non test, and usually the result is given in numerical value which is then interpreted into a letter or linguistic variable. Linguistic variable is a variable whose value is not numbers but words or sentences describing the competency and the words are characterized by fuzzy sets defined in the universe defined set . Valuation in non-test assessment techniques such as assignments and observations is quite possible or even more appropriate if presented using linguistic variables. Sometimes, some assignments and observations would be easier to assessby means of linguistic variables because such valuations cannot be ascertained by numeric scores. Considering that possibility, it is proposed to use linguistic variables not to represent qualitative aspect, but to represent teacherAos preferences in the non-test assessment techniques. Thereby, teachers can assess using linguistic variables, in the case that has been done using numerical value. As a consequence of using the linguistic variables, assessment data set will consist of numerical and linguistic information, so it needs a procedure to combine the two types of data to obtain the final result. There have been studies, which are initiated by Herrera and Martinez . that combines numeric and linguistic variables and represents unification results in 2-tuple linguistic approach. This 2-tuple linguistic approach is better than other linguistic approaches to overcome the problem of combining linguistic and numerical values. Unification result of other linguistic approaches usually does not exactly match any of the initial linguistic terms, and needs an approximation process to express the result in the initial expression This consequently produces the loss of information and hence causes the lack of precision, but it can be well handled by the 2-tuple linguistic approach. Considering some problems described above, it is important to develop a robust assessment method which can accommodate the use of linguistic variables in some assessment techniques in such a way that the final result can describe studentsAo strong and weak points in every competency. Some ideas implemented in the previous studies are combined to define solution for the problem. The aim of this paper is to extend the concept of solving Multi Criteria Decision Making (MCDM) problems under linguistic environment, to solve the problems of learning competency evaluation. The extension includes information about determining weights of learning competency, using linguistic variables to value studentsAo performance in some assessment techniques, combining numeric and linguistic data and informing the studentAos excellence in a specific competency, but did not succeed in another competency. order to do this, the remaining part of this paper is organized as follows: In Section 2, some basic definitions of the 2-tuple fuzzy linguistic approach and some aggregation operators are briefly reviewed. Section 3 describes some basic definitions to integrate numeric and linguistic. The proposed method to solve the problems based on unifying numeric and linguistic is presented in Section 4. Section 5 presents result and analysis and finally the paper is concluded in Section 6. THE 2-TUPLE FUZZY LINGUISTIC REPRESENTATION Computational techniques for dealing with linguistic terms can be classified into three categories . , i. extension principle, symbolic method, and 2-tuple fuzzy linguistic representation model. In the first two approaches, the results usually do not exactly match any of initial linguistic terms, and then an approximation process must be developed to express the result in the initial expression domain. This consequently produces a certain loss of information and hence results in the lack of precision. Herrera and Martynez . , proposed the third approach, namely the 2-tuple fuzzy linguistic representation model to overcome these limitations, through2-tuples . , ), which iscompiledby thelinguistic termss while assessedthe numericalvaluein the interval [-0. 5, 0. Definition 1. The symbolic translation of a linguistic term consists of a numerical value that supports the Audifference of informationAy between a counting of information assessed obtained after a symbolic aggregation operation . cting on the order index of the label. and the closest value in that indicates the index of the closest linguistic term in The linguistic representation model defines a set of functions to make transformation between linguistic terms and 2-tuples. Decision-Making Model for Student Assessment by Unifying Numerical and Linguistic Data (Sri Andayan. A ISSN: 2088-8708 Definition 2. Let the function as: be linguistic term, then its equivalent 2-tuple representation is obtained by means of . A crisp value can be transformed into the 2-tuple linguistic variable using the following definition: Definition 3. Let be a linguistic term set, be a number value representing the symbolic aggregation result of linguisticterm. Then the 2-tuple that expresses the equivalent information to is obtained using the following function: where round is the usual rounding operation, symbolic translation. Definition 4. Let there exists a function numerical value has the closest index label to is the value of the be a linguistic term set and is 2-tuple linguistic information, then which is able to transform 2-tuple linguistic information into its equivalent . COMBINING NUMERICAND LINGUISTIC USING LINGUISTICAPPROACH Let is a numerical value and a set of term linguistic. To combine numerical and linguistic values, it takes several functions that transform these values into a 2-tuple linguistic Herrera and Martinez . have defined the function, which includes two steps, i. into fuzzy set in S and transforming the fuzzy set into 2-tuple linguistic model assessed in S. Definition 5. Let is a numerical value and into fuzzy set in S using function defined as follows: a set of term linguistic. Transforming such that . The semantic of the membership function is given b trapezoidal parametric function whose parameters The result will be transformed into linguistic 2-tuple using definition below. Definition 6. Let )} be a fuzzy set that represents numerical value the linguistic set To obtain a numerical value that represents information from the fuzzy set assessed in . by means of function IJECE Vol. No. February 2017 : 363 Ae 373 IJECE ISSN: 2088-8708 Oc Value is transformed into 2-tuple linguistic by using the function i as in Equation 2. Once obtained the transformation results in 2-tuple linguistic model, unifying process of the information is conducted using 2-tuple linguistic aggregation operator. Some aggregation operators for 2-tuple linguistic variables defined, such as arithmetic mean, weighted average, and linguistic weighted average operator . The operators are defined as follows. Definition 7. Let be a 2-tupel linguistic set, then the arithmetic mean is I I ( Oc Definition 8. Let be a 2-tuple linguistic set, and be their associated weights. The 2-tuple weighted average I is Oc The results in 2-tuple linguistic should can be converted into an appropriate numerical value. There are 2 steps to convert a value of 2-tuple linguistic into a value of . Definition 9. Let be2-tuple linguisticbased onsymbolic translation, where whose equivalent numerical value is Function computes two 2-tuples based on the membership degree, from the initial 2-tuple linguistic, that support the same counting of information: Definition 10. Let be two 2-tuple linguistic sets based on membership degree, the equivalent numerical value assessed in . is obtained using function CV (. ) is a function providing characteristic value. The result is a crisp value that summarize the information given by a fuzzy set , one of them is maximum value (MV). Definition 11. If given label with the membership degree Therefore CV (. ) of maximum value is defined as , height is defined as . PROPOSED MODEL In the proposed model, the weight is assigned to the learning competencies, not to each of assessment techniques, and determined using a specified method. This model proposes to exploit linguistic variable to assess studentAos performance in multiple valuation techniques such as assignment, daily tests, daily observations . , presentations and portfolios. For this purpose, the representation of the linguistic variable must be defined. Decision-Making Model for Student Assessment by Unifying Numerical and Linguistic Data (Sri Andayan. A ISSN: 2088-8708 The set of linguistic variables is defined on the basis of exposure to Herrera and Herrera-Viedma . In view of this, a linguistic term set, with seven labels used in the proposed model can be defined as follows and the semantic is described in Table 1. Table 1. Linguistic Terms and their Semantics Symbol Abb. Linguistic term Very poor Poor Average Above average Good Very good Excellent Triangular Fuzzy Number . ,0,0. , 0. 17, 0. 17, 0. 33, 0. 33, 0. 5, 0. 5, 0. 67, 0. 67, 0. 83, . 83,1,. The cardinality of linguistic term set S in a limited number of grades must be defined appropriately. It could be small enough but does not reduce the precision of the value and it should be rich enough to allow discrimination of the performances of each criterion. Based on study, the psychologists recommended the use of 7A2 labels, less than 5 being not sufficiently informative, more than 9 being too much for a proper understanding of their differences . Moreover, in educational measurement seven categoriesscaleat the same distance is consistent with ThurstoneAoscale and has a good reliability . The set of semantic linguistic terms are represented by triangular fuzzy numbers (TFN). TFN is a simple method and easily understood to represent an assessment of decision maker, and fuzzy arithmetic operations in TFN are very easy to do . In addition, the membership function of TFN is considered quite reliable in showing the uncertainty of linguistic assessmentwhich usually represents estimated subjective assessment of decision makers . Uncertainty is one source of measurement errors, which in educational measurement is considered and represented as shown in the Equation The Equation shows that observed score ( ) consists of true score ( ) and measurement error ( ) . Learning assessment is conducted to assess a number of competency standards. For example. Table 2 shows the math competency standards for high school of class X in the first semester. Table 2. Competency Standardsof Math class X semester 1 Standard of Competency Solve problems related to the power, roots, and Solve problems related to the functions, equations and quadratic functions and quadratic inequality Basic Competency Using the rules of power, roots, and logarithm Performing algebraic manipulations in computation involving power, roots, and logarithms Solve problems associated with linear equations system and one variable 1 Solving of 2-variables linear equations system and 2-variables mixed linear and quadratic equations system 2 Designing a mathematical model of a problem associated with linear equations system 3 Solving mathematical models of a problem related to linear equations systems and its 4 Completing one-variable inequality that involves algebraic fractions 5 Designing a mathematical model of problems associated with one-variable inequality 6 Solving mathematical models of problems associated with one -variable inequality and its 1 Understanding the concept of a function 2 Drawing a graph of simple algebra and quadratic functions 3 Using the properties and rules of quadratic equations and inequalities 4 Performing algebraic manipulation in computation related to quadratic equations and inequalities 5 Designing a mathematical model of a problem related to equality and / or a quadratic function 6 Solving mathematical model of a problem related to equality and / or quadratic functions and their Let A=. 1,Aa. be the set of students who will be assessed based on several standard of competencies C=. 1,A,c. which are described into some basic competencies B=. 1,A,b. Learning assessment is conducted using several techniques T=. 1,A,t. in which the number of the type . varies according to the basic competency. For example t1 denotes for test, t2for observation, and t3 for assignment. IJECE Vol. No. February 2017 : 363 Ae 373 IJECE ISSN: 2088-8708 The value in each ti may be either numerical x . or linguistic S=. 0,A,s. For this purpose, the numerical value assigned by the teacher are commonly presented in . and must then be transformed into . This scheme is illustrated in Table 3. Table 3. Scheme of assessment problem with numeric and linguistic values Alternati ve ( )/ Basic Competency A A Competency Standard Basic CompeBasic CompetencyA Basic CompetencyA Competency Standard Basic Competency A Basic Competency A Steps for determining the final value of the assessment data set are prepared using 2-tuple linguistic approach and based on the matrix operations. Set of values within each basic competency . arked by a red can be presented into a decision matrix ( ) , where if using numerical values and if using linguistic values. varies between each basic competency. There are two main phases of a common decision resolution scheme, i. the aggregation phase that aggregates the values provided by the experts to obtain a collective assessment for the alternatives. exploitation phase of the collective assessments to rank, sort the best one/samong the alternatives . For the proposed model, the stagesare carried outin a2-tuple linguistic forthe evaluation of learning competency is developed based on the common phase with several improvements. Figure 2 shows a basic scheme of this approach, whose steps are further described below. Calculating the weight of using rating scale and FANP Determining the final result . ,) for each student by applying Weighted Average operator Transforming final result . ,) into numeric Determining the final decision matrix Grading for each competency in 2-tuplelinguistic Determining the final value of each competency Exploitation Aggregation Numeric: E . Preprocessing Creating matrix of basic competency in numerical and linguistic data Determining matrix in 2-tuplefuzzy linguistic Transformation Figure 2. Steps of the proposed method Preprocessing There are two processes carried out at this stage, i. transforming numerical value into . and determining the weight of learning competencies. In general, the numerical value assigned by the teacher presented in . For the proposed model, the value must be transformed into . On the other hand, the weights of the learning competencies are determined using a combination of rating scale . with Fuzzy Analytic Network Process (FANP). This combined method is developed based on some research, i. Decision-Making Model for Student Assessment by Unifying Numerical and Linguistic Data (Sri Andayan. A ISSN: 2088-8708 application of FANP in requirements in the house of quality . An IT project selection . Total Quality Management . , and selection of facility location . This combined method also considers some drawbacks of ANP . and enhance linguistic scale which is used in a pair wise comparison matrix for FANP based on the previous one . , . Transformation: Transforming Numerical and Linguistic Information Into 2-tuple Fuzzy Linguistic Preferences given by the teacher for the student consisting of numerical and linguistic information are presented in the form of a decision matrix Each element in the matrix is then transformed into 2-tuple linguistic to obtain matrix The transformation is performed using Equation 1 for linguistic information. and Equation 4, 5 and 2 for numerical information. Aggregation Determining the final value of each basic competency for every student The final value of each basic competency for every student is determined by calculating the average of each row in the 2-tuple linguistic decision matrix using Equation 6 in order to obtain a matrix column I I I I I I I I I ( Oc Determining the final decision matrix The final decision matrix is a set of final value of each basic competency. Therefore it is composed by merging k column matrix obtained in step . I I I I I I I I I I I I Aggregating the information and the degree of importance of evaluation competency using weighted average operators to obtain the final results At this stage the 2-tuple linguistic information for all of the attributes obtained by any alternative would be aggregated into a single value, which means aggregating each row in the final decision matrix. Since each attribute . asic competenc. in the assessment data has an important weight, and then the weight is taken into account in the process of aggregation by using a weighted average operator (Equation . Exploitation Describing the achievement level of each competency Each column inthe final decision matrix shows the value of m students for each basic competency. Ma and Zhou . have proposed a method called fuzzy grading system by transforming numerical values into corresponding letter grades, based on membership degree of a fuzzy function. Moss in et al . uses a classification system based on fuzzy rule to assess each competency. Thereby, the final decision matrix represents a combination of the two ideas. Thus, each cell in I I in the final decision matrix shows achievement of student ith in basic competency bth and will be elaborated as the achievement level of each student of each basic competency. Transforming the final results into the final pertinent numerical values Numerical final score which is equivalent with final result in 2-tuple linguistic is still needed in a final report. Therefore, to complete the process, the last stage is converting the final 2-tuple linguistic into numeric information using Equation 3, 8 and 9. IJECE Vol. No. February 2017 : 363 Ae 373 IJECE ISSN: 2088-8708 RESULTS AND ANALYSIS Supposea teacher will assess studentsAo competencies in a course which has 14 basic competencies as depicted in Table 2 which will be assessed by means of three kinds of evaluation techniques, i. assignments and observation. Each of the techniques can be conducted once or more. If, for example, there are six students, , from the assessment data set of fourteen basic competencies as in Table 2. The linguistic term set S used in the assessment is defined as in Table 1. The decision matrix which is used to represent the assessment value of six students for each basic competency is ( ) , where The fourteen decision matrices can be obtained for the fourteen relevant basic competencies of the six students. For example, the first three decision matrices are shown below. Each of the decision matrices is then transformed into2-tuple linguistic matrix. The transformation results for the three example matrices above are shown below. (VG,-0. (E,. (G,-0. (A,. (E,. (E,. (G,0. (G,. (G,-0. (G,. (VG,-0. (VG,. (G,. (A,. (VG,. (A,. (A,. (G,. (G,-0. (AA,-0. (VG,0. (G,0. (G,-0. (G,0. (G,. (VG,. (P,. (AA,. (G,. (G,. (G,. (AA,. (G,. (A,. (AA,. (A,. (VG,. (A,. (VG,. (G,. (A,. (G,. (VG,0. (G,0. (VG,0. (G,0. (G,0. (VG,0. (G,. (E,. (A,. (A,. (G,. (G,. (G,. (AA,. (A,. (P,. (G,. (E,. For every 2-tuple linguistic decision matrix, the average of each row will be determined using Equation 6, and results a column matrix. There are fourteen column matrices which are later merged into the final decision matrix, whose results are presented in Table 4. Table 4. The Final Decision Matrix (VG,-0. (G,0. (VG,0. (G,. (G,0. (G,-0. (AA,0. (AA,-0. (A,0. (AA,-0. (AA,0. (A,0. (A,-0. (E,-0. (VG,-0. (G,0. (VG,0. (E,-0. (AA,0. (G,-0. (G,-0. (AA,0. (AA,-0. (VG,-0. (AA,0. (VG,0. (VG,-0. (E,-0. (G,0. (G,0. (VG,0. (VG,-0. (A,-0. (AA,0. (AA,-0. (G,-0. (A,0. (A,0. (AA,0. (G,-0. (VG,-0. (E,-0. (G,0. (VG,-0. (VG,-0. (VG,-0. (G,0. (G,0. (VG,0. (AA,-0. (AA,0. (G,0. (VG,. (G,-0. (VG,-0. (G,-0. (AA,-0. (A,0. (AA,-0. (G,. (A,0. (A,0. (A,. (G,0. (VG,-0. (G,0. (VG,-0. (AA,-0. (AA,0. (G,-0. (AA,-0. (G,0. (VG,0. (VG,-0. (VG,-0. (VG,. (VG,. (VG,0. (G,0. (VG,-0. (VG,-0. (G,0. (G,0. (VG,0. Table 5. The final results of studentAos assessment Stu# Numeric 2-TL score (VG,-0. (AA,-0. (VG,0. (G,-0. (AA,0. (VG,-0. Description Very good, although still needs 32% more to achieve this rank Above average, although still needs 34% more to achieve this rank Very good, has a potential of 3% to achieve higher ranks Good, although still needs 41% more to achieve this rank Above average, has a potential of 34% to achieve higher ranks Very good, although still needs 47% more to achieve this rank Suppose the weight of fourteen competencies obtained from the calculation using combination of rating scale and FANP methods is w = . Finally, the final results of studentAos assessment in the form of the 2-tuple linguistic are determined using Equation 7. To accomplish the results, the final 2-tuple linguistic scoreis converted into Decision-Making Model for Student Assessment by Unifying Numerical and Linguistic Data (Sri Andayan. A ISSN: 2088-8708 numeric using Equation 3, 8 and 9. The meaning of the score can be described referring to the definition of as stated in Definition 1. The results are shown in Table 5. Based on Table 5, the student rankings are: student #3> student #1> student #6> student #4> student #5> student #2. Table 6 shows the detail result of each competency for student#1. The score of each competency can be seen in the first row of Table 4. From Table 6, the final value of student #1 is 77. 86 and (VG, -. The result shows that student #1 is in category of Very Good (VG), although she/he still needs 32% to reach the grade VG, indicated by a value of = -0. Table 6. Detailed result for student#1 Stu# Numeric score 2-TL score 2-TL based membership degree (VG,-0. (G,0. , (VG,0. 2-TL score (VG, -0. (G,0. (VG,0. Description Very good, although still needs 6% more to achieve this rank Good, has potential of 47% to achieve higher ranks Very Good, has potential of 2% to achieve higher ranks Details: Competency# C1. C1. C1. Etc. Description Very good, although it still needs 32% more to achieve this rank The final results using a 2-tuple linguistic provide meaningful information about studentAos Value on the linguistic 2-tuples in the final value of a student can be interpreted as a comparison of ability with other students if they are in the same category, and show how much potential the student has to reach higher ranks. Generally, the final result of learning process is determined by the arithmetic average method. The method is a statistical indicator that represents the central tendency of data. The computation is simple and commonly used in student learning assessment problem. However, this method is strongly influenced by outliers and cannot deal with quantitative and qualitative data simultaneously . Therefore this study proposes a model that uses 2-tuple linguistic approach to cover the weaknesses of the method. According to . , the 2-tuples linguistics model has been applied in many fields. However it has not been used in the assessment of learning. In . , a problem of higher education studentsAo selection is solved using the 2-tuples linguistics approach and it shows that this approach provides information about studentsAo rank more accurately and reasonably, furthermore, it does not lose any valuable information from the The results of this study in-line with the results of the previous one. In addition, this study also offers several significant findings, namely: . a new procedure for determining the final result which combines numerical and linguistic data, . the opportunity of using linguistic variable instead of numeric for some technical evaluations which consider psychological factors, so that it is possible to integrate the attitude assessment into cognitive one which is usually conducted separately, . the meaningfulness of the results since value of the final results inform the degree of ability and to reach higher ranks, . the richness of the results since it evaluates students with respect to their levels of competence in each attribute such as knowledge or skills. Using this result, studentsAo mastery of each attribute can be diagnosed and their progress of learning can be estimated. According to . , the result supports the purpose of Cognitive Diagnosis Theory, which is to provide students, teachers, or parents-individual feedback regarding to studentAos mastery of eachcompetency measured by the assessment. CONCLUSION The modeling and handling of linguistic information are crucial in the assessment of learning since there are qualitative aspects included in the assessment. Therefore a method using 2-tuple linguistic representations to compute the final score of assessment that involves numerical and linguistic information has been proposed. Value of the 2-tuple linguistic in the final result and in the description of each competency becomes meaningful information that can be interpreted as a comparative ability one student has related to other students, and shows how much potential is achieved to reach higherranks. The proposed model contributes to enrich the learning assessment techniques, due to the exploitation of linguistic variable as representation preferences, providing flexible space for teachers in their assessments. Moreover, the model IJECE Vol. No. February 2017 : 363 Ae 373 IJECE ISSN: 2088-8708 gives evaluation result with respect to studentsAo levels of competence in each attribute such as knowledge or Using this result, studentsAo mastery of each attribute can be diagnosed and their progress of learning can be estimated. REFERENCES