Journal of Applied Engineering and Technological Science Vol 3.
2022 : 178-184
USABILITY TESTING ON TRACER STUDY SYSTEM USING THE
HEURISTIC EVALUATION METHOD
Afriansyah1*.
Walhidayat2.
Rizki Novendra3.
Lidwina Harefa4.
Sutejo5 Universitas Lancang Kuning afriansyah@unilak.
Received : 25 May 2022.
Revised: 29 June 2022.
Accepted : 30 June 2022
*Corresponding Author
ABSTRACT
A tracer study is a survey of graduates tracks alumni activities after graduating from an educational institution.
Lancang Kuning University is one of the educational institutions that have a tracer study system.
A system can be said to be good if it has good usability.
So the purpose of this research is to find out whether the tracer study system of Universitas Lancang Kuning has good usability.
The heuristic evaluation method will be used to measure usability using 10 aspects of usability heuristics with a questionnaire media in collecting data.
Before distributing the questionnaires, an instrument test such as the Gregory test will be carried out by involving system experts and linguists.
Then a validity test will be carried out, a reliability test will be carried out after that a heuristic test is carried out by distributing questionnaires.
Based on the calculation results that the lowest percentage is owned by the visibility of the system status variable by 75% and the highest percentage results in the match between the system and the real world and consistency and standard with the same calculation results obtained by 81%.
The results of the analysis show that the tracer system of Universitas Lancang Kuning has high usability with an average percentage of 78%.
Keywords : Usability.
Heuristic Evaluation.
Tracer Study Introduction The usability test of a web is something that needs to be considered by software developers to create an attractive and user-friendly interface design to make it easier for all users(Hartstein, et al.
, 2.
Usability testing is one way to find out how easy it is for users to use an application, how efficiently and effectively an application or website can help users achieve their goals, and whether users are satisfied with the application used(Merve Demirci, 2021.
Anderjovi, et al.
Usability is centered on the attributes of a system and efforts to avoid errors or usability problems(Beatty, et al.
, 2.
While the focus of UX is on the user and the user's good response to the system can be seen from the emotions, behavior, and values resulting from the interaction of the system with the system.
Lancang Kuning University is a private university in Pekanbaru that already has a system, one of which is a tracer study system that is already running, which will be filled in by alumni themselves(Dilan, et al.
, 2022.
Chrismanto, et al.
, 2021.
Hamzah, et al.
The tracer study service system in P2K2 can achieve specific goals effectively, efficiently, and achieve user satisfaction, so a usability evaluation is needed, one of which is using the Heuristic Evaluation method(Langevin, et al.
, 2.
Heuristic evaluation is a usability evaluation method whose aim is to improve a design effectively by using 10 aspects of usability heuristics.
This method allows evaluators who can independently evaluate and assess the system from every aspect of usability heuristics that indicate usability problems in a system.
This study aims to determine the usability level of the Universitas Lancang Kuning tracer study system using the Heuristic Evaluation method(Alcaraz Martynez, et al.
, 2021.
Hamzah, et al.
, 2.
Tracer Study is an approach that allows higher education institutions to obtain information about deficiencies that may occur in the educational process and the learning process and can be the basis for planning activities for future improvements.
The specific objectives of the tracer study include knowing the relevance of implementing the curriculum that has been applied in universities to the needs of the labor market and professional development in the competence of the department(Klarich, et al.
, 2.
Afriansyah et al A Vol 3.
2022 : 178-184 Usability testing is a technique used to evaluate products by testing them directly on users, usability testing is an attribute to assess how easy the website interface is to use (Rocha, 2021.
Khairani, et al.
, 2.
Based on this statement, it's can be concluded that usability is a tool used to measure efficiency, ease, and ability to remember interactions without problems or errors.
Experts in the usability field state that usability consists of two main things, namely are ease of learning and ease use(Jycome Filho & Macydo, 2.
Heuristic Evaluation is one of the methods commonly used to perform usability testing.
Nielsen's opinion states that this method is commonly used to find usability problems in user interface design finding usability problems in interface design this method can be included as part of the interactive design process (Bouraghi, et al.
, 2022.
Bauer-Negrini, et al.
, 2.
Research Methods The method used is the Heuristic evaluation method using 10 aspects of usability in the measurement scale:
Fig.
Usability Heuristic Results This study collected answers from 15 respondents using a Likert scale consisting of strongly agree (SS), agree (S), neutral (N), disagree (TS), and strongly disagree (STS).
Each variable is calculated using the statistical formula percentage.
Heuristic Test Result Based on Figure 3, it can be seen the results of calculating the average percentage of each variable in the heuristic evaluation method with the highest percentage value being in the match between system and real-world (H.
variable with a value of 81.
33% and the lowest percentage being in the visibility of system status variable ( H.
with a value of 75.
Afriansyah et al A Vol 3.
2022 : 178-184 Average Percentage 67v.
Fig.
Percentage of Heuristic Test Results Instrument Trial Results Gregory Test Results The calculation of the validity test of an instrument was completed using the Gregory formula which involved 2 experts (Geisen & Romano Bergstrom, 2.
The results of calculations involving 2 experts, namely linguists and systems experts, the results of the content validity coefficient of the instrument being tested was 0.
So it can be concluded that this instrument meets the criteria for hearing very high validity.
2 Validity Test Results The construct validity test used the Pearson product Moment correlation formula.
Instrument testing uses a sample of 15 respondents with an r table value of 0.
The instrument items tested were 32 items, one statement was declared invalid .
liminated immediatel.
and 31 items were declared valid.
Calculation results using Microsoft Excel 2013 and the IBM SPSS Statistics 25 application.
3 Reliability Test Results A reliability test is used to test whether the instrument used is reliable.
Strong if there is a similarity of information at various times.
The test calculation uses the IBM SPSS Statistic 25 From the results of the reliability calculation using the Alpha Cronbach formula, 971> 0.
6, it can be concluded that the statements used in the questionnaire are reliable, which means that there are similarities in the data at different times and the following data is 4 Recommendations Afriansyah et al A Vol 3.
2022 : 178-184 Fig.
Instrument Menu Page .
Fig.
Instrument Menu Page .
Based on Figures 3 and 4 the draft recommendations.
The improvements made are as follows :
Consistency in letters/words such as the word "MAGANG" into Capitalize Each Word format refers to heuristic number 4, namely consistency and standard on statement item number 14 based on the questionnaire results obtained on this item 4 respondents chose strongly agree, 10 respondents chose to agree and 3 respondents neutral answer.
Remove the word Auselamat datangAy on the upper right side of the instrument fill page.
The use of the word "selamat datang" on the instrument filling page is considered unsuitable because in general the word "selamat datang" refers to someone who has just entered the system usually located on the web prefix after logging in, referring to the heuristic number 2 in statement item number 6.
Based on the results questionnaire 3 respondents chose neutral on statement number 6.
Afriansyah et al A Vol 3.
2022 : 178-184 .
The next recommendation is to eliminate foreign symbols or symbols that are considered unfamiliar or do not understand the meaning which is located on the lower right corner as a telephone symbol, with reference to heuristic number 2 in statement item number 4.
Adding or providing a user manual menu so that users can access the system properly refers to heuristic number 9, namely help users recognize, diagnose, and recover from error question number 30.
Remove the login icon or link to log in.
The existence of redundant buttons on login after alumni enter the Unilak tracer study page menu has the potential to cause users to be Based on the book Research-Based Web Design & Usability Guidelines which states not to provide two or more ways with the same information on one web page.
Therefore, the researcher changed the information on the user login icon to an icon with alumni information that had logged in as alumni.
Changing the font color with a darker color, when compared to the previous color, the gray font on the instrument filling form is closer to gray so that the font is not very visible and This recommendation is based on a rule from the book Research-Based Web Design & Usability Guidelines, which is that people will read dark text 32% faster than reading light Fig.
Result of Recommendation for Improvement of Instrument Menu .
Conclusion Based on the results and discussion, it can be concluded that the results of the analysis of the tracer study system at Lancang Kuning University using 10 aspects of usability variables obtained from 15 respondents with 31 research questionnaire statements obtained an average percentage, namely Visibility of system status 75%.
Match between system and the real world 81%.
User Control and Freedom 80%.
Consistency and standard 81%.
Prevention System Error 79%.
Recognition rather than recall 77%.
Flexibility, and Efficiency of Use 77%.
Aesthetic and minimalist design 79%.
Help users recognize, diagnose, and recover from error 77%, and Help And Documentation 77%.
From this statement, the average usability percentage is 78% in the high category.
Afriansyah et al A Vol 3.
2022 : 178-184
References