doi:10. 21831/cp. Cakrawala Pendidikan. Vol. No. February 2021 DESIGN AND MULTIMEDIA LEARNING PRINCIPLES ON MOOC INDONESIAX Andreas Rio Adriyanto*. Imam Santosa. Achmad Syarief. Irfansyah Institut Teknologi Bandung. Indonesia *e-mail: imamz@fsrd. Abstract: The AuKampus MerdekaAy or AuFreedom CampusAy policy from the Indonesian Ministry of Education gives students the freedom to participate in learning activities outside their study program. Learning resources can be obtained from online-based learning. One online learning resource is Massive Online Open Course (MOOC), which has gained massive participation. Good quality learning materials can help students construct their knowledge. Indonesian MOOC providers have developed their learning materials, but they are still not optimal in quality. This study aims to analyze the implementation of design and multimedia principles on Indonesian MOOCAos learning materials. The research used a quantitative strategy with the data collection method of visual observation of the IndonesiaX materials compared to those of edX. Udemy, and Coursera materials. Data analysis was based on the visual analysis of 9 design principles and 12 multimedia learning principles. In this research, the findings reveal that the design consistency and icon representation principles are yet to have an optimal grade. The same conditions are also found in implementing the multimedia principles of coherence, redundancy, and modality. The findings in this study are expected to be a consideration for MOOC providers in designing better online learning materials. Keywords: MOOC. IndonesiaX, multimedia learning, the design principle. PRINSIP DESAIN DAN PEMBELAJARAN MULTIMEDIA PADA MOOC INDONESIAX Abstrak: Kebijakan AuKampus MerdekaAy dari Kemendikbud Indonesia adalah memberikan kebebasan mahasiswa untuk dapat mengikuti kegiatan pembelajaran di luar dari program studi. Sumber pembelajaran tersebut dapat diperoleh dari pembelajaran berbasis daring. Salah satu sumber pembelajaran daring adalah Massive Online Open Course (MOOC) yang terbuka dengan partisipasi besar. Kualitas materi ajar yang baik dapat membantu siswa dalam mengonstruksi pengetahuan. Penyedia MOOC di Indonesia telah mengembangkan materi ajarnya, namun masih belum optimal dalam kualitas materi. Tujuan penelitian ini adalah menganalisis penerapan prinsip desain dan multimedia pada materi ajar penyedia MOOC Indonesia. Penelitian menggunakan strategi kuantitatif dengan metode pengumpulan data lewat pengamatan visual pada materi IndonesiaX dengan perbandingan pada materi edX. Udemy dan Coursera. Analisis data menggunakan analisis visual dari 9 prinsip desain dan 12 prinsip pembelajaran multimedia. Temuan dalam penelitian ini adalah pada prinsip desain konsistensi, representasi ikon masih memiliki nilai yang tidak optimal, kondisi yang sama juga ditemui pada penerapan prinsip multimedia koherensi, redundansi dan modalitas. Temuan dalam penelitian ini diharapkan dapat menjadi pertimbangan bagi penyelenggara MOOC dalam merancang materi ajar daring yang lebih baik. Kata Kunci: MOOC. IndonesiaX, pembelajaran multimedia, prinsip desain. INTRODUCTION The AuKampus MerdekaAy policy from the Indonesian Ministry of Education and Culture gives students the right to take courses outside the study program. It aims to encourage students to get new experiences outside the campus. The labor skills required by the market are sometimes different from the curriculum. Market speed anticipates technology and information that creates much new knowledge that has not been prepared by universities. The university curriculum is not flexible to be replaced every On the other hand, many learning providers provide the latest materials in line with market needs that can be accessed online. One of them is MOOC (Massive Open Online Cours. MOOC is an online learning material with massive participant participation and is accessed online. Some early MOOC providers such as Coursera. Udacity, and edX had features such as. massive participation, openness, online access, learning material in the video material format, quizzes, exams, and discussion format (Daradoumis. Bassi. Xhafa, & Caballe, 2. Learning material available at MOOC providers generally displays video material Some studies reveal that MOOC learning videos are generally relatively short . ive to 20 minute. The quality of instructional videos can vary. Learning videos with minimal quality displays the teacher profile recorded with a medium shot display and combined with text and graphic presentations. For higher quality, learning videos are produced in specialized studios with complete equipment. However, there are also learning videos with low quality by directly recording teachers when teaching (Johnston, 2. A study at the Universitas Teknologi Indonesia found that students and lecturers cannot take advantage of online learning This research finds that there are obstacles in operating online learning properly (Divayana, 2. Other research on the postgraduate programs of Universitas Terbuka deals with analyzing interactions between learning readiness and learning satisfaction. Self-efficacy, self-regulation, and connectedness simultaneously affect learning satisfaction (Suciati, 2. The previous studies show that the individuality factor is the characteristics of online learning. A student is in an independent situation when dealing with a digital screen system to conduct learning activities. In this situation, the visual element of online learning material becomes an essential aspect. Alby & Hernyndez-Leo . gives representations of learning material and investigate how to connect learning outcomes with visual representations. Graphic elements are an essential part of the visual representation of the learning material. However, many have not paid attention to the communication function of the graphic elements. A study in the learning management system (LMS) and open course wares of Indonesian universities found that many course materials use decorative visual The decorative function does not help students construct knowledge but increase their cognitive load memory (Adriyanto. Santosa, & Syarief, 2. On the other hand, students who receive learning are generally digital generations accustomed to using digital devices and the This reality is in line with a survey that found that the average generation born after 2000 spends more than five hours a day on online activities. Unfortunately, the literacy level in book reading is still inadequate (Adriyanto. Santosa, & Syarief, 2. Berliyanto & Santoso . conducted observations at local MOOC providers in Indonesia, specifically IndonesiaX. MOOC Open University. Ciputra University Entrepreneurship Online, and FOCUS Fisipol Gadjah Mada University. IndonesiaX has the largest number and variety of courses compared to other MOOCs observed. One of this studyAos recommendations that strategic planning is required in implementing the MOOC. However. Kurniasari. Jusuf, & Gunardi . states that the number of courses offered by MOOC providers, including IndonesiaX, is not as many as the number of well-known international MOOC courses such as Coursera, edX, or Future Learn. This research also found that there is a low rate of completion and achievement of the IndonesiaX course. Lubis. Idrus, & Rashid . show that the total number of IndonesiaX users of 155,000 is still inadequate compared to IndonesiaAos total internet users of 171 million Several studies have been conducted on IndonesiaX. However, not many have analyzed it from the visual aspect of learning materials. This research aims to observe and analyze IndonesiaX learning materials from the design and multimedia aspects. The study results are expected to provide recommendations for a learning material that is more attractive and comfortable for students. METHODS Strategy of Inquiry The paradigm used in this research is It is a concern with real-world Design and Multimedia Learning Principles on Mooc IndonesiaX practice-oriented and solutions to problems. The research used a quantitative strategy with data collection methods by visual observation of material courses. Data Collections Visual observation is conducted using case studies on IndonesiaX learning materials . ttps://w. by comparing edX . ttps://w. Coursera . ttps:// or. and Udemy . ttps://w. ee Figure . The topics presented in the MOOC are topics related to the implementation of information technology, such as digital marketing topics and user experience Research Instrument The design principle will analyze user interface criteria and multimedia learning principles to analyze video content criteria and learning tools . ee Figure . The design principles are categorized according to the way they work on a design. The categories used in this research are principles of implementation that help people learn from the design and principles of enhancing a designAos usability. These principles are accessibility, chunking, forgiveness, legibility, performance load, 80/20 rule, consistency, control, and iconic representation (Lidwell. Holden, & Butler. Figure 1. Coursera, edX. Udemy and IndonesiaX Figure 2. Design Principle and Multimedia Learning Principles Cakrawala Pendidikan. Vol. No. February 2021 doi:10. 21831/cp. The cognitive theory of multimedia learning (Mayer, 2. is divided into three principles: principles for reducing extraneous processing, managing essential processing, and fostering generative processing. The first principle contains coherence, signalling, redundancy, spatial contiguity, and temporal Later, the second principle includes segmenting, pre-training, and modality Moreover, the third principle consists of multimedia, personalization, voice, and image Codes and assessment parameters are made to facilitate the evaluation. The design principle is divided into two main parts consisting of five parameters related to the principle of implementation that helps people to learn from design . ccessibility, chunking, forgiveness, legibility, and performance loa. and four parameters related to the principle of enhancing the usability of a design . /20 rule, consistency, control, and iconic representatio. The principle of multimedia is divided into three parts. reducing extraneous processing principles . oherence, signalling, redundancy, spatial contiguity, and temporal contiguit. , managing essential processing principles . egmenting, pre-training principle, and modalit. , and fostering generative processing principles . ultimedia, personalization, voice, and imag. Data Analysis A MOOC content material will be evaluated by taking part in online learning. the content meets the parameters, then given a value of 1. If partially fulfilled, it will be given a value of . 5, and if it does not meet, it will be given a value of 0 (Atmaja & Firman, 2. The parameter values are obtained from the number of parameters that meet divided by the total number of parameters for each criterion, multiplied by 5. Multiplication by 5 is related to the range of parameter values in Table 6. The following calculation is to get the parameter . The scale value definition is modified from the web usability measurement, which uses a 0 to 4 scale to illustrate the presence or absence of usability problems in the observed web (Nielsen & Mack, 1. The parameter values obtained in the calculation will get a description according to the range of values described in Table 1. Table 1. Range of Value Parameters Range of Value Parameters . Grade Excellent Good Fair Poor Very poor Not available RESULTS AND DISCUSSION Results The research object is the IndonesiaX lecture material related to information technology with the topic AuDigital MarketingAy delivered by Juanda Ravelim. As a comparison material, the research using Udemy. Coursera, and edX material with the related information technology topic AuUser Experience. Ay Layout Interface Navigation of the learning material using the sidebar navigation located on the left . Figure . The material arrangement is made using division per week. Each week there are sub materials that can be opened by dropping down every weekend. The materialAos main content is a learning video by presenting the lecturer . Figure . In addition to the learning video, there is a narrative text of the learning video . Figure . At the top of the learning video, a graphic shows studentsAo progress in the following material . Figure . When analyzed from the layout aspect, users are given the convenience to access the information needed. Users are given two alternative ways to enter the next sub material, first, by accessing the forward arrow button at the bottom of the learning video . Figure . and second from independently accessing the navigation menu on the left. Multimedia Elements The typeface for the text elements in IndonesiaX uses the sans-serif. The text element is not used as learning material on its web page Design and Multimedia Learning Principles on Mooc IndonesiaX Figure 3. The Interface of IndonesiaXAos Material Content but is a part of the learning video component. The text also becomes a transcript located next to the learning video . Figure . that users can use to search in detail for the teacherAos words about a particular topic. Coursera and Udemy further highlight text as they do with IndonesiaX. While edX still uses text as learning material in addition to learning videos. The image elements are not explicitly placed in the learning material. Images become part of the motion graphics that are in the learning video material. The video-audio material is a significant part of IndonesiaX learning materials. Video content contains a combination of motion graphic content and the teacherAos verbal narration that provides relevant information. The average video duration ranges from nine to 12 minutes. The display on the learning video shows more of the instructor profiles with the medium shot technique than the other The teacher profile appears with an average of 50% to 70% of the total video The videoAos remaining duration is filled with display images, text, motion graphics, and animation. Cakrawala Pendidikan. Vol. No. February 2021 Design Principles Design principles with the implementation that help people to learn from design consist of five parameters with an explanation chart that contains a description of the principles, codes, and parameters to facilitate evaluation in Table The design principle is used to see the MOOC user interface being observed. Overall the value of applying principles that help users to learn from design is excellent grades, except for edX, which gets good grades, as shown in Table 3. In terms of accessibility (DL . IndonesiaX has fulfilled this principle. Users can easily find which menu they want, which course is being done. The navigation display on the left makes it easy to access the desired section. The same thing applies to Udemy and Coursera. edX there is a slight difference. the anatomical navigation menu is located at the top. There is no direct statement about the course material in It displays the icon form that represents the course material, making it difficult for users to navigate it quickly because it does not display the learning material text. This situation is shown in Figure 4. doi:10. 21831/cp. Table 2. The Principle of Implementation That Help People to Learn from Design Code DL 1 Parameter Accessibility: this principle is needed in a design system to be easily used by various user characteristics, without any particular adaptations and modifications. Chunking: This method is implemented in designs with complex information by dividing the information into several locations. Forgiveness: A system can minimize deficiencies or errors for its users. DL 2 DL 3 DL 4 Legibility: Regarding the level of clarity and legibility of the information presented. Performance load: consists of cognitive load and kinematic load. Cognitive load is associated with a load of cognitive function activities, such as users required to recall using a system. The kinematic load is related to physical effort or steps in completing an activity. DL 5 The Rule Do users quickly access parts of the learning material? Does the MOOC system share content and information? Can the system anticipate if the user executes incorrectly? Clear See cognitive and kinematic loads in the process of a system in MOOC. Table 3. Evaluation of Implementation That Helps People to Learn from Design Parameter Assessment DL 1 DL 2 DL 3 DL 4 DL 5 Parameter fulfilled Parameter value Grade Values IndonesiaX Excellent Udemy Excellent Coursera Excellent Note: 1 = parameter fulfilled. 5 = parameter partially fulfilled. 0 = not available Good Mean Excellent Figure 4. Drop-Down Menu on IndonesiaX . Icon Menu on edX (Righ. For the chunking principle (DL . IndonesiaX has implemented it well. One of them is by using the drop-down concept (Figure . to make it easier for users to see a complicated thing simpler. The explicit sharing of menu information and material content makes it easy for users to explore this system. This principle is also well applied to Udemy. Coursera, and edX. In the forgiveness principle (DL . , the MOOC system generally has met. The MOOC system can minimize deficiencies or errors for its The principle relates to accessibility and legibility principles. With the ease and clarity of information in the system, usersAo mistakes can be minimized. Design and Multimedia Learning Principles on Mooc IndonesiaX The legibility principle (DL . is related to the clarity and legibility of the information. IndonesiaX LMS is fulfilling this principle. The smallest font size of 14 pixels is quite legible by users. The different font sizes and colors for titles and sub-headings also make it easier for users to understand the information and shown in Figure 5. The same is also well applied by Udemy. Coursera, and edX. On the performance load principle (DL . IndonesiaX has been well implemented. UsersAo ease of recalling a system and the short steps taken in executing can ease the userAos cognitive load and kinematic load. This principle is related to the chunking principle. Information is broken down into sections that can make it easier for users to reduce the performance load. However, for edX, this is not fulfilled because the navigation menu requires several steps to execute a section. Design principles with enhancing the usability of design consist of four parameters with an explanation chart that contains a description of the principles, codes, and parameters to facilitate evaluation in Table 4. Figure 5. Typeface of Different Sizes. Thicknesses, and Colors Table 4. The Principles of Enhancing the Usability of a Design Code DUS 1 DUS 2 DUS 3 DUS 4 Parameter 80/20 rule: The functional division of a system consisting of 80% and 20%, the 20% part of the system, significantly impacts the systemAos 80% part. Consistency: this principle is beneficial for a system that is easily recognized and understood by users or the target market. There are four types of consistency: Aesthetic: consistency in appearance and style . isual syste. Functional: consistency in the meaning and action of a function. Internal: consistency of one element with other elements in the External: consistency of one element with other elements in a system in the environment. Control: There is a control system that gives users the choice of usage based on their needs. Iconic representation: Consists of similar, example, symbolic, and Iconic representation helps make it easy for users to run a system that is presented in visual form Cakrawala Pendidikan. Vol. No. February 2021 The Rule Clear Clear Clear Clear doi:10. 21831/cp. The 80/20 rule explains that 80 percent of a system is caused by 20 percent of its In connection with this principle, observations on IndonesiaX LMS will see whether 20 percent of the systemAos variables affect 80 percent of the overall system. Overall, for IndonesiaXAos interface, this principle has been well implemented, shown in Table 5. Based on the 80/20 rule principle (DUS . IndonesiaX has implemented a 20% division of functions that significantly impact the other 80%. This condition can be seen in the application for navigation to learning materials that are a small part of the system but significantly impact the other 80%. Udemy. Coursera, and edX well implement this principle. The principle of consistency (DUS . in IndonesiaX is partially fulfilled. There are inconsistencies in aesthetics and function. Aesthetic inconsistencies can be seen in the mismatch between the layout interface and the learning video interface. The navigation menu on the IndonesiaX learning video is not consistent with the layout of the system. The learning video material seems to be an independent part of the system. Compared with Udemy, the learning video interfaceAos consistency is similar to harmony with the system layout. Even in color to show the video timeline have similar color with UdemyAos identity color . ee Figure The functional inconsistencies in IndonesiaX are seen in the drop-down arrow for the learning material menu on the left bar side. The use of the arrow only functions to open sub-menus, but not to close them again. EdX is also partly fulfilled by the consistency principle, while Udemy and Coursera have fulfilled the principle. The control principle (DUS . is a principle that gives users the freedom to control the system according to their needs. All MOOC providers have fulfilled this principle. are given other display alternatives to follow the material course. The iconic representation principle (DUS . on all MOOC providers is still partially fulfilled. The implementation of icons that use the similarity, examples, symbols, or free shapes concept has been used in some parts of the MOOC systemAos layout. However, there are still limitations for certain things. Some of the icons using forms that are not familiar to users have added some text explanation. There are two types of icons in this MOOC provider. A text description accompanies the first icon. The second icon, without any description, until the user hovers the cursor towards the icon, then appears . ee Figure . Table 5. Evaluation of Enhancing the Usability of a Design Parameter Assessment DUS 1 DUS 2 DUS 3 DUS 4 Parameter fulfilled Parameter value Grade IndonesiaX Good Udemy Good Values Coursera Good Note: 1 = parameter fulfilled. 5 = parameter partially fulfilled. 0 = not available Good Mean Good Figure 6. Interface Consistency on Udemy Design and Multimedia Learning Principles on Mooc IndonesiaX Figure 7. Icon representation on IndonesiaX. Udemy. Coursera dan edX (Source: indonesiax. id, , udemy. com, coursera. org, and edx. Multimedia Learning Principles The principle of multimedia learning is used to observe the content of learning materials on MOOC providers. The principle of reducing extraneous processing consists of five parameters with an explanation chart that contains a description of the principles, codes, and parameters to facilitate evaluation in Table In general, the IndonesiaX MOOC learning material observed has a good grade for the principle of reducing extraneous processing . ee Table . Table 6. The Principle of Reducing Extraneous Processing Code MLREP 1 Parameter Coherence principle: students learn better when extraneous material is excluded rather than included. MLREP 2 Signaling principle: students will learn better if the learning materialAos essential things are given a specific highlight. Redundancy principle: students will learn better from graphics and narration than graphics, narration, and printed text. Spatial contiguity principle: Students learn better when corresponding words and pictures are presented near rather than far from each other on the page or screen. Temporal contiguity principle: Students learn better when corresponding words and pictures are presented simultaneously rather than MLREP 3 MLREP 4 MLREP 5 The Rule Seeing the presence or absence of irrelevant material . ext, images. If there is an absence, it has fulfilled this principle Clear Clear Clear Clear Table 7. Evaluation of Reducing Extraneous Processing Parameter Assessment MLREP 1 MLREP 2 MLREP 3 MLREP 4 MLREP 5 Parameter fulfilled Parameter value Grade IndonesiaX Good Udemy Excellent Values Coursera Fair Good Mean Good Note: 1 = parameter fulfilled. 5 = parameter partially fulfilled. 0 = not available Cakrawala Pendidikan. Vol. No. February 2021 doi:10. 21831/cp. The coherence principle (MLREP . relating to text, image, and sound material that is not relevant to learning material is excluded from the material. This principle is related to the userAos cognitive load when viewing learning In IndonesiaXAos learning video, the background displayed full ornaments that gave users a extra cognitive load to focus on the teacher. The motion graphics that appear between the video parts have not been arranged for knowledge construction (Figure . Sound effects, text, and images that are not a significant part of constructing knowledge are often shown in learning videos. The same thing happened in the Coursera learning video, while the Udemy and edX learning videos were already concerned with this principle. The signaling principle (MLREP . has been fulfilled in the IndonesiaX learning video. Although they have not implemented good design principles such as the choice of font, size, color, shape, contrast, and composition, the essential parts are highlighted. Other MOOC providers have fulfilled this principle. Only Coursera partly fulfills the principles. In several Coursera learning videos, there is no difference in color in the text. The condition will be an essential part of the material explanation, so there is no highlighting of a particular concept. The redundancy principle (MLREP . relates to the addition of written text in learning material that has been done with voice narration. In the IndonesiaX learning video, a written script is raised by following what the instructor This situation might aim to make it easier for users to choose which parts of the material to study further. The same is true for additional scripts that can be displayed at the bottom of the learning video. Although both of these functions can be deactivated, it can add to the userAos cognitive load in focusing their attention on the teaching video if this is activated. Learning videos on Coursera. Udemy, and edX also have the same function as IndonesiaX learning videos. IndonesiaX and other MOOC providers have fulfilled the spatial contiguity principle (MLREP . and temporal contiguity principle (MLREP . Images and text in learning materials are generally displayed close together and displayed in simultaneous time. The principle of managing essential processing consists of three parameters with an explanation chart that contains a description of the principles, codes, and parameters to facilitate evaluation in Table 8. Figure 8. Higher Cognitive Load by Adding Irrelevant Material (Source: indonesiax. Table 8. The Principle of Managing Essential Processing Code MLMEP 1 MLMEP 2 MLMEP 3 Parameter Segmenting principle: students will learn better with material controlled by students, rather than linearly. Pre-training principle: students will learn better if they understand the name and characteristics of the main concept. Modality principle: students will learn better with pictures and spoken words compared to pictures and printed words. The Rule Clear Clear Clear Design and Multimedia Learning Principles on Mooc IndonesiaX This principle relates to the process of managing information and processing material that is important by users. In general. IndonesiaXAos learning material is a good grade. For the segmenting principle (MLMEP . , the IndonesiaX material and all MOOC providers have fulfilled the principle (Table . The user can control the course material, delaying the course, repeating, and moving material. The use of navigation for teaching materials and navigation in teaching videos make it easier for students to control the material lesson. The right way of signaling is done by segmenting information in the learning video. The pre-training principle (MLMEP . at IndonesiaX and all MOOC providers have fulfilled the principle. Management of learning material introduces the basic concepts of learning materials and understands the global concepts and links to sub-topics to be taught. This situation will make it easier for students to understand the names and characteristics of the main concepts. However, the modality principle (MLMEP . was only partially fulfilled by IndonesiaX. There are many learning video material in IndonesiaX that combines images with written text compared to images with spoken narration. The same thing is also found in Coursera and edX learning videos, while Udemy learning videos have fulfilled this principle by using pictures and spoken narration. The principle of fostering generative processing consists of four parameters with an explanation chart that contains a description of the principles, codes, and parameters to facilitate evaluation in Table 10. This principle is related to the principle that fostering generative processing. Cognitive processes require deep understanding related to student motivation. They are processing this generative load related to how students can organize and integrate material learning Overall. IndonesiaXAos learning video material scores good grades for this principle and is above the average value of all MOOCs observed (Table . Implementing multimedia principles (MLFGP . of IndonesiaX learning videos has fulfilled the principles in detail. This condition is also the same as other MOOC The material contained in the learning video is a combination of text and images and nothing that consists of only text elements. Table 9. Evaluation of Managing Essential Processing Parameter Assessment MLMEP 1 MLMEP 2 MLMEP 3 Parameter fulfilled Parameter value Grade IndonesiaX Good Udemy Excellent Values Coursera Good Note: 1 = parameter fulfilled, . 5 = parameter partially fulfilled, 0 = not available Good Mean Good Table 10. The Principle of Fostering Generative Processing Code Parameter MLFGP 1 Multimedia principle: students will learn better from material that contains a combination of text and images than text alone. MLFGP 2 Personalization principle: students will learn better when words are applied in a conversational style rather than formally. MLFGP 3 Voice principle: students will learn better with narratives given through human voices than machinesAo sounds. MLFGP 4 Image principle: students will not learn better with multimedia material when the narratorAos figure appears on the screen. Table 11. Evaluation of Fostering Generative Processing Parameter Assessment Values IndonesiaX Udemy Coursera MLFGP 1 MLFGP 2 MLFGP 3 MLFGP 4 Parameter fulfilled Parameter value Grade Good Good Fair Note: 1 = parameter fulfilled. 5 = parameter partially fulfilled. 0 = not available Cakrawala Pendidikan. Vol. No. February 2021 Fair The Rule Clear Clear Clear Clear Mean Fair doi:10. 21831/cp. For the personalization principle (MLFGP . IndonesiaXAos teachers use the informal language readily accepted by ordinary users. Bringing teachers in a relaxed way by wearing casual apparel can increase the personalization of learning videos. This situation contrasts with teachers at other MOOC providers who use more formal language and wearing formal apparel. For the voice principle (MLFGP . , all MOOC providers use human voices spoken directly by the instructor and nothing that uses voices processed from an audio software. For the image principle (MLFGP . , almost all MOOC providers, including IndonesiaX use narrators, and only Udemy appears without narrators at all. According to this principle, students will not learn better when the narratorAos figure appears on the screen. This principle might be investigated further because MOOC providers generally use the narrator figure in the video display. Based on the image principle suggested that the instructorAos appearance in multimedia material does not promote learning. This condition is because additional loads cover the potential benefits of social presence or personalization due to cognitive processing. Discussion This section will discuss the results that have been obtained by analyzing sections consisting of interface layouts, multimedia elements, design principles, and multimedia learning principles. Layout Interface Thorngate & Hoden . conducted research that showed that navigation on the left has a higher usability level than navigation at the Similar to navigation on IndonesiaX, the left side navigation layout model is also applied to Coursera. However, something different is found in edX, which implements top navigation and Udemy on the right. Research conducted by Bowen. Ellis & Chaparro . compared long navigation, which contains a lot of submenu content, and short navigation. Experiments have found that long navigation is more usable for the These findings can support navigation in online learning because learning materials can contain a lot of material topics. Users can more easily explore with a complete menu rather than displaying a portion of the menu as on the edX. Multimedia Elements Research conducted on edXAos learning videos found that short video duration will increase student engagement compared to longduration videos (Guo. Kim & Rubin, 2. right segmentation setting in video production can be done by setting the video duration to no more than six minutes. Further, the study mentioned that informal teaching styles that emphasize personal feelings enhance student engagement (Guo et al. , 2. Learning video on IndonesiaX is still of a sufficiently long duration compared to what is suggested by this However, the informal teaching style was conducted by following the recommendations of the study. Design Principles The segmentation applied to the IndonesiaX system makes it easy for users to see certain parts grouped separately. The use of the principle of chunking (DL . is in line with several studies on using the principle of The principle aims to reduce studentsAo cognitive load by dividing pieces of information into small units. Belcher . experimented on the implementation of chunking to paragraph settings in online learning content. Although there is no significant difference, this research considers other things that can affect the learning process, such as timing structure and active Morrison-Jones North researched to see the effects of typography in LMS. Four typographic elements are examined, namely the typeface, size, alignment, and The results of these four elements have a significant effect on knowledge sharing Arial or sans-serif typeface is the preferred typeface, and 12 points are the letterAos preferred size. Left and justified alignment is the preferred alignment. Sentence case emphasis is the preferred type of emphasis. IndonesiaX has implemented this legibility (DL . principle The consistency principle (DUS . is related to user comfort in seeing the system interface it faces. In IndonesiaX this is still partially fulfilled. The IndonesianX identity can be derived in the implementation of the The use of color and shape identities can be applied to certain parts of the interface Design and Multimedia Learning Principles on Mooc IndonesiaX and materials so that there is harmony between the visual elements in IndonesiaX. In general, the icon representation (DUS . is well implemented, although specific icons for unfamiliar users will be confusing. Using an icon that is immediately recognizable by the user will make it easier for the user to understand the information provided. Modified icons can delay the processing of information and increase the cognitive load. Icons should include text that describes the information or be provided when required by the user. Multimedia Learning Principles The coherence principle (MLREP . is about excluding the material that is not relevant to learning material. In IndonesiaX video material, there are sound effects, text, and images that are not a significant part of constructing knowledge, leading to a high cognitive load. However, there is a study that is counter to this principle. Adding approximately 50 percent of irrelevant information but interesting information on multimedia material did not give low test results. A possible explanation is that adding interesting information acts as a useful function and keeps studentsAo attention to authentic learning (Muller. Lee, & Sharma, 2. For this reason, further investigation is needed related to this principle. With in-depth experiments, it is hoped that this principle can be strengthened. According to the coherence principle, further research can also be investigated concerning the teaching roomAos Do students prefer the appearance of straight and black or white background so that the instructorAos appearance can be seen and without any other distraction? Alternatively, do students prefer the instructorAos appearance to be in a particular room, with the risk of having an extra element but providing a sense of comfort in learning? The redundancy principle (MLREP . relates to the addition of written text into voice narration. In IndonesiaX this principle is still partially fulfilled. However, there is research that conflicts with the redundancy The study was conducted by comparing the effects of learning videos with caption and without caption. This research is to find a relationship between motivation and Cakrawala Pendidikan. Vol. No. February 2021 student achievement. An impressive result was found that there were no differences in motivation and achievement in video with or without caption. Caption videos can be used as a motivational factor, an alternative to the linguistic element, increasing attention, and preventing misunderstanding (Culbertson. Shen. Andersen, & Jung, 2. Students will learn better with pictures and spoken words in the modality principle than pictures and printed words. This condition is related to the dual-channel assumption that receives images through the visual sense and hears information through the auditory According to this theory, adding text to an image will increase the cognitive load. Based on the modality principle (MLMEP . was only partially fulfilled by IndonesiaX. The situation is in line with research that examines the addition of images to support learning in a biology lesson in elementary The picture should be added to the spoken text compared to the written text, for school children viewing images while reading can increase cognitive capacity, especially from their visual channel. Pictures enhanced learning, but the text should be spoken rather than written (Herrlinger. Hyffler. Opfermann, & Leutner, 2. In the image principle (MLFGP . , students will not learn better with multimedia material when the narratorAos figure appears on the screen. However, almost all MOOC providers, including IndonesiaX use narrators. However, there is research that conflicts with the image principle. A study conducted a comparison between learning videos that use and without the instructorAos facial appearance (Kizilcec. Bailenson, & Gomez, 2. Students who saw the instructorAos face had a better learning experience than students who did not. contrast, students who prefer learning without the instructorAos facial appearance argue to avoid distraction because there is a possibility that students dislike the instructorAos appearance. Based on the results of the study, a learning material is made that combines the two The result is that material with variations of these combinations is strategically better than constant display conditions. also, the learning outcome results not change. doi:10. 21831/cp. According to this research. IndonesiaXAos video lesson has used a combination of narrator display and learning material. Further research can be done by observing which part is more dominant in the video lessonAos duration, whether the narratorAos appearance or learning material. Another thing that can be considered further research is determining when to present the narrator and display learning material. CONCLUSION In general, the implementation of design principles in IndonesiaX materials received a good grade. Although there are still lacking in details . onsistency, iconic representation, coherence, redundancy, modality, and image principle. , overall have good grades. Further research can be carried out to analyze the components that are still lacking. IndonesiaX is relatively new to the MOOC platform in Indonesia, so it can still be developed further. is hoped that learning materials in IndonesiaX can be directed to increase student engagement in online learning by paying attention to visual aspect, specifically the design and multimedia learning principles. The weakness of this research is to observe one learning material by comparing other MOOC materials. The reason for using another MOOC is to compare to the well-established MOOCs. For further research, observation of several learning materials in the same MOOC can be alternative research. Comparisons can be made using different types of learning materials. By multiplying, cases can enrich similar However, this researchAos suggestions and recommendations are expected to reduce the deficiencies that exist in general. As a support for the AuKampus MerdekaAy program, the role of Indonesian MOOC is crucial. Improvement and further development are expected to improve the quality of online learning. REFERENCES