Vol. No. September 2018 JURNAL ILMIAH PEURADEUN The Indonesian Journal of the Social Sciences p-ISSN: 2338-8617/ e-ISSN: 2443-2067 Vol. No. September 2018 Pages: 397-408 Project-Based Learning Evaluation from StudentsAo and SupervisorsAo Perspectives: A Qualitative Research at Polytechnic Malaysia Ramlee Mustapha1. Ichsan M. Nasir2. Sadrina3 1,2,3Technical and Vocational Education Faculty. Universiti Pendidikan Sultan Idris. Malaysia Article in Jurnal Ilmiah Peuradeun Available at : http://journal. org/index. php/jipeuradeun/article/view/238 DOI : http://dx. org/10. 26811/peuradeun. Jurnal Ilmiah Peuradeun (JIP), the Indonesian Journal of the Social Sciences, is a leading peer-reviewed and openaccess journal, which publishes scholarly works, and specializes in the Social Sciences that emphasize contemporary Asian issues with interdisciplinary and multidisciplinary approaches. JIP is published by SCAD Independent and published 3 times of year (January. May, and Septembe. with p-ISSN: 2338-8617 and e-ISSN: Jurnal Ilmiah Peuradeun has become a CrossRef Member. Therefore, all articles published will have a unique DOI number. JIP has been accredited by the Ministry of Research Technology and Higher Education Republic of Indonesia (SK Dirjen PRP RistekDikti No. 48a/KPT/2. This accreditation is valid from October 30, 2017 until October 30, 2022. JIP published by SCAD Independent. All articles published in this journal are protected by copyright, licensed under a CC-BY-SA or an equivalent license as the optimal license for the publication, distribution, use, and reuse of scholarly works. Any views expressed in this publication are the views of the authors and not of the Editorial Board of JIP or SCAD Independent. JIP or SCAD Independent cannot be held responsible for views, opinions and written statements of authors or researchers published in this journal. The publisher shall not be liable for any loss, actions, claims, proceedings, demand, or costs or damages whatsoever or howsoever caused arising directly or indirectly in connection with or arising out of the use of the research material. Authors alone are responsible for the contents of their articles. JIP indexed/included in Web of Science. MAS. Index Copernicus International. Sinta. Garuda. Moraref. Scilit. Sherpa/Romeo. Google Scholar. OAJI. PKP. Index. Crossref. BASE. ROAD. GIF. Advanced Science Index. JournalTOCs. ISI. SIS. ESJI. SSRN. ResearchGate. Mendeley and others. Jurnal Ilmiah Peuradeun | Copyright A 2018 SCAD Independent. All Rights Reserved Jurnal Ilmiah Peuradeun The Indonesian Journal of the Social Sciences doi: 10. 26811/peuradeun. Copyright A 2018 SCAD Independent All Rights Reserved Printed in Indonesia Jurnal Ilmiah Peuradeun Vol. No. September 2018 Pages: 397-408 PROJECT-BASED LEARNING EVALUATION FROM STUDENTSAo AND SUPERVISORSAo PERSPECTIVES: A QUALITATIVE RESEARCH AT POLYTECHNIC MALAYSIA Ramlee Mustapha1. Ichsan M. Nasir2. Sadrina3 1,2,3Technical and Vocational Education Faculty. Universiti Pendidikan Sultan Idris. Malaysia 1Contibutor Email: dr. ramlee@fptv. Received: Feb 8, 2018 Accepted: May 22, 2018 Published: Sept 28, 2018 Article Url: http://journal. org/index. php/jipeuradeun/article/view/238 Abstract The purpose of this case study was to evaluate the Project-Based Learning that was implemented at the Mechanical Engineering Department in a polytechnic in Malaysia. One kind of constructivism. Project-Based Learning was introduced into the Malaysian polytechnics curriculum regarding to result creative and innovative human resources. This study involved a random sample of 118 students and 43 supervisors in the Mechanical Engineering Department. The study found that both the students and supervisors agreed that Project-Based Learning approach is appropriate for the final project course J5012. In addition, both groups of respondents believed that the supervisors possesed adequate technical knowledge and implemented supervisory duties effectively. Nevertheless, students perceived the module content was hard to understand. The students barely agreed that the machines and equipments at the polytechnic were appropriate for the project. Positively. Polytechnic Kota Bharu should introduce a formal course of Project-Based Learning to the polytechnic system in Malaysia. Keywords: Project-Based Learning. Polytechnic. Malaysian Education. p-ISSN: 2338-8617 e-ISSN: 2443-2067 JIP-The Indonesian Journal of the Social Sciences . p-ISSN: 2338-8617 Vol. No. September 2018 e-ISSN: 2443-2067 Introduction Education is an important catalyst in developing talented, relevant, skillful and innovative human resources. Education continues to play a vital role in developing and transforming Malaysia for the next decade. Higher education sector is at the forefront in driving the nationAs progress and development. This sector plays a key role in shifting MalaysiaAs to become a high income economy by 2020. Technical and Vocational Education (TVE) is one of the various disciplines of education that can generate economic growth of a country (Ramlee & Abu, 2. TVE was considered to provide opportunities for students who have the tendency toward vocational fields and technology to fulfill the technical It is perceived as one of the crucial elements in enhancing economics of productivity (Min, 1995. Ramlee & Greenan, 2. polytechnics have expanded to become MalaysiaAs largest public tertiary TVE provider in this country. Project-Based Learning was introduced in the Malaysian polytechnics curriculum in order to produce creative and innovative graduates (Safrina & Saminan, 2. It is believed that students with Project-Based Learning are energetically involved in scaffolding, and proposing creative solutions (Chambers et al. , 2. Principally. Project-Based Learning is about solving real-world Based on Schneider . and Grant . Project-Based Learning is an instructional method that emphasizes student-centered learning by assigning project. Regarding to socio-constructivism view. Project-Based Learning efforts the students on social interaction and group collaboration (Moursund, 2. In addition. Project-Based Learning is a systematic teaching approach that engages students in learning, real-world problem and life-enhancing skills through creative, scientific, authentic, challenging process and ensuing a product. ProjectBased Learning is a dynamic model that focuses on teaching by engaging students in higher order thinking. It is also a tangible model that requires . JIP-The Indonesian Journal of the Social Sciences Project-Based Learning Evaluation from StudentsAo and SupervisorsAo Perspectives Ramlee Mustapha et al. real-world task, collaborative investigation, and the production of an artifact or a product (Blumenfeld et al. , 1. However, students perceive that by engaging in a project, they will have some advantages such as, free choice in deciding what they will work on, plan their own project, participate in defining criteria to assess their project, solve problems, and able to present their project (Andreas and Rogers, 2. Thus, students may have difficulty in Project Based Learning, such as, difficulty to define a research project, to find resources, to manage time, to collaborate with others and to revise the project (Schneider, 2. The role of the supervisors is to monitor the progress of the project. The supervisor should also facilitate the transfer of learning and to support the students who meet problems while doing the project. In the traditional paradigm, teachers act as a source of knowledge. However, this kind traditional method, teachers still preferred to teach the exam-oriented system. Thus, it is different from Project-Based Learning, where teachers act as a facilitator of learning. Project-Based Learning is an approach that transforms teaching from Auteachers tellingAy to Austudents doingAy (El Kamoun et al. , 2. In other words. Project-Based Learning offer a different approach with assesing the real world problem, causing a solution and resulting a product. Thus. Project-Based Learning is more encompassing than Problem-Based Learning (Moursund, 2. Method This study was a kind of descriptive study intended to observe the studentsA and supervisorsA opinion concerning about the Project-Based Learning at Polytechnic in Malaysia. According to Gall. Borg, and Gall . , descriptive research contains providing careful descriptions of a Specifically, this study employed a case study method that concentrated to one polytechnic and to evaluate the effectiveness of AuProject-Based LearningAy method. The instrument used in this study consisted of a set of interview protocol with four questions. The qualitative data were analyzed by emerging each themes. JIP-The Indonesian Journal of the Social Sciences . p-ISSN: 2338-8617 Vol. No. September 2018 e-ISSN: 2443-2067 There were two populations, the first population was final-project course (J5. supervisors in the Mechanical Engineering Department in the selected polytechnic. The second population was final-year students who grabbed the final-project course (J5. The sample consisted of 118 students and 43 supervisors were perceived based on the Krejcie and Morgan Samplesize Table . The interview protocol in this study was based on the research framework in terms to accumulate qualitative data from the students and the supervisors. The questions posed in this study were structured and semi-structured ones. Structured questions were usually posed to clarify some information provided by the respondents. The interview was conducted within 30 minutes and recorded using tape recorder to facilitate the transcription and analysis. For the interview, five students . hree females and two male student. and five lecturers were involved for interview. They were selected based on their supervisorsA Several drafts of the instrument were reviewed by a panel of experts . ne professor in technical and vocational education, one doctor in engineering education and one doctor in Polytechnic Institutio. Research Finding In the process collecting data, interview questioning forms were posed to the students and the supervisors who participated in this research. Transcripts of the interview were analyzed qualitatively to identify the emerging themes. The coding system used in this study was as follows: L is used for student and S for supervisor. In terms of gender. M for male and F for female. In addition, in terms of categories of programs. A was used to represent the Diploma of Mechanical Engineering (Automotiv. P was used to represent the Diploma of Mechanical Engineering (Agricultur. , and M is used to represent the Diploma of Mechanical Engineering. Four questions in the interview protocol were formulated to assess the implementation of the Project-Based Learning and to support the quantitative findings. The research themes were separated into four . JIP-The Indonesian Journal of the Social Sciences Project-Based Learning Evaluation from StudentsAo and SupervisorsAo Perspectives Ramlee Mustapha et al. categories: the knowledge of Project-Based Learning, supervision process, project module, and facilities. Knowledge of Project-Based Learning The first question was constructed to determine the studentsA and supervisorsA perceptions of Project-Based Learning. From the interview data with the students, there were diverse understandings of Project-Based Learning. One student perceived Project-Based Learning as a theory while another student equated Project-Based Learning with e-SOLMS. In fact, there was one student who said that he never heard about Project-Based Learning. A student (LMP. stated that he knew about Project-Based Learning as a theory. AuYes. I understand. Because [Project-Based Learnin. is a kind of theory, then I know what I should do. Ay (LMP. Another student (LFM. perceived that Project-Based learning as eSOLMS. E-SOLMS was a kind of media . that used along in ProjectBased Learning process. Au[Project-Based Learnin. was the using of e-SOLMS website. If we have problems then we use e-SOLMS, our supervisors reply via e-SOLMS every Ay (LFM. However, there was one student (LFP. who did not know anything about Project-Based Learning. She was uncertain about Project-Based Learning. AuI never heard about [Project-Based Learnin. Ay (LFP. The same interview question was asked to the supervisors. Majority of them knew about Project-Based Learning. Similar to the student, a supervisor (SFM. believed that Project-Based Learning based on theory. AuProject-Based Learning. t i. based on theory. Ay (SFM. Another supervisor (SMM. believed that Project-Based Learning was appropriate to be implemented because it has facilitated the students in the project. JIP-The Indonesian Journal of the Social Sciences . p-ISSN: 2338-8617 Vol. No. September 2018 e-ISSN: 2443-2067 Au[Project-Based Learnin. is an applicable method for the students to understand what they should do. Ay (SMM. However, another supervisor (SMM. thought that Project-Based Learning should be implemented to enable the supervisors to evaluate studentsA competencies in every semester. AuProject-Based Learning should be employed to facilitate the supervisors to evaluate project each semesterAy. (SMM. Supervision Process In terms of supervision, the interview data indicated mixed responses regarding the effectiveness of the supervisors. A students seemed their supervisor has supervising and technical skills. AuThat our supervisor has supervising skills. Ay (LMP. Student (LFM. said that her supervisor possessed both technical and supervising skills. AuYes, he has . upervising skil. , because he has revealed us how to create the circuit, compute the circuit, and how to install the circuit. Ay (LFM. When the same questions were asked the supervisors, they stated that they possessed the supervising skills. Supervisor (SMM. said that he has no problem in supervising the students. In addition, he believed that supervisors with education background were better supervisors than those with only technical content. AuSupervising skill. I have no problem with it because we were education But nowadays, many lecturers were technical engineering Thus, they . ew lecturer. had poor supervising skills. (SMM. Another supervisor (SMM. stated that in terms of supervising skills, he expected his students to come and meet him frequently. would used e-SOLMS to monitor the studentsA progress. JIP-The Indonesian Journal of the Social Sciences Project-Based Learning Evaluation from StudentsAo and SupervisorsAo Perspectives Ramlee Mustapha et al. AuAbout that skills . upervising skill. were expected their students to come and meet them as often as possible. If the students did not come to discuss. I would monitor my students by using eSOLMS. Au(SMM. However, there was one supervisor (SFP. who claimed that her studentsA project did not match with her expertise. Thus, the condition has caused difficulty for her to supervise the students in the project. AuSometimes the project that I supervised was not appropriate with my So that project was out of my knowledge. Ay(SFP. Project Module Concerning about the project management module, there was a varied perceptions of the students about the module. A student (LMM. believed that the project module was effective. AuIt . he project modul. was effectiveAy (LMM. Nevertheless, another student (LFM. said that some of her project activities did not follow the module. Au. sometimes my . activity based on module, but sometimes it did Ay (LFM. In addition, the supervisors were asked about their view of project management module, one supervisor (SMM. believed that the project module has facilitated the students to focus on what to do in the project. AuIt . roject modul. means that it helped the students to focus on what to do in the project. help their project progress. Ay (SMM. In addition, there was one supervisor (SFP. who perceived that they could monitor students Aproject with e-SOLMS. If she could not see the students, she would use e-SOLMS to discuss with her students. AuProject was monitored by e-SOLMS. It was good . or superviso. to monitor the studentAos work . and also if I could not meet my students . ace to fac. , then weAoll meet on e-SOLMS . ia onlin. Ay (SFP. JIP-The Indonesian Journal of the Social Sciences . p-ISSN: 2338-8617 Vol. No. September 2018 e-ISSN: 2443-2067 Infrastructure and Facilities Facility, with its adequate and proper tools, and materials are critical in ensufing the students to produce a good invention. Generally, the students perceived main facilities at the polytechnic factory were However, some specific materials and tools were not enough. Hence, the students had to buy the material for the project in Kuala Lumpur or Penang as stated by a student (LFM. AuIn general, facilities in the polytechnic were sufficient, but some instruments were not enough, because of that, we had to buy the instruments outside polytechnic. Ay (LFM. Then, a student (LFM. thought that the facilities in the polytechnic were enough. Au. so far, the facilities were sufficient. Ay (LFP. Similar with some supervisors, that said the facility, material, machines were sufficient in the polytechnic. A supervisor (SMM. claimed that the polytechnic has provided appropriate facility, materials and machines for the project. AuMain facilities in the polytechnic were adequate for the students, but some specific instruments were not there in the polytechnic, so they . have to go to KL or Penang . o buy that instrument. (SMM. However, another supervisor (SMM. identified such as main machines for the studentsA project were adequate but the students did not use them. Au[The main facilitie. were provided, but the students did not use them because the machines were broken or they were not trained to use Ay(SMM. Formerly, supervisor (SFM. agreed that the polytechnic has sufficient material and tools for the studentsA project. However, because of the limited room-space, some students have to run the project external of . JIP-The Indonesian Journal of the Social Sciences Project-Based Learning Evaluation from StudentsAo and SupervisorsAo Perspectives Ramlee Mustapha et al. AuDue to limited space . or doing projec. some students conducted the project outside the polytechnic. Ay (SFM. Discussion In terms of the epistemology of Project-Based Learning, almost all of the students perceived that they knew about Project-Based Learning. From the interview data, however, there were mixed perspectives of Project-Based Learning. Some students believed Project-Based Learning as a theory and others perceived Project-Based Learning as e-SOLMS. Those who believed Project-Based Learning as e-SOLMS considered ProjectBased Learning as a problem solving using e-SOLMS. Andreas and Rogers . asserted that people when engaging in a project may have different perspectives regarding the project and they might have free choice in deciding what they will work on, plan their own project, select people on their team and solve the problem their own way. The supervisors, on the other hand, believed Project-Based Learning as a theory. They also assumed that Project-Based Learning is an appropriate approach for the studentsAo final project. However, there were some students and few supervisors who had no clue what Project-Based Learning was all about. Therefore, the Project-Based Learning coordinator should organize briefing session with students and supervisors before the Final Project Course commenced. Regarding e-SOLMS, most supervisors were comfortable with e-SOLMS in monitoring the studentsAo projects. McAlpine. Reidsema and Allen . asserted that online medium may facilitate Project-Based Learning implementation. In terms of PolytechnicAo facilities, some students claimed that some materials for the project were not provided. So, they had to buy some materials themselves. Nevertheless, in general, the respondents stated that the polytechnic has provided the necessary materials, tools and machines needed for the project. Blumenfelt et al. asserted that a project could take a sizable amount of time and a number of materials to be JIP-The Indonesian Journal of the Social Sciences . p-ISSN: 2338-8617 Vol. No. September 2018 e-ISSN: 2443-2067 Conclusion Several conclusions could be derived based on the empirical findings of the study. In terms of knowledge, most students believed that they have knowledge about Project-Based Learning but few could not differentiate between Project-Based Learning and e-SOLMS. Meanwhile, the supervisors claimed that they have knowledge on both Project-Based Learning and e-SOLMS. Students stated that the project module has facilitated their activities in the project, although some students still faced difficulty in understanding the content of the project module. Thus, the project module needs to be reevaluated. In terms of supervising skills, some supervisors believed their supervising skills are still poor. Therefore, a proper training to enhance their supervising skills is deemed necessary. The supervisors claimed that they used e-SOLMS to monitor their studentsAo project activities. The study also found that most supervisors were not formally trained to handle Project-Based Learning. Some have never experienced handling project, planning, management and supervisory tasks. So, it can conclude that the polytechnic staff and students should be formally trained in Problem-Based Learning and eSOLMS. Hopefully. Polytechnic Kota Bharu should introduce a formal course of Project-Based Learning to the polytechnic system in Malaysia. Bibliography