IDARAH (Jurnal Pendidikan dan Kependidika.
Vol.
7 No.
pISSN: 2549-8193 eISSN: 2656-8012 Transforming Online Learning Management: Generative Models on ChatGPT to Enhance Online Student Engagement Scale (OLE) Ahmad Al Yakin,1* Muthmainnah,1 Eka Apriani,2 Ahmed J.
Obaid,3 Ahmed A.
Elngar,4 Universitas Al Asyariah Mandar.
Polewali.
Sulawesi Barat.
Indonesia 2 Institut Agama Islam Negeri Curup Bengkulu.
Indonesia 3 University of Kufa.
Iraq, 4 Beni-Suef University.
Beni-Suef City.
Egypt Abstract History Received 20 May 2023 Revised 28 November 2023 Accepted 02 December 2023 Keywords ChatGPT.
Online Learning.
Student Engagement Scale.
Teaching Sociology.
Artificial Intelligence (AI) technology in education is rising, with ChatGPT, an advanced AI chatbot developed by OpenAI, gaining popularity.
This study focuses on exploring the potential of ChatGPT in enhancing academic learning in sociology and politics.
Using a quantitative research approach, the study examines student engagement with ChatGPT in an educational setting.
The research was conducted with 23 fourth-semester undergraduate students in early 2023.
The findings indicate that ChatGPT generates enthusiasm and high levels of student engagement, facilitating activities such as idea exchange, discussions, analysis, and motivation.
However, the integration of ChatGPT in education requires well-defined strategies and pedagogical approaches that prioritize critical thinking skills and access to fact-checking resources.
The study suggests future research directions to ensure the responsible use of chatbots like ChatGPT in academic environments.
Although challenges exist, such as potential bias, the need for human oversight, and risks of misuse, effective management can overcome these obstacles.
Leveraging AI in education offers opportunities for students to develop an early understanding of social biases, critical elements, and risks associated with AI The study concludes with recommendations for addressing these challenges and promoting the ethical use of ChatGPT in Corresponding Author: A Ahmad Al Yakin |A ahmadalyakin@unasman.
: https://doi.
org/10.
47766/idarah.
Copyright .
2023 Idarah (Jurnal Pendidikan dan Kependidika.
Idarah (Jurnal Pendidikan dan Kependidika.
Vol.
7 No.
INTRODUCTION
New technologies emerge, often challenging established norms and prompting individuals to reassess their priorities and adjust (Felzensztein & Tretiakov, 2.
Academics have previously deliberated on Google's potential impact on schools, debating whether search engines make individuals smarter or shallower (Bozkurt et , 2023.
Leon & Vidhani, 2.
and questioning the necessity of teachers.
Massive Open Online Courses (MOOC.
garnered attention in the early 2010s (Cheng, 2.
, but their performance fell short of expectations, leading to shifts in focus and business models (Cheng, 2022.
Fui-Hoon Nah et al.
, 2.
Even a robust tool like ChatGPT is not immune to criticism.
This research explores the advantages and disadvantages of using ChatGPT for online student engagement in the classroom (Gill et al.
, 2024.
Yuzar et al.
, 2.
Various educational institutions and organizations are increasingly exploring the potential benefits of AI-based technology for learning (Firat, 2023.
Kooli, 2.
, driven in part by widespread media coverage of AI applications in education.
ChatGPT, developed by OpenAI as an advanced natural language processing (NLP) model in 2019, exemplifies this technology (Lund et al.
, 2.
Functioning as a generative AI.
ChatGPT uses an algorithm to produce text that simulates human writing, interpreting natural language requests and generating human-sounding responses (Whittlestone et al.
, 2.
Designed for one-on-one conversations.
ChatGPT serves as a powerful tool for activities such as answering queries, creating narratives, summarizing content, and even composing essays.
OpenAI launched GPT4, a more advanced version of ChatGPT, on March 14, 2023.
The usage of ChatGPT extends across various domains, including writing (Dergaa et al.
, 2.
, libraries (Lund & Wang, 2.
, and classrooms (Malinka et al.
In educational settings.
ChatGPT proves valuable by serving as a virtual tutor, managing student inquiries, and crafting individual lesson plans (Baidoo-Anu & Owusu Ansah, 2.
As a practical AI tool, it facilitates the acquisition of "AI literacy" for educators and students, encompassing knowledge and skills necessary for comprehending, utilizing, and assessing the social and ethical implications of AI technology (Hagerty & Rubinov, 2.
This includes understanding AI principles, methodologies, algorithms and the ability to analyze and evaluate AI systems and their applications (Purificato et al.
, 2.
An essential component of AI literacy is an awareness of AI's ethical, legal, and social consequences, coupled with effective communication about AI issues and ideas (Hagerty & Rubinov, 2.
ChatGPT, being a user-friendly AI application, can serve as a teaching tool, aiding instructors and students in better understanding and adapting to the evolving field of AI (Atlas, 2.
Copyright A IDARAH (Jurnal Pendidikan dan Kependidika.
Ahmad Al Yakin.
Muthmainnah.
Eka Apriani.
Ahmed J.
Obaid.
Ahmed A.
Elngar Transforming Online Learning Management: Generative Models on ChatGPT to Enhance Online Student Engagement Scale (OLE) Today's technology has transitioned from a benign pastime to a transformative Its success hinges on various factors and is impervious to bans or denials.
Understanding the potential benefits, drawbacks, and limitations of technology reliant on large language models like ChatGPT is crucial.
Moreover, comprehending the impact of ChatGPT and related technologies on specific areas, such as education, is essential for their practical application in the classroom.
Educators and stakeholders can then assess the advantages and disadvantages, weighing the decision to incorporate such technology and developing a strategic plan (Dwivedi et al.
, 2.
Upon gaining knowledge about what ChatGPT is capable of, individuals can make informed decisions regarding its usage, considering both advantages and However, adapting to ChatGPT may necessitate changing ingrained habits, posing a challenge due to natural reluctance to change.
Over time, skepticism and disapproval tend to diminish as technology becomes integral to daily life, particularly for versatile tools penetrating diverse fields.
Research by Alkaissi and McFarlane suggests that resistance and extreme reactions are unlikely to impede technology from reaching the pinnacle of productivity (Alkaissi & McFarlane, 2.
In the rapidly expanding field of computer science, artificial intelligence (AI) seeks to develop intelligent robots with human-like cognition and behavior.
AI finds applications across diverse sectors, including healthcare, transportation, education, and training.
AI can also be seamlessly integrated with the Internet of Things (IoT) to create a synergistic technology called AIoT.
Among the most promising AI technologies is ChatGPT, a natural language processing (NLP) system adept at mimicking human-like conversation.
ChatGPT holds significant potential to enhance classroom teaching, problemsolving, and learning.
For instance, technology can assist educators in tailoring lessons to each student, making them more specific and engaging (Kasneci et al.
, 2.
This individualized approach can potentially boost student interest, motivation, and performance in class.
Additionally, the ChatGPT model proves helpful in evaluating and measuring the effectiveness of educational programs, providing teachers with a valuable tool for efficiently assessing and commenting on student work.
Applying powerful artificial intelligence technology like ChatGPT facilitates a quick and easy understanding of complex math topics for students.
This technology allows users to pose questions about political sociology in natural language and receive instant answers.
ChatGPT requires no prior knowledge or training in mathematics, yet it aids in comprehending complex critical thinking and problemsolving concepts.
Users can engage in conversations with AI to seek assistance with political sociology phenomena and intricate political history.
Furthermore, helpful hints and tips are available whenever users encounter difficulties.
While ChatGPT boasts impressive features, it is not without limitations.
The language model may Idarah (Jurnal Pendidikan dan Kependidika.
Vol.
7 No.
sometimes produce irrelevant, inaccurate, or biased answers and struggle with understanding the nuances or context of specific issues.
It is essential to recognize that ChatGPT is a tool, not a substitute for real teachers and educators (Wardat et al.
, 2.
In conclusion, while ChatGPT has the potential to enhance the educational experience for teachers and students, it is crucial to use it in conjunction with human instructors who provide guidance, direction, and monitoring in the classroom.
Understanding the limitations of ChatGPT and using it ethically and responsibly are critical considerations for educators leveraging it to create individualized content, evaluate student learning, and provide feedback.
In online engagement, students must interact with course materials, peers, and the teacher for effective learning, reflecting a fundamental principle of social According to research by Zhai .
, successful course design and high levels of learning and satisfaction are associated with three factors: dynamic discussion .
nteraction with classmate.
, a transparent interface for easy navigation, and frequent, quality interaction with instructors.
Hong supports that excellent practice entails interaction between teachers and students, peer learning, and active Similarly, scholars like Dwivedi.
Kshetri.
Hughes.
Slade.
Jeyaraj.
Kar.
Baabdullah.
Koohang, .
underscore the importance of student participation in online learning for positive learning outcomes.
Offering students opportunities to connect with the instructor, peers, and course content can mitigate a common problem in online coursesAistudents' feelings of However, there is still limited research examining the potential of ChatGPT to increase student engagement in the classroom.
The conceptual paper aims to illustrate the potential benefits of using ChatGPT to enhance student engagement in METHOD This study employs quantitative methods to describe, summarize, or explain data collected from materials such as questionnaires.
The research is conducted at Al Asyariah Mandar University, where ChatGPT-based learning is utilized as online learning material in political sociology courses.
The study was carried out from February to April 2023 with students in the fourth semester of the Faculty of Teacher Training and Education, specifically in the Pancasila and Citizenship Education study The survey form describes the respondents, with attitudes toward ChatGPT-based online education being the initial focus.
Subsequently, the research explores the impact of ChatGPT-based treatment on students' abilities to function in the modern world.
The sampling strategy employed is "purposeful sampling," a consciously chosen non-probability method that considers the researcher's opinion on Copyright A IDARAH (Jurnal Pendidikan dan Kependidika.
Ahmad Al Yakin.
Muthmainnah.
Eka Apriani.
Ahmed J.
Obaid.
Ahmed A.
Elngar Transforming Online Learning Management: Generative Models on ChatGPT to Enhance Online Student Engagement Scale (OLE) which sample is most likely to achieve the research objectives, as outlined by Kumar .
Therefore, the study focused on students enrolled in the Pancasila and Citizenship Education Study Program.
Questionnaires are usually used to collect information in the field of education.
It is usually used to find out about other people's hobbies, values, and characteristics that cannot be seen at a glance (Gall et al.
, 1.
Students who previously took political sociology classes through the online learning platform ChatGPT were given a survey.
Survey findings are expressed as a percentage and visualized using a graph.
At the start of the 2022-2023 academic year sufficient time was allocated to retrospect the previous semester's deployment of online learning.
There were a total of 23 people .
boys and 15 girl.
in this study.
In this investigation, we adapted the questionnaire box to include questions about students' experiences with ChatGPT.
Sixty items were included in the survey, ten comments each for positive statements on ChatGPT.
Students were asked to fill out a questionnaire using a Likert Scale so that the data collected could be analysed to show how they felt about ChatGPT while learning was being carried out.
Questions and grids are placed in Table 1.
Table 1.
Engagement Score in learning through ChatGPT Positive Engagement Very good Good Fairly Low Very low (Cohen et al.
, 2.
Score The questionnaire has 16 positive statements.
As a result, 120 is the maximum possible score and 30 is the minimum score.
Interval scores are calculated using the following table for each ChatGPT scoring category:
Table 2.
Students Classification score for ChatGPT questionnaire Classification Very good Good Fairly Low Very low Score Furthermore, to analyze the research data using quantitative and qualitative analysis using statistical analysis SPSS 26 for window.
Idarah (Jurnal Pendidikan dan Kependidika.
Vol.
7 No.
RESULT AND DISCUSSION
ChatGPT can comprehend students' unique learning styles, enabling a personalized learning experience tailored to their needs.
It can effectively structure course materials by analyzing students' academic performance to meet their specific This personalized approach allows students to learn comfortably, ensuring a comprehensive understanding of even the most intricate and complex With the assistance of ChatGPT, students can delve deep into the subject matter, clarifying any doubts or uncertainties along the way.
The ability to provide such personalized and adaptive learning experiences sets ChatGPT apart, fostering a more effective and engaging educational journey for students.
After students receive treatment and complete the survey, the lecturer analyzes the data.
Both observational learning and application learning behavior involve discussing political history with ChatGPT, analyzing political phenomena in Indonesia and the world, and examining people's behavior towards politics and money politics.
Assignments submitted are recorded during the course.
As mentioned earlier, there is a distinction between students who only attend classes and those actively involved in learning by logging into online platforms or clicking links.
This analysis distinguishes between observing and learning through applications.
However, this data analysis solely focuses on the level of involvement and does not investigate its impact on students' learning ability.
It would be easy for students to click and open ChatGPT, notice its content, and then take a quiz where they have to guess the answer.
Although a rough estimate, the total number of behaviors helps test whether their engagement scale is positive with ChatGPT.
Thus, the data analysis distinguishes between passive engagement of receiving information and engagement of being actively involved with the material using ChatGPT, alone or in collaboration with other students and teachers.
Separate totals were prepared for observational learning behaviors and application learning activities.
Copyright A IDARAH (Jurnal Pendidikan dan Kependidika.
Ahmad Al Yakin.
Muthmainnah.
Eka Apriani.
Ahmed J.
Obaid.
Ahmed A.
Elngar Transforming Online Learning Management: Generative Models on ChatGPT to Enhance Online Student Engagement Scale (OLE) Totally agree Partially agree Fairly Partially disagree Totally disagree Figure 1.
Students engaged in learning activities through ChatGPT Figure 1, the first statement, reflects the survey results, indicating that 60.
percent of respondents agree that ChatGPT is a priority to them, with an additional 13 percent of respondents falling into this category.
Despite this, 47.
82% of respondents guarantee paying attention to the teacher, and 39.
13% partially agree.
Doing activities in the class with ChatGPT is considered helpful by 78.
26%, with 73% of respondents in the "totally agree" category.
In the fourth statement, participating in discussion activities to increase students' critical thinking had 73.
in agreement and 26.
08% partially agreed, with no one choosing the shallow category.
The following statement inquired about how ChatGPT helps with all exercises, with 6% of respondents agreeing with this assertion, while 17.
39 percent partially Finally, most respondents expressed confidence in their ability to learn using ChatGPT.
In the last statement, which asked about studying only to pass exams, the majority partially disagreed or disagreed with this statement.
Idarah (Jurnal Pendidikan dan Kependidika.
Vol.
7 No.
ChatGpT is ChatGPT ChatGPT is ChatGPT I do my best Attending Doing home ChatGPT interesting motivate me easily to use to share my Social Politic work with help me to to read the Course is ChatGPT important to Very good Good Fairly Low Very low Figure 2.
StudentsAo perception on ChatGPT These results shed light on the extent to which participants engage with ChatGPT technology.
Of the respondents, 65.
21% chose "very good," while 34.
partially believe that ChatGPT is an exciting tool for learning and motivating to read materials .
13% agree with this statement, and 30.
43% partially agre.
This indicates a high level of competence in using technology because 78.
26% of respondents chose the "outstanding" category, and 21.
73% took the "excellent" position for ChatGPT's fast response.
However, overall, respondents provided positive statements.
Only 4.
34% of respondents were classified as deficient, and 8.
fell into a low category regarding their technical problem-solving skills, showing ambivalence about sharing ideas.
Regarding the ability to obtain information with ChatGPT, 60.
89% of respondents rated it excellent, while 39.
13% considered it good.
This finding aligns with the statements of the surveys.
The good news is that none of these responses can be considered harmful, indicating support for ChatGPT as a learning tool to engage participants in the online class.
Figure 3.
Students engaged in learning through ChatGPT Copyright A IDARAH (Jurnal Pendidikan dan Kependidika.
Ahmad Al Yakin.
Muthmainnah.
Eka Apriani.
Ahmed J.
Obaid.
Ahmed A.
Elngar Transforming Online Learning Management: Generative Models on ChatGPT to Enhance Online Student Engagement Scale (OLE) Quantitative and qualitative analyses were carried out on the data in this study.
By verifying the questionnaire results, we gain insight into the potential of ChatGPT in engaging students to study political sociology.
Researchers used SPSS version 26 for Windows to store, organize, and analyze research data.
The following table displays the results of the student's scores on the questionnaire employed by the Table 3.
Mean score of students engaged to ChatGPT Descriptive Statistics ChatGPT Valid N .
Minimum Maximum Mean Std.
Deviation Based on table 3 In total, 23 students were willing to express their thoughts on their learning activities through ChatGPT and their responses matched the requirements for analysis.
The next stage was to assign a letter grade to each studentAos answer on the questionnaire.
Table 3 displays mean score of the students answer is 08, from the questionnaire to properly understand the results of the students score in good engage category.
Table 4.
Descriptives Statistic ChatGPT Mean 95% Confidence Interval for Mean 5% Trimmed Mean Median Variance Std.
Deviation Minimum Maximum Range Interquartile Range Skewness Kurtosis Lower Bound Upper Bound Statistic Std.
Error Twenty-three students/respondentAos ass can be seen in the table 4 representation of the data provided ChatGPT engage students to learn in good category.
In this paper, we found that academic integrity used in conjunction with ChatGPT and other AI-based text generators is highly likely to be compromised.
Likewise, they have the potential to change the academic world.
Student involvement is very important so that a student-centered class atmosphere can be implemented optimally.
The presence of ChatGPT in the classroom can help students get and share ideas, increase participation in discussions, increase interest in reading and increase confidence in Idarah (Jurnal Pendidikan dan Kependidika.
Vol.
7 No.
learning as shown by figure 1 and study by Adiguzel, et al and Chaudry.
(Adiguzel et al.
, 2023.
Chaudhry et al.
, 2.
The ability to access Information quickly, the ease of using ChatGPT which can motivate students to do homework more quickly.
However, there were several students who said they had difficulty accessing ChatGPT due to inadequate network and limited quota.
In addition, in figure 2 it was found that students were not sure that ChatGPT could fully assist them in working on their papers because the information was biased and prone to similarities if ChatGPT was used for this need.
The presence of ChatGPT adds interest to studying political sociology.
access to information is fast and easy compared to reading textbooks.
Chatbot ChatGPT, an artificial intelligence chat tool, is ready to answer any questions, similar to Rahman and Watanobe's research (Rahman & Watanobe, 2.
The reaction to the chatbot's debut has received mixed responses from the literary and journalistic community.
Because it can simulate human reactions, many praise it as the best artificial intelligence technology.
On the other hand, some journalists see it as an attack on their right to make impartial judgments.
Based on the research results, it is evident that ChatGPT offers undergraduate students and lecturers the ability to find appropriate solutions to theory-based problems, at least in the context of political sociology classes, discussing and describing political phenomena and making comparisons with other countries.
ChatGPT replies are always concise and to the point.
ChatGPT should be a viable option for students looking for immediate responses to the questions shown in Figure ChatGPT provides replies depending on the user's word limit, unlike search engines that generate billions of results that may or may not be accurate and/or relevant.
These comments can provide users with enough information to make an informed decision without requiring them to sift through a massive list of potential sources and evaluate their legitimacy.
ChatGPT provides lecturers and students with a way to model the process of active discussion, feedback, and interaction.
The classroom can use ChatGPT to discuss and grade students' answers to questions, scenarios, and case studies.
They can serve as examples of potential solutions, and their strengths and weaknesses can be examined.
Students can then be asked to write their responses to the discussion ChatGPT's quick response can free up time to create more substantial and active discussions.
Due to ChatGPT's capabilities, teachers must adapt their methods to take advantage of cutting-edge AI tools and limit any adverse effects they may As previously mentioned.
ChatGPT can generate text very similar to human Teachers are urged to use anti-plagiarism software as a platform for receiving homework assignments to reduce the likelihood of students submitting comments generated by Chatbots.
Copyright A IDARAH (Jurnal Pendidikan dan Kependidika.
Ahmad Al Yakin.
Muthmainnah.
Eka Apriani.
Ahmed J.
Obaid.
Ahmed A.
Elngar Transforming Online Learning Management: Generative Models on ChatGPT to Enhance Online Student Engagement Scale (OLE) Educators and school authorities raise concerns regarding the potential for plagiarism that may arise when students use ChatGPT to complete assignments.
Plagiarism is a severe transgression in the scholarly domain, with specific academic establishments even threatening the expulsion of convicted offenders.
Positive aspects of ChatGPT in schools.
Nevertheless, some authorities contend that software such as ChatGPT is here to stay, and educational institutions should capitalize on its advantages.
ChatGPT eagerly anticipates the prospect of working with educators to devise pragmatic resolutions that empower students and instructors to benefit from the capabilities of artificial intelligence.
ChatGPT's capability to simplify difficult passages, thereby increasing their accessibility for students with reduced reading abilities, is one of its benefits.
Moreover.
ChatGPT is an invaluable instrument that enhances the reading experience of students with learning disabilities.
Instead of being perceived as an impediment, the chatbot ought to be regarded as an innovative educational prospect, akin to the initial scepticism that accompanied graphing calculators until they ultimately assisted students in deciphering mathematical formulas.
The study provides evidence that ChatGPT substantially impacts creativity and that plagiarism, in turn, affects creativity.
Additionally, creativity influences motivation, and the confluence of these elements ultimately affects academic Most respondents agree that ChatGPT helps educators .
oth teachers and student.
succeed by providing essential background information on a wide range of Participants also noted that ChatGPT helped them gain a broad perspective on various .
topics using straightforward language.
The future of education is ripe with digital possibilities, and ChatGPT may cause a sea change in how education is delivered.
This research adds findings and theoretical insights to the ongoing discussion about chatbots in the classroom.
This research also emphasizes the importance of rethinking education in light of the recent push to incorporate chatbots into the classroom.
The practical topic of "raising competence" underscores the need to create a curriculum to improve the skills of teachers and students, given the rapid growth of chatbots.
One route is to learn how best to incorporate chatbots into existing and future curricula and how best to create and implement such courses.
A few caveats to this study need to be recognized before conclusions can be drawn.
For example, this research focuses on universities that have just quantitatively started using ChatGPT.
In addition, the sample size is relatively small, with only 23 students contributing to the study.
Despite these caveats, this research lays a solid foundation for uncovering early adopter concerns about chatbots, particularly ChatGPT, in the classroom.
Investigating how human and machine tutors (ChatGPT) can work together to increase engagement, as well as the changes and Idarah (Jurnal Pendidikan dan Kependidika.
Vol.
7 No.
outcomes this brings to the field of education, can be a potential focus for future CONCLUSION ChatGPT is a valuable tool for educators and students, providing essential background information and enabling a comprehensive understanding of complex Its integration in education holds immense potential and could revolutionize knowledge imparting.
This research contributes to the ongoing discourse on chatbot use in classrooms and emphasizes the need to re-evaluate education to enhance teachers' and students' skills.
Future research should explore how human and machine tutors can collaborate to enhance engagement and investigate the resulting educational changes.
BIBLIOGRAPHY