International Journal of Cyber and IT Service Management (IJCITSM) Vol.
No.
April 2025, pp.
23Oe30 E-ISSN: 2808-554X | P-ISSN: 2797-1325.
DOI:10.
ye Advancing Higher Education: Longitudinal Study on AI Integration and Its Impact on Learning Marviola Hardini1 .
Hetilaniar2 .
Semaria Eva Elita Girsang3* .
Souza Nurafrianto Windiartono Putra4 .
Ihsan Nuril Hikam5 1 Department of Information System.
University of Raharja.
Indonesia 2 Faculty of Language and Arts.
University PGRI Palembang.
Indonesia 3 Department of Teacher Professional Education Program.
Simalungun University.
Indonesia 4 Department of Information Technology.
UniversitaOt des Saarlandes.
German 5 Department of Information Technology.
University of Raharja.
Indonesia 1 marviola@raharja.
info, 2 hetilaniar@univpgri-palembang.
id, 3 semariagirsang.
eg@gmail.
com, 4 s.
windiartono@uni-saarland.
5 ihsan.
nuril@raharja.
*Corresponding Author
Article Info
ABSTRACT
Article history:
The integration of Artificial Intelligence (AI) into higher education is reshaping the learning landscape.
This longitudinal study explores AI impact on learning outcomes, student engagement, and the overall educational experience, focusing on five key variables: AI-enabled Personalized Learning (AIPL).
Student Engagement Metrics.
Cognitive Skill Development (CSD).
Digital Literacy Advancement (DLA), and Educational Resource Optimization (ERO).
Using Structural Equation Modeling (SEM) with SmartPLS, the study analyzes these variables to assess AI effectiveness as a pedagogical tool.
By evaluating how AI influences student engagement and academic performance, this research highlights the potential of AI to enhance cognitive skills and digital literacy, optimize educational resources, and improve learning efficiency.
The study spans multiple academic terms to track the evolving impact of AI, ensuring its long-term sustainability in modern education.
The findings aim to inform future strategies for AI integration in higher education, contributing to the broader discourse on AI transformative role in education and providing actionable insights for educators and policymakers.
By focusing on the core principles of AI-driven innovation and learning optimization, this research seeks to offer evidence-based recommendations to improve the quality and accessibility of education.
Submission January 9, 2025 Revised February 6, 2025 Accepted March 3, 2025 Published March 10, 2025 Keywords:
Artificial Intelligence Higher Education Personalized Learning Student Engagement This is an open access article under the CC BY 4.
0 license.
DOI: https://doi.
org/10.
34306/ijcitsm.
This is an open-access article under the CC-BY license .
ttps://creativecommons.
org/licenses/by/4.
AAuthors retain all copyrights INTRODUCTION The advent of Artificial Intelligence AI has precipitated a paradigm shift across various sectors, and education is no exception.
AI potential to revolutionize teaching and learning processes has been increasingly recognized, leading to its gradual integration into educational settings.
This study aims to explore the transformative role of AI in higher education, focusing on its impact on both pedagogical aspects and the broader educational experience .
, .
While the integration of AI has been discussed in prior literature, this research distinguishes itself by addressing the unique aspects of AI impact on cognitive skill development and resource Journal homepage: https://iiast.
iaic-publisher.
org/ijcitsm/index.
php/IJCITSM/index ye
E-ISSN: 2808-554X | P-ISSN: 2797-1325
Specifically, it highlights how AI technologies can address gaps in current educational models by improving engagement, personalization, and efficiency in learning.
A key benefit of AI in education is its ability to personalize learning experiences at scale.
AI systems can adapt to the learning pace, style, and preferences of individual students, potentially leading to more effective learning outcomes.
This study explores how AI-driven personalization influences student academic performance and motivation, as personalized learning is increasingly recognized as crucial for student success .
In particular, this research will examine the effectiveness of AI in enhancing student engagement, an essential element in academic achievement, especially in an era where student attention is limited.
By focusing on AI adaptive and interactive capabilities, the study will offer insights into how it can enhance the student learning journey.
In addition to personalization.
AI is poised to play a pivotal role in developing essential cognitive skills and enhancing digital literacy among students.
Cognitive skills, such as critical thinking, problem-solving, and creativity, are increasingly important in the digital age.
AI offers unique opportunities to create complex, realworld problem-solving environments, which are instrumental in honing these skills.
The study will evaluate AI effectiveness in fostering cognitive development, particularly how it can support higher-order thinking .
Moreover, as digital literacy becomes fundamental for success in the modern world.
AI role in facilitating this aspect of education is essential.
This research will examine how AI technologies contribute to the enhancement of digital literacy, preparing students to thrive in an ever-evolving technological landscape.
Finally, the study will address AI potential to optimize educational resources, making the learning experience more efficient and cost-effective .
AI technologies can streamline resource allocation, identify gaps in learning materials, and offer predictive analytics to optimize the use of educational resources.
This section of the study will explore how AI can be leveraged by educational institutions to improve operational efficiency, enhance the quality of education, and ensure the strategic use of resources .
The findings from this research will help stakeholders in higher education understand how AI can drive innovation and optimize their practices, supporting both educational and operational goals.
LITERATURE REVIEW
AI-Enabled Personalized Learning (AIPL) The growing field of AIPL is based on the concept that education can be customized to match the learning patterns, preferences, and pace of individual students.
AIPL systems utilize machine learning algorithms to adapt instructional materials according to a studentAos progress, creating a personalized educational Research suggests that such personalized learning approaches can lead to improved retention rates and a deeper understanding of the subject matter .
Ae.
This personalization goes beyond addressing individual learning styles.
it also involves real-time adjustments to a learner competencies as they evolve during the The implications of AIPL for educators and educational institutions are profound.
The integration of AI into learning platforms not only enhances student learning outcomes but also provides educators with valuable, data-driven insights into student performance .
These insights can help inform instructional strategies, making them more tailored and effective.
Furthermore.
AIPL can lead to curriculum adjustments, allowing educational institutions to create a more dynamic and responsive learning environment that evolves according to the needs of the students.
By leveraging AI, educators can better support students individual learning journeys, improving both the efficiency and effectiveness of education.
Hypothesis 1 (H.
: The use of AI-enabled personalized learning systems positively correlates with the improvement of individual academic performance in higher education.
Student Engagement Metrics (SEM) Engagement is a complex and multifaceted construct that involves behavioral, emotional, and cognitive dimensions of the student experience.
AI technologies hold the potential to enhance all three aspects by providing interactive content, immediate feedback, and personalized learning pathways.
Research consistently shows a positive correlation between student engagement and academic achievement, suggesting that AI ability to deepen engagement could lead to improved learning outcomes .
, .
The operationalization of engagement through AI involves using analytics to track and assess student interactions with learning materials.
By adapting to studentsAo needs in real time.
AI systems can create a more engaging learning environment, tailored to individual progress.
This personalized approach not only enhances International Journal of Cyber and IT Service Management (IJCITSM).
Vol.
No.
April 2025, pp.
23Ae30 International Journal of Cyber and IT Service Management (IJCITSM) ye the learning experience but also increases student satisfaction .
Additionally.
AI-driven engagement has the potential to reduce dropout rates, which are critical metrics for educational institutions aiming to retain students and improve overall academic performance.
By fostering deeper engagement.
AI could help ensure that students remain motivated and invested in their learning journey.
Hypothesis 2 (H.
: There is a significant positive relationship between the implementation of AI in learning environments and the levels of student engagement.
Cognitive Skill Development (CSD) AI capacity to present complex, real-world problems in a controlled environment makes it an excellent tool for developing higher order cognitive skills.
The literature suggests that such skills are better honed through active problem-solving and critical thinking exercises, which AI systems can facilitate.
This is particularly relevant in disciplines where abstract concepts can be made tangible through simulation and modeling .
The focus shifts to the longitudinal development of these skills.
Cognitive skills do not develop overnight but rather through sustained and progressive challenges that AI systems can provide.
The adaptability of AI could support the incremental development of cognitive abilities over time, a relationship that this research aims to explore and quantify .
, .
Hypothesis 3 (H.
: AI integration in educational curricula is positively associated with the enhancement of students cognitive skill development.
Digital Literacy Advancement (DLA) Digital literacy is no longer a supplementary skill but a fundamental component of education.
AI role in this domain is twofold: it serves as both the medium and the facilitator of digital literacy.
By interacting with AI-powered tools, students can learn to navigate digital environments with greater proficiency.
The literature supports the notion that technology integration in education is a key driver of digital literacy skills .
The broader implications of digital literacy in the workforce and society.
As the digital divide continues to present significant challenges, the role of education in bridging this gap is critical.
AI ability to tailor learning and provide digital experiences to a diverse student body is an essential factor in promoting equitable digital literacy.
Hypothesis 4 (H.
: Exposure to AI-based educational tools leads to a significant increase in studentsAo digital literacy levels.
Educational Resource Optimization (ERO) The optimization of educational resources is a significant concern for institutions aiming to maximize learning outcomes while minimizing costs.
AI can contribute to this by predicting learning outcomes and identifying the most effective educational tools and methodologies.
The literature points to AI capacity for data analysis and pattern recognition as key to optimizing educational resources .
, .
Discussion extends to the sustainability of educational practices.
AI can play a role in creating sustainable educational models by ensuring that resources are used where they are most effective.
This not only has the potential to improve educational outcomes but also to make education more accessible by reducing costs and barriers to entry.
Hypothesis 5 (H.
: The application of AI for educational resource optimization is positively related to the efficiency and effectiveness of the learning environment.
METHODS
This study employs a robust and comprehensive methodology to empirically test the hypotheses derived from the literature review, utilizing SEM with SmartPLS.
SmartPLS is selected for its ability to handle complex models efficiently and its suitability for small to medium sample sizes, which aligns well with the exploratory nature of this research.
The Partial Least Squares SEM (PLS-SEM) approach is particularly advantageous for its minimal requirements regarding measurement scales and distributional assumptions, making it an ideal choice for theory development, which is the central objective of this study .
, .
The data for the study will be collected through surveys and performance metrics over a defined academic period.
The surveys will target students perceptions and experiences with AI-enabled learning tools, their engagement levels, cognitive skill development, digital literacy, and their views on the optimization of educational resources .
Performance metrics will be obtained from the educational institutions Learning Management Systems (LMS), providing objective data on student performance and resource utilization, which complements the self-reported data from the surveys .
, .
E-ISSN: 2808-554X | P-ISSN: 2797-1325
ye The study will be conducted in phases, with the first phase focusing on constructing an initial model based on the theoretical framework outlined in the literature review.
This model will explore the relationships between key constructs such as AIPL.
CSD.
DLA, and ERO.
The measurement model will be tested for reliability and validity, ensuring that each construct is accurately represented by its respective indicators .
Once the measurement model is validated, the structural model will be assessed to evaluate the hypothesized relationships between the constructs.
A longitudinal approach will be used in this study, involving multiple waves of data collection to assess the stability and changes of the constructs over time.
This will allow the study to capture the dynamic nature of AI integration in education and its evolving effects on the variables of interest .
, .
By applying longitudinal data, the study will be able to employ advanced PLS-SEM techniques such as latent growth modeling, which will offer deeper insights into the development of the constructs over time and help assess the predictive validity of the model.
In the final phase, the results from the SmartPLS model will be interpreted, with particular focus on the path coefficients, which will indicate the strength and significance of the hypothesized relationships.
The modelAos predictive power and goodness-of-fit will also be assessed to ensure the robustness of the findings .
To further validate the studyAos conclusions, bootstrapping procedures will be used to provide confidence intervals for the estimates.
This methodological approach will allow the study to provide valuable contributions to the field of AI in education and offer practical recommendations for educators and policymakers seeking to enhance the educational experience using AI technologies .
, .
RESULT AND DISCUSSION
The data collected from the surveys and performance metrics were analyzed using SmartPLS to test the proposed hypotheses.
The results of the PLS-SEM analysis are summarized in Table 1, which presents the path coefficients, t-values, and p-values for each hypothesized relationship.
Table 1.
PLS-SEM Path Coefficients Path Coefficient T-Value P-Value AIPL Ie Academic Performance <0.
SEM Ie Engagement Level <0.
CSD Ie Cognitive Skills <0.
DLA Ie Digital Literacy <0.
ERO Ie Learning Efficiency <0.
Supported? Yes Yes Yes Yes Yes Table 1 in the results section encapsulates the core findings from the SmartPLS analysis, presenting a clear picture of the relationships between the use of AI in educational settings and various educational The table reveals significant path coefficients for all hypothesized relationships, indicating that AI-enabled personalized learning systems are strongly associated with improved academic performance.
This suggests that as AI personalization increases, so does the academic achievement of students, highlighting the potential of AI to cater to individual learning needs effectively.
Construct
AIPL
SEM
CSD
DLA
ERO
Table 2.
Construct Reliability and Validity CronbachAos Alpha Composite Reliability Average Variance Extracted (AVE) Table 2 presents the internal consistency reliability, composite reliability, and the average variance extracted for each construct.
All constructs exceeded the threshold for CronbachAos Alpha .
and Composite Reliability .
, indicating good internal consistency.
Furthermore, the AVE for each construct is above the recommended threshold of 0.
5, suggesting that the majority of the variance in the indicators is captured by the constructs they are intended to measure.
This demonstrates the convergent validity of the measurement model.
International Journal of Cyber and IT Service Management (IJCITSM).
Vol.
No.
April 2025, pp.
23Ae30 International Journal of Cyber and IT Service Management (IJCITSM) ye Table 3.
R-Squared Values and Effect Sizes Endogenous Construct R-Squared Effect Size .
2C) Academic Performance Engagement Level Cognitive Skills Digital Literacy Learning Efficiency Table 3 outlines the R-squared values, which represent the proportion of variance in the endogenous constructs that is explained by the model.
The R-squared values for all constructs are substantial, indicating that the model explains a significant portion of the variance in the outcomes.
The effect sizes .
2CI) suggest that the independent variables have a medium to large effect on the dependent variables, further validating the strength of the relationships within the model.
Together, these tables provide a comprehensive view of the model reliability, validity, and explanatory The results indicate that the model is both robust and significant, providing strong empirical support for the integration of AI in higher education to enhance various educational outcomes.
The discussion would then critically engage with these findings, considering the implications for educational practice and policy, as well as reflecting on the limitations of the study and recommendations for future research.
The results of this study provide empirical evidence supporting the significant role of Artificial Intelligence (AI) in various aspects of higher education.
The hypothesis regarding the positive relationship between SEM and student engagement levels (H.
was confirmed, with a significant path coefficient.
This highlights AI ability to foster engaging, interactive learning environments, which are crucial for improving student retention and satisfaction.
The impact of AI on cognitive skill development (H.
was also supported, indicating a positive effect on studentsAo problem-solving, critical thinking, and creativity.
These skills are increasingly important in todayAos workforce, where complex problem-solving is essential.
Further, the positive relationship between digital literacy advancement (H.
and exposure to AI-based educational tools was established.
This reinforces the idea that AI is key to equipping students with the digital skills necessary for the modern economy, positioning them for success both academically and professionally.
Finally, the hypothesis regarding Educational Resource Optimization (ERO) and learning efficiency (H.
was confirmed, with AI proving effective in optimizing resource use and improving learning efficiency.
This suggests that AI not only enhances educational outcomes but also promotes a more resource-efficient learning environment.
Overall, the findings suggest that AI integration in higher education can lead to significant improvements in personalized learning, engagement, cognitive skills, digital literacy, and resource management.
However, successful implementation requires careful planning, ongoing evaluation, and addressing challenges such as data privacy and educator training to maximize AIAos benefits.
MANAGERIAL IMPLICATION
The integration of AI in education offers significant opportunities for enhancing personalized learning, optimizing resources, and improving overall educational outcomes.
Managers in educational institutions should prioritize the strategic adoption of AI tools that cater to individual student needs, such as adaptive learning systems and real-time feedback platforms.
Additionally.
AI can optimize resource allocation, reduce costs, and streamline operations, leading to more efficient use of educational resources.
However, to ensure successful implementation, institutions must invest in professional development programs for educators to enhance their digital literacy and familiarity with AI technologies.
Furthermore, ongoing evaluation and monitoring are crucial to assess the long-term impact of AI on student outcomes and engagement.
Managers should employ data-driven decision-making to continuously refine AI strategies and ensure sustainable improvements.
Ethical considerations, such as addressing AI biases, ensuring equitable access, and safeguarding data privacy, must also be prioritized.
By focusing on these areas, educational institutions can leverage AI to create a more personalized, efficient, and inclusive learning environment while mitigating potential risks.
E-ISSN: 2808-554X | P-ISSN: 2797-1325
CONCLUSION
The study findings provide strong evidence of the positive impact of Artificial Intelligence (AI) on higher education.
The significant path coefficients from the SmartPLS analysis highlight AIAos potential to improve academic performance through personalized learning, enhance student engagement, foster cognitive skill development, boost digital literacy, and optimize educational resources.
These results demonstrate AIAos transformative role in tailoring education to individual needs, making learning more effective and accessible.
Additionally, the sustained positive effects across multiple constructs indicate that AI integration in higher education is not just a temporary trend but a meaningful shift toward a more data-driven, responsive, and student-centered educational model.
This shift offers valuable implications for institutions looking to harness AI to revolutionize teaching and learning.
The studyAos methodology, using a longitudinal approach and PLS-SEM, offers a solid foundation for future research, especially in exploring the long-term effects of AI in education.
As higher education continues to evolve in the digital age.
AI strategic integration emerges as a critical factor in improving both educational outcomes and operational efficiency.
In conclusion, this research contributes to the growing body of literature supporting AI in education, providing insights for educational stakeholders to make informed decisions about adopting AI technologies.
However, as we move forward, it is crucial that AI implementation is approached with careful consideration of ethical implications, equitable access, and a commitment to ongoing improvement based on empirical evidence.
DECLARATIONS
About Authors Marviola Hardini (MH) Hetilaniar (HH) https://orcid.
org/0000-0003-3336-2131 https://orcid.
org/0000-0001-6564-4358 Semaria Eva Elita Girsang (SE) https://orcid.
org/0000-0002-2337-2064 Souza Nurafrianto Windiartono (SN) Ihsan Nuril Hikam (IN) https://orcid.
org/0009-0000-0345-9763 Author Contributions Conceptualization: SE.
Methodology: MH.
Software: IN.
Validation: HH and SS.
Formal Analysis:
MH and SE.
Investigation: IN.
Resources: MH.
Data Curation: IN.
Writing Original Draft Preparation: SN and HH.
Writing Review and Editing: MH and SN.
Visualization: TM.
All authors.
MH.
HH.
SE.
SN and IN have read and agreed to the published version of the manuscript.
REFERENCES