NTNU Team Leads ICILS Global Study: Taiwan Students Claim #1 in Computational Thinking
December 10, 2024
In response to the arrival of the AI era, Taiwan participated for the first time in the International Computer and Information Literacy Study (ICILS). Led by a research team from NTNU, the Taiwan ICILS National Research Center held a press conference on the evening of November 12 at the Ministry of Education, jointly releasing the results of ICILS 2023 in coordination with the International Association for the Evaluation of Educational Achievement (IEA). The findings revealed that Taiwanese students demonstrated outstanding performance in computational thinking, ranking first in the world—underscoring the nation’s strong foundation in information education. In its first participation in the ICILS program, Taiwan’s research was carried out by a team from NTNU, commissioned by the K–12 Education Administration of the Ministry of Education and the National Academy for Educational Research. The project was personally led by NTNU President Professor Cheng-Chih Wu, who served as National Research Coordinator alongside Professor Meng-Jong Tsai of NTNU’s College of Learning Informatics. Professor Yu-Tzu Lin from NTNU’s Graduate Institute of Information and Computer Education and Professor Jiun-Yu Wu from National Yang Ming Chiao Tung University’s Institute of Education served as co-principal investigators. The press conference was attended by Director-General Fu-Yuan Peng of the K-12 Education Administration, National Academy for Educational Research President Chung-i Lin, and Vice President Chin-Hsiang Yen. Caption: Group photo of the NTNU research team with distinguished guests from the Ministry of Education. From left to right: Professor Yu-Tzu Lin (far left), Vice President Chin-Hsiang Yen (second from left), President Chung-i Lin (third from left), Director-General Fu-Yuan Peng (fourth from left), NTNU President Professor Cheng-Chih Wu (fifth from left), Professor Meng-Jong Tsai (third from right), and Professor Jiun-Yu Wu of National Yang Ming Chiao Tung University (far right). Caption: NTNU President Professor Cheng-Chih Wu (second from right) responds to questions. Caption: Professor Meng-Jong Tsai explains the research findings. The ICILS is administered by the IEA. It assesses Grade 8 students’ understanding of ICT concepts, practical skills, and problem-solving abilities through online tests and questionnaires. The study also examines teachers’ digital teaching practices and schools’ digital leadership, providing a comprehensive view of the factors influencing students’ computer and information literacy across participating countries. Launched in 2013, ICILS is conducted every five years and surveys Grade 8 students, teachers, ICT coordinators, and principals worldwide. ICILS 2023 marked the third cycle of this global assessment. A total of 34 countries participated, with over 5,000 schools, more than 130,000 students, and over 60,000 teachers taking part. From Taiwan, 169 schools participated, including 5,112 Grade 8 students and 2,233 Grade 8 teachers. The key findings from the survey are as follows: Taiwan Ranks First Globally in Computational Thinking (CT), and Fourth in Computer and Information Literacy (CIL) In computational thinking (CT), Taiwanese students scored an average of 548 points—the highest among the 24 participating countries (global average: 483). The CT assessment evaluates students’ abilities to understand digital systems, analyze problems, devise solutions, and develop algorithms and programs. The results show that Taiwanese students outperformed their global peers in problem-solving using computational methods. CT is a core focus of Taiwan’s current ICT curriculum. Compared to students in other countries, Taiwanese students receive more in-depth instruction in CT-related concepts and skills. Computational Thinking (CT): Taiwan Ranks First Taiwanese students achieved an average score of 548, significantly above the international average of 483. Ranked 1st among the 24 participating countries. Computer and Information Literacy (CIL) — Taiwan Ranks Fourth Taiwanese students averaged 515 points, significantly higher than the international average of 476 points, ranking fourth among the 34 participating countries. South Korea, the Czech Republic, and Denmark ranked as the top three. CIL achievement results show that Taiwanese students scored an average of 515 points (global average 476 points), ranking fourth among 34 countries, only behind South Korea, the Czech Republic, and Denmark. This indicator mainly assesses students’ abilities in using ICT tools, gathering information, producing information, and digital communication. It demonstrates that Taiwanese students perform well in terms of using ICT for problem solving, creation, and interactive communication. In terms of CT performance, more than half of Taiwanese students (52%) achieved Level 3 or above, demonstrating the ability to independently solve complex problems—far exceeding the international average (29%). Regarding CIL performance, the majority of Taiwanese students (64%) reached Level 2 or above, capable of completing basic information processing tasks, which also surpasses the international average (49%). CT performance shows little gender difference; female students outperform males in CIL. International assessments found no consistent conclusions regarding gender differences in CT. In most countries, male students slightly outperformed females in CT, but only six countries showed statistically significant differences. In Taiwan, female students scored slightly higher than males, but the difference was not statistically significant, indicating no notable gender gap in CT performance. This aligns with findings from countries like Finland, Norway, and South Korea. In terms of CIL, Taiwanese female students scored significantly higher than males, consistent with global trends. Overall, the results challenge the traditional stereotype that male students have an advantage in ICT-related learning. Taiwan’s CT and CIL performance is less correlated with students’ socioeconomic background. The survey results show that across countries, student performance is associated with socioeconomic background factors such as parental education, occupation, and access to computer resources at home. However, in Taiwan, the correlation between CT and CIL performance and socioeconomic background is significantly lower than the international average. This indicates that ICT education outcomes in Taiwan are less influenced by family background, suggesting more equitable access to information education and a higher degree of social fairness. ICT Usage Among Students Across Countries Students in all countries reported using ICT more frequently outside of school than in school, and mostly for non-academic purposes. However, trend analysis shows that increased ICT usage frequency does not lead to higher CIL performance. In most countries, students use general-purpose software (e.g., word processing, presentation, spreadsheets) in class more frequently than specialized software (e.g., multimedia production, simulation and modeling software, interactive game-based learning platforms). In contrast, Taiwanese students reported more frequent use of specialized software than general-purpose applications. Taiwanese Principals Show High Awareness of Students' and Teachers' Use of Generative AI Tools Principals across countries expressed mixed views on generative AI tools (e.g., ChatGPT). Over half of the students’ principals globally believe that generative AI will improve student learning, and nearly two-thirds think it will help increase student engagement. However, concerns remain that students may become overly reliant on AI and lose the ability to learn independently. Compared to the international average, Taiwanese principals are more aware of the impact generative AI tools have on both student learning and teacher instruction. While recognizing the potential benefits of AI in education, they are also attuned to its possible disruptions and consequences. Summary Taiwan’s Grade 8 students performed exceptionally well in CT and CIL, ranking first and fourth respectively among participating countries. Female students stood out in particular, overturning traditional stereotypes. While students’ performance is linked to family SES, the correlation in Taiwan is significantly lower than the international average, demonstrating greater social equity. Students reported opportunities to use ICT both in and out of school, and felt confident in acquiring appropriate internet literacy. Taiwan’s students performed remarkably well in this assessment, clearly reflecting the success of national ICT education strategies and their effective implementation at all levels of teaching, aligning with international trends and enhancing students’ CT and CIL to meet the demands of the digital era. In addition to Taiwan’s internationally advanced ICT curriculum and the concrete implementation of curriculum content in schools, relevant ICT education policies include: (1) establishing a three-tier support system through cooperation between central, local, and school levels to strengthen teachers’ digital teaching competencies and resource sharing; (2) promoting international CT assessment challenges to spark interest in CT learning; (3) implementing the one-tablet-per-student policy and encouraging private-sector investment in rural areas to reduce urban–rural disparities in classroom ICT use; (4) emphasizing online behavior guidance and actively promoting topics such as information ethics and cybersecurity; and (5) advocating gender equality and digital inclusion education, encouraging students to break boundaries and pursue self-fulfillment. NTNU has long been committed to advancing ICT education, not only participating in the development and promotion of national ICT education policies, but also actively engaging in textbook review, promoting widespread information literacy, and collaborating with top domestic and international universities through international conferences and academic exchanges to foster inter-school resource sharing and educational innovation. NTNU also continues to advance professional development programs for in-service teachers, helping them enhance their ability to teach with modern ICT tools to meet the rapidly evolving demands of digital education. Facing the ever-changing challenges of technology, NTNU also spares no effort in teacher education, actively cultivating future educators with contemporary ICT teaching capabilities to ensure they can effectively leverage technology and create digital learning environments that meet the needs of today’s students. (Source: Taiwan ICILS National Research Center / Photo: Chang Shih / Editor: Hu Shih-tse) Download the ICILS 2023 results presentation from the official ICILS National Research Center website (CIRN-ICILS).