earticle

논문검색

Evaluating Conversational AI Systems for Responsible Integration in Education : A Comprehensive Framework

원문정보

Utkarch Mittal, Namjae Cho, Giseob Yu

피인용수 : 0(자료제공 : 네이버학술정보)

초록

영어

As conversational AI systems such as ChatGPT have become more advanced, researchers are exploring ways to use them in education. However, we need effective ways to evaluate these systems before allowing them to help teach students. This study proposes a detailed framework for testing conversational AI across three important criteria as follow. First, specialized benchmarks that measure skills include giving clear explanations, adapting to context during long dialogues, and maintaining a consistent teaching personality. Second, adaptive standards check whether the systems meet the ethical requirements of privacy, fairness, and transparency. These standards are regularly updated to match societal expectations. Lastly, evaluations were conducted from three perspectives: technical accuracy on test datasets, performance during simulations with groups of virtual students, and feedback from real students and teachers using the system. This framework provides a robust methodology for identifying strengths and weaknesses of conversational AI before its deployment in schools. It emphasizes assessments tailored to the critical qualities of dialogic intelligence, user-centric metrics capturing real-world impact, and ethical alignment through participatory design. Responsible innovation by AI assistants requires evidence that they can enhance accessible, engaging, and personalized education without disrupting teaching effectiveness or student agency.

목차

Abstract
1. Introduction
2. Literature Review
3. Insights and Considerations for Evaluating ChatGPT
3.1 Personal Consistency
3.2 Contextual Adaptability
3.3 Simulation of Naturalness
3.4 Updated Ethical Benchmarks
4. Proposed Evaluation Framework
4.1 Conversational Intelligence Benchmarks
4.2 Simulations of Learner Engagement
4.3 Tracking Dialogue Effectiveness
4.4 Ethical Alignment Standards (EAS)
4.5 Learner-Centric Metrics
4.6 Iterative Evaluation Protocol
5. Evaluating Framework Efficacy
5.1 Feasibility Analysis
5.2 Adaptability Analysis
5.3 Limitations and Assumptions
6. Conclusion
References

저자정보

  • Utkarch Mittal Manager, The Gap Inc. USA
  • Namjae Cho Professor, School of Business, Hanyang University
  • Giseob Yu Adjunct Professor, School of Business, Hanyang University

참고문헌

자료제공 : 네이버학술정보

    함께 이용한 논문

      ※ 기관로그인 시 무료 이용이 가능합니다.

      • 4,800원

      0개의 논문이 장바구니에 담겼습니다.