earticle

논문검색

한국어 작문 평가 채점의 타당도 검증: 다국면 Rasch 측정 모형 활용

원문정보

A validation of the scoring of KFL writing assessment based on the many-facet Rasch measurement model

이영식

피인용수 : 0(자료제공 : 네이버학술정보)

초록

영어

This paper aims to analyze the scores assigned to compositions of Korean as a foreign language (KFL) in terms of the many-facet Rasch measurement (MFRM) model. The MFRM computer program Facets has recently been updated and this research uses it in order to investigate the scoring reliability of KFL writing test. For the research data the Korean compositions written by 270 KFL learners were collected and rated by eleven Korean raters. At first a brief theoretical basis for the Facets is introduced based on the MFRM model. Then focusing on the raters’ characteristics such as rating consistency and fitness in terms of the rating scheme of content/organization and language, the collected scores of KFL compositions are analyzed and the analysis results are interpreted. As a result, a few cases of unreliable scoring of Korean raters are identified, but it appears that the ratings of Korean raters for a standardized KFL writing test are generally reliable. Finally it is suggested that the Facets program of MFRM offer many potential advantages for validating the scoring reliability of Korean writing assessment.

목차

 I. 서론  II. 다국면 Rasch 측정 모형의 이론적 배경과 최근의 Facets 프로그램  III. 다국면적 Rasch 측정 모형을 이용한 선행 연구  IV. 연구방법   1. 수험자   2. 시험문제   3. 채점자 및 채점  V. 분석결과   1. 데이터 요약(Data Summary)   2. 모든 국면의 분석 결과(All Facet Vertical “Rulers”)   2. 채점의 부적합(misfit) 및 과적합(overfit)   3. 사용된 단계의 적합성(Category Statistics)   4. 채점결과 비신뢰성의 검증(Unexpected Responses)  VI. 결론  참고문헌  <부록> 한국어 서술문 시험 채점 기준표

저자정보

  • 이영식 Lee, Young Shik. 한남대학교

참고문헌

자료제공 : 네이버학술정보

    함께 이용한 논문

      ※ 기관로그인 시 무료 이용이 가능합니다.

      • 5,700원

      0개의 논문이 장바구니에 담겼습니다.