지원사업
학술연구/단체지원/교육 등 연구자 활동을 지속하도록 DBpia가 지원하고 있어요.
커뮤니티
연구자들이 자신의 연구와 전문성을 널리 알리고, 새로운 협력의 기회를 만들 수 있는 네트워킹 공간이에요.
이용수
초록· 키워드
오류제보하기
Kim, Hyun Jung. 2011. Investigating the rationality of using composite scores for a speaking placement assessment. Korean Journal of English Language and Linguistics 11-3, 465-495. In second language performance assessments, analytic scoring is often preferred over holistic scoring in evaluating learners' test performances due to its advantages (e.g., detailed information about examinee ability and raters' separate attention to different components of the test construct). However, a single composite score is often used to infer learners' language ability, even in cases where their test performances have been rated using an analytic scoring rubric. Using a composite score may result in information loss regarding learners' ability and may mislead test users (e.g., teachers) in their decision-making. Therefore, this study investigated the reliability of the analytic ratings as well as the composite scores of a speaking placement test used in a community English program. A total of 215 incoming students took a speaking placement test, which included six semi-direct, computer-delivered tasks (three independent and three integrated). Students' recorded performances were scored by two independent raters on five analytic rating scales. An analysis of the analytic ratings using multivariate generalizability theory found high dependability of the speaking ratings and supported the use of composite scores. The findings suggest that a composite score reflecting multicomponential speaking ability can be reasonably used for placement decisions without being affected by other sources of score variation (e.g., tasks and task types).
목차
1. Introduction
2. Literature review
3. Method
4. Results
5. Discussion and Conclusions
References
Appendix A Speaking placement test
Appendix B Analytic scoring rubric
참고문헌 (17)
참고문헌 신청
1. [학술지(정기간행물)] - Bachman,L.F / 2002 / Some reflections on task-based language performance assessment / Language Testing 19 : 453 ~ 476
2. [단행본] - 라일바크만 / 2004 / Statistical analyses for language assessment / Cambridge University Press
3. [학술지(정기간행물)] - Bachman, L. F. / 1995 / Investigating variability in tasks and rater judgements in a performance test of foreign language speaking / Language Testing 12 : 238 ~ 257
4. [기타자료] - Brennan,R.L / 1999 / mGENOVA, Version 2.0. [Computer software]
5. [학술지(정기간행물)] - Brown,A / 1995 / The effect of rater variables in the development of an occupation-specific language performance test / Language Testing 12 : 1 ~ 15
2. [단행본] - 라일바크만 / 2004 / Statistical analyses for language assessment / Cambridge University Press
3. [학술지(정기간행물)] - Bachman, L. F. / 1995 / Investigating variability in tasks and rater judgements in a performance test of foreign language speaking / Language Testing 12 : 238 ~ 257
4. [기타자료] - Brennan,R.L / 1999 / mGENOVA, Version 2.0. [Computer software]
5. [학술지(정기간행물)] - Brown,A / 1995 / The effect of rater variables in the development of an occupation-specific language performance test / Language Testing 12 : 1 ~ 15
이 논문의 저자 정보
이 논문과 함께 이용한 논문
Effects of Acoustic Cues in the Perception of English Stop Laryngeal Consonants by English and Korean Listeners
Hansook Choi
영어학
2012
.06
Adaptation of Laryngeal Contrast in English Loanwords by Korean Speakers : Mapping from Auditory Forms to Surface Forms
Kim Jong Shil
영어학
2012
.06
Orthographic Differences and English L2 Spelling Errors
Chaehee Pa
,
k
영어학
2012
.06
Finding Textual Examples of Genres : Issues for Corpus Users
Chae Kwan Jung
,
Sue Wha
,
ton
영어학
2012
.03
The effects of training on incorporation of teacher feedback in L2 writing revision
Sunghee Pa
,
k
영어학
2012
.03
최근 본 자료
댓글(0)
0
UCI(KEPA) : I410-ECN-0101-2013-740-000750038