지원사업
학술연구/단체지원/교육 등 연구자 활동을 지속하도록 DBpia가 지원하고 있어요.
커뮤니티
연구자들이 자신의 연구와 전문성을 널리 알리고, 새로운 협력의 기회를 만들 수 있는 네트워킹 공간이에요.
논문 기본 정보
- 자료유형
- 학술저널
- 저자정보
- 발행연도
- 2012.1
- 수록면
- 65 - 73 (9page)
이용수
초록· 키워드
오류제보하기
Objectives: The purpose of this study is to validate a method that uses multiple queries to create a set of relevance judgments used to indicate which documents are pertinent to each query when forming a biomedical test collection. Methods: The aspect query is the major concept of this research; it can represent every aspect of the original query with the same informational need. Manually generated aspect queries created by 15 recruited participants where run using the BM25 retrieval model in order to create aspect query based relevance sets (QRELS). In order to demonstrate the feasibility of these QRELSs, The results from a 2004 genomics track run supported by the National Institute of Standards and Technology (NIST) were used to compute the mean average precision (MAP) based on Text Retrieval Conference (TREC) QRELSs and aspect-QRELSs. The rank correlation was calculated using both Kendall’s and Spearman’s rank correlation methods. Results: We experimentally verified the utility of the aspect query method by combining the top ranked documents retrieved by a number of multiple queries which ranked the order of the information. The retrieval system correlated highly with rankings based on human relevance judgments. Conclusions: Substantial results were shown with high correlations of up to 0.863 (p < 0.01) between the judgment-free gold standard based on the aspect queries and the human-judged gold standard supported by NIST. The results also demonstrate that the aspect query method can contribute in building test collections used for medical literature retrieval.
목차
등록된 정보가 없습니다.
참고문헌 (20)
참고문헌 신청
Cao YG. / 2009 / Evaluation of the clinical question answering presentation / Proceedings of the Workshop on Current Trends in Biomedical Natural Language Processing : 171 ~ 178
Efron M. / 2009 / Using multiple query aspects to build test collections without human relevance judgments / Proceedings of the 31th European Conference on IR Research on Advances
Grady C. / 2010 / Crowdsourcing document relevance assessment with mechanical turk / Proceedings of the NAACL HLT Workshop on Creating Speech and Language Data with Amazon’s Mech
Heppin KF / 2010 / MedEval: a Swedish medical test collection with doctors and patients user groups / Proceedings of the NAACL HLT 2010 Second Louhi Workshop on Text and Data Minin
Hersh W. / 1994 / OHSUMED: an interactive retrieval evaluation and new large test collection for research / Proceedings of the 17th Annual International ACM SIGIR Conference on Res
Efron M. / 2009 / Using multiple query aspects to build test collections without human relevance judgments / Proceedings of the 31th European Conference on IR Research on Advances
Grady C. / 2010 / Crowdsourcing document relevance assessment with mechanical turk / Proceedings of the NAACL HLT Workshop on Creating Speech and Language Data with Amazon’s Mech
Heppin KF / 2010 / MedEval: a Swedish medical test collection with doctors and patients user groups / Proceedings of the NAACL HLT 2010 Second Louhi Workshop on Text and Data Minin
Hersh W. / 1994 / OHSUMED: an interactive retrieval evaluation and new large test collection for research / Proceedings of the 17th Annual International ACM SIGIR Conference on Res
이 논문의 저자 정보
최근 본 자료
댓글(0)
0