Multi-task Peer-Review Score Prediction

Jiyi Li, Ayaka Sato, Kazuya Shimura, Fumiyo Fukumoto

First Workshop on Scholarly Document Processing (SDP 2020) Workshop Paper

You can open the pre-recorded video in a separate window.

Abstract: Automatic prediction on the peer-review aspect scores of academic papers can be a useful assistant tool for both reviewers and authors. To handle the small size of published datasets on the target aspect of scores, we propose a multi-task approach to leverage additional information from other aspects of scores for improving the performance of the target. Because one of the problems of building multi-task models is how to select the proper resources of auxiliary tasks and how to select the proper shared structures. We propose a multi-task shared structure encoding approach which automatically selects good shared network structures as well as good auxiliary resources. The experiments based on peer-review datasets show that our approach is effective and has better performance on the target scores than the single-task method and naive multi-task methods.
NOTE: Video may display a random order of authors. Correct author list is at the top of this page.