ASA Connect

 View Only

Invitation to participate in a study to improve peer review in ML conferences

  • 1.  Invitation to participate in a study to improve peer review in ML conferences

    Posted 03-18-2024 22:52
    Edited by Weijie Su 03-18-2024 23:04

    Dear ASA Members,

    I hope you are doing great! I am writing to invite you to participate in a statistical experiment if you submitted papers to ICML this year. The link to this study can be found under "Author Tasks" on your OpenReview submission page.

    In this experiment, my team seeks to improve the peer review process in machine learning conferences by incorporating authors' own opinions on their submissions. For background, the quality of peer review in ML/AI has been drastically declining due to the explosion of submission volumes to conferences like ICML and NeurIPS. The study asks the author to provide a ranking of the submissions in terms of quality. Your input will help evaluate new statistical methods to enhance peer review while maintaining strict confidentiality. Rest assured that your responses will not be used in the decision-making process this year. More details can be found at https://openrank.cc/. 

    Thank you for your support!

    ------------------------------
    Weijie Su
    University of Pennsylvania
    ------------------------------