ASA Connect

Dear Colleagues,

I am writing to invite you to participate in a statistical experiment if you submitted papers to ICML this year. The link to this study can be found under "Author Tasks" on your OpenReview submission page.

In this experiment, my team seeks to improve the peer review process in ML/AI conferences by incorporating authors' own opinions on their submissions. For background, the quality of peer review in ML/AI has been drastically declining due to the explosion of submission volumes to conferences like ICML and NeurIPS. The study asks the author to provide a ranking of the submissions in terms of quality. Your input will help evaluate new statistical methods to enhance peer review while maintaining strict confidentiality. More details can be found at openrank.cc/. 

Thanks!