Peer Review Upgrade: The Reviewer Portal
We are excited to share some upgrades and quality of life improvements for our reviewers and our review process as a whole.
Peer Review Upgrades: The Reviewer Portal
While the spotlight is often put on our community of analysts who produce stellar analytical outputs for our partners, our dynamic network of reviewers are just as important. In MetricsDAO’s three step process for on-demand analytics, peer reviews are the last crucial step in delivering high quality analytical solutions. With this we are excited to share some upgrades and quality of life improvements for our reviewers and our review process as a whole.
New Reviewer Portal
Reviewers can now access all the analytics submissions assigned to them through the reviewer portal. Through this, our operations team can assign reviews and the system will take care of managing what used to be manual overhead. Reviewers can then submit their reviews through the portal itself, allowing for timely and well-organized submissions.
This removes system scalability issues and allows us to engage as many reviewers in our network as possible.
Challenge Assignment Flexibility
Reviews can now be assigned down to the singular question level itself, instead of the challenge topic as a whole. This addresses the request by our reviewers to review just specific questions that lend best to their expertise. Enabling this allows our reviewers to have more focused reviews and help our operations team to better distribute challenge reviews across our network.
Reviewer Profiles
With the new portal, reviewer profiles can now be built up. This can track reviewer efficiency, scoring patterns, quality of reviews, and many more. The goal of this is to have a reliable view of the MetricsDAO reviewer network based on historical performance. Data is at the center of what everything we do and managing reviewer reputation should be no different.
We expect the new reviewer portal and related improvements to go a long way in helping us fulfill our goal of delivering on-chain analytics at scale. We have more coming soon so stay tuned by following us on Twitter and joining our Discord.