Evaluation of the Remote Peer Assessment Process for the Explore and Create Program

The Canada Council for the Arts engaged Forum Research to evaluate the remote assessment process implemented by the Explore and Create Program as a result of the pandemic.

Research goal

This evaluation focused on examining the effectiveness and obtaining feedback on the remote peer assessment process. 

Methods

Forum conducted statistical analysis of competition results, a survey, and interviews with peer assessors, and focus groups with Council staff. 135 peer assessors and 30 Council staff participated. 

Outcomes

The evaluation concluded that:

• Overall, the remote assessment process was considered effective. 
• Most peer assessors (94%) were satisfied with the assessment process. 
• The remote model has allowed for the inclusion of many assessors but presented challenges for those with limited access to resources (e.g., internet, equipment, workspace). 

Recommendations for improving the assessment process included: 

• Recognizing barriers that potential peer assessors may face to participating remotely and providing them with additional support and resources.
• Providing additional training for staff and peer assessors (e.g., on rapport building, equity within granting). 
• Ensuring consistency in processes across committees and that there is adequate time for discussion. 
• Provide support for unsuccessful applicants. 

The Canada Council is integrating the findings and recommendations from the evaluation to guide improvements to its assessment processes. 

Questions?

Please contact the Research, Measurement and Data Analytics Section at research@canadacouncil.ca.