Application Review Process
E-PAS-003
Note that the PDF file is not fully accessible. However, it contains visual aids that may be helpful when navigating the updated portal.
1. Introduction
1.1 Objectives
This guide is designed to provide comprehensive instructions to assessors on how to review and score applications.
Upon completion, you will be able to:
- review and score applications
- finalize your assessment
1. Introduction
1.1 Objectives
This guide is designed to provide comprehensive instructions to assessors on how to review and score applications.
Upon completion, you will be able to:
- review and score applications
- finalize your assessment
1.2 Key terms and concepts
Key term | Definition |
---|---|
Assessment group | Groups of applications assessed within a competition |
Assessor assignment | A page on the portal where assessors will find all essential information about their assessment group, including links to assess applications |
Application assessment | A page on the portal where assessors can view and score applications |
Context brief | An article intended to equip assessment committees with essential knowledge relevant to the applications in the assessment group |
2. Access Application Assessments topics
2.1 Navigate to the Assessor Assignment screen
Once the assessment group status is ready for assessment, you will be notified by email, and you will be able to start assessing applications.
- Navigate to the Assessor Assignment screen.
- View your list of application assessments. You will only see the first few applications in this list.
- Click View All to see the complete list.
2.2 View your Application Assessments
The expanded list of application assessments includes the following columns:
- Name
- Application
- Applicant
- Assessment status
- Total score (reviewers): Total score you have given to the applications
- Conflict of interest: Applications regarding which you flagged a conflict of interest
- Flag for discussion: Applications that you flagged for further discussion
- Added to agenda: Applications that have been added to the committee meeting agenda
This list provides an overview of the applications assigned to you for review. It should serve as your foundation for starting the review and scoring process. You can regularly refer back to it to monitor your progress and the scores you have given.
To open an application, click the relevant Name hyperlink.
3. Assess applications topics
3.1 Review applications
The layout of the Application Assessment page has three sections:
a) Header: Includes key information about the application: Application Assessment ID, Assessment Group, Application ID, Applicant, Application Name, Score Submission Due Date and Status.
b) Main section: Includes the application content and supporting documentation. You can review the application questions and answers by opening and closing the different sections of the application.
c) Side panel: Includes the Assessment section for you to complete (scoring and additional details)
3.2 Complete Assessment section
After reviewing the application content and supporting documentation, complete the side panel with the Assessment section:
- Complete the Scoring section:
- Scored questions: Enter your score for each assessment criteria
- Non-scored questions: Select the relevant answer
- Total score: Auto populated field calculated based on the scores you have entered
- Complete the Additional Details section:
- Conflict of interest: If applicable, check the box to communicate a conflict of interest. When selected, the scores and comments you entered for this application will be deleted.
- Flag for discussion: If applicable, check the box to communicate your intent to discuss this application with the program officer or possibly the committee.
- Constructive comment: If applicable, enter your comment. Note that applicants will be able to read the comment upon request, so you should keep this in mind when writing your comment.
- Click Save. A message will be displayed to confirm that your scores were successfully saved.
Note: To return to your list of application assessments, click the Back button in your browser. You can save and return to your assessments as many times as you want until the scores have been locked (see Score Submission Due Date in the header of the Application Assessment page or on your list of application assessments).
Program employees assigned to your committee will communicate the next steps and provide necessary details for committee discussion meetings.
4. Finalize Assessment
4.1 Assessor Sign-off
Once the assessment committee has completed the assessment and the assessment group status is set to Ranking Complete, navigate to the Assessor Assignment screen to sign off on your assessor assignment.
A banner to complete your assessor assignment will be displayed.
- Review and check the boxes to agree to each statement.
- Click Submit to complete your assessor assignment.
Note: Program employees will share the assessment group’s final ranking with the committee.