Competency Assessments - Part 5 - Advanced Settings - Steps before publishing an Assessment Template

After questions have been added and you are ready to publish your assessment template, you need to complete a few steps, which can’t be edited once it’s published:

• Declare a pass score
• Declare how many questions should be included in an assigned assessment
• Choose a scoring method
• Set the information the candidate can see
• Adjust the advanced settings

Pass Score

The pass score can be presented in points (e.g. 7 / 10 points) or as a percentage (e.g. 70%).

To set the pass score:

1. Click the edit (pencil) icon under Pass Score
2. Select points or percent from the dropdown menu
3. Type in a number according to your choice above
4. Click Save

Number of Questions

You can have a larger number of questions in the template than are required for each assessment. This allows you to produce varied assessments from the same template. The questions can be randomly selected from the pool available. When you create a question you declare if it should be mandatory. Mandatory questions are always included up to the number of questions declared for the assessment.

To set the number of questions (if you don’t want to Ask all Questions):

1. Click the edit (pencil) icon under Number of Questions
2. Type the number of questions to include in every assessment (Leave empty to Ask all Questions)
3. Click Save

Randomise Questions

If a number is set above, questions will automatically be randomised.

If not, you can still randomise them:

1. Click the edit (pencil) icon under Randomise Questions
2. Click the checkbox
3. Click Save

What Info Can the Candidate See?

This section has two fields that define what information the candidates should see:

• After completion / marking - what the candidate sees when they receive feedback on their completed or expired assessment
• Before or during the assessment - what the candidate sees while the assessment is not started or is in progress

There are 4 choices for After completion / marking:

• Pass or Fail only - no other information provided
• Show failed Questions - only failed questions and answers returned
• All info excluding examiner comments - all questions, answers and scores returned, without examiner comments
• All info including examiner comments - all of the above plus any comments entered by the examiner

For Before or during the assessment, you can select any of the following:

• Intro text
• Reference docs
• Questions
• Pass/Fail per question
• Candidate's answers
• Correct answers
• Score given
• Attachments
• Examiner guidance
• Examiner remarks
  
  

To set the information a candidate can see:

1. Click the edit (pencil) icon under What Info Can the Candidate See? to expand the area
2. Click in the After completion / marking field to reveal the dropdown menu and select one of the choices
3. In the Before or during the assessment field, select the information the candidate can see before and during the assessment
4. Click Save

Scoring Method

The Scoring Method dropdown menu sets which scoring system is used. There are 3 choices: Severe, Moderate and Lenient. For information about the different scoring systems, see Scoring Method.

Allow Progress to be saved?

Sometimes it is acceptable to allow an assessment to be paused and return to complete it later without losing the answers already entered. This option is useful to prevent loss of work when an assessment involves lengthy processes, in case the assessor gets timed out and logged off the system in the middle of the assessment.

When this option is set to “yes”, assessors will see a ‘Save Progress’ button in the bottom left corner of the exam. Clicking it will save all completed answers and the user can close the assessment temporarily by clicking the “X” at the top.

Advanced Settings

There are 6 advanced settings:

• Examiner Settings
  
• Completion Settings
  
• Reissue Settings
  
• Notification Settings
  
• OU Scope
  
• Reference Documents

Most advanced settings can’t be changed once the assessment template is published. The only advanced setting that can be edited after publishing is Examiner Settings.

Publish an Assessment Template

Once the questions are complete and the score, number of questions and advanced settings have been applied the template can be published.

The template won't be published, and an error message is shown instead, if:

• The pass score is set to zero
• The pass score is greater than the number of points available
• The template has no questions
• Any question has answers that aren't valid
• The Number of Questions is larger than the number of questions in the template
• There are more mandatory questions than the Number of Questions setting

To publish:

1. Scroll up to the header section of the template
2. Click the dropdown menu for Actions:
3. Select Publish
4. Click Go
5. Click OK in the message box saying, “Are you sure you want to publish this Template?”

Next step:

The next article covers Examiner Setting (Adv. Settings)

Previous step:

The previous article covers Adding questions to a Draft Competency Assessment Template