Quiz Challenges: Questions
This page enables you to add the questions for this Quiz challenge.
Choose from Multiple Choice or Text question. You can use the double arrow () to re-arrange questions.
Both types start with the Prompt, which can contain Markdown formatting, enabling you to be as complex or simple as you like, including text styling, code formatting, lists, and even adding images.
Under each question is a section called Other Options, which can be expanded by clicking on it. This contains additional settings to refine scoring and answer formatting.
Other Options: Points
You can change the number of points awarded for a correct answer. This enables you to adjust the weight given to make some answers more important than others.
Other Options: Partial Credit
If a question has more than one answer or validator, you can force all-or-nothing scoring by unchecking Allow Partial Credit
Quickly Adding Questions
You can use the Insert a new question () menu to quickly insert & duplicate questions above or below the question you are working on.
Multiple Choice Questions
Multiple Choice Questions will have one or more answers, each of which can contain Markdown formatting.
At least one answer must beck checked as the correct answer (to the left of the answer text). You can have multiple "correct" answers, allowing for more interesting answers.
You can re-arrange the answers easily dragging them with the double arrow ().
Finally, you can remove an answer by clicking the button.
If you add several questions, but check only one, the default mode is to show the answers to the participant using Radio buttons, which means "select one and only one answer". If you check off more than one, the answer will use Checkboxes, which means they can select any or all answers.
You can override this default by going into Other Options and changing the Maximum Number of Answer Selections.
Each free text question can be one of the following formats:
- Short Answer: A single line answer, expected to be no more than a couple words
- Long Answer: A multi-line Markdown editor for entering long answers
- Code (Short): A single line of code or other preformatted text. You can specify the language from our supported language list.
- Code (Multiline): A full code editor for entering long-form code answers. You can specify the language from our supported language list.
Free text questions can be automatically scored by adding one or more optional validation matchers. These can be use to validate in one of several ways:
- Includes Text The answer must include the provided text somewhere. The validation can be case sensitive (a=A), or can ignore case (a≠A).
- Excludes Text The answer must not include the provided text. You can set the case sensitivity as well.
- Equals Exactly The answer must exactly equal the provided text. You can set the case sensitivity.
- Does Not Equal The answer must not be the provided text. You can set the case sensitivity. Note: this usually will work better as Excludes Text.
- Matches Pattern The answer must match the provided Regular Expression. You can set the Case Insensitive (
i) and Multiline (
m) flags on the expression.
- Doesn't Match Pattern The answer must not match the provided Regular Expression, with the same options as above.
If they all are correctly matched (or not found), the question is awarded full points. If some or none match, the score awarded is based on the Partial Credit setting.
You can remove a validation matcher by clicking the button.
Previewing Validation Matcher Results
If you have at least one validation matcher, you can use Preview Matcher Results to test how the scoring works. Click on Preview Matcher Results to open the Matcher Preview tool.
In here, you can add text to the left-hand pane. The right-hand pane shows you the auto-scored results, including marking correct and incorrect matchers. To see which matchers are correctly matching or not, look above and to the right of each matcher for a or .
The calculated score is shown as well.
Challenge VersionsSemantic Versioning system for Qualified Challenges
Challenge: Advanced Test CasesDetails about advanced test reporting features such as hidden, weighted and tagged test cases
Challenge: Carry Forward SolutionsDetails about how to write a challenge that will candidates to pull and modify a previous solution to another challenge.
Challenge: InstructionsHelp for writing Challenge Instructions
Code Challenge Editor IDEReference for editing code challenges in the Qualified online IDE
Code Challenge: Language GeneratorHow to use the Language Generator