Test with real questions

Read first Task 40

Collect twenty real questions with the answer you expect, then measure the bot against them. A score out of twenty is the only honest measure of quality.

Definition and example

Test with real questions is the focus of this lesson. Collect twenty real questions with the answer you expect, then measure the bot against them. A score out of twenty is the only honest measure of quality. The task asks you to apply that idea in a small example: What makes a good test question. Before you run the code, predict what should happen. Then Inspect the printed output and the values your program uses and compare it with your prediction. If the result differs, change one relevant line and run it again. Testing one change at a time makes the cause of a result easier to understand.

Python 1 automatic check Content and quality

Code editor Ctrl + Enter runs

# TASK test-with-real-questions-10: What makes a good test question?
# STEPS: Read the explanation. Change one relevant line at a time, then run the code and compare the result with the check on the right.
QUESTIONS = [
    ('What is the Python fee?', 'fee'),
    ('What are your timings?', 'timing'),
    ('Where are you in Faisalabad?', 'contact'),
]

def route(question):
    q = question.lower()
    if 'fee' in q:
        return 'fee'
    if 'timing' in q or 'time' in q:
        return 'timing'
    return 'contact'

passed = 0
for question, expected in QUESTIONS:
    got = route(question)
    if got == expected:
        passed += 1
    pass  # TODO: produce the required output for this task.
print('score:', passed, 'of', len(QUESTIONS))

Run your code to see the output and the checks.

Your result

Submit your code to see results

Write your code in the middle column and press Run code.

Checks on this task:

The program output must match “What is the Python fee? -> fee (expected fee) What are your timings? -> timing (expected timing) Where are you in Faisalabad? -> contact (expected contact) score: 3 of 3”.

The task and step-by-step instructions are written as comments at the top of the editor. Change one relevant line, run it, and compare the result with these checks.

Incorrect attempts before answer: 0 / 3

Track progress

0 passed of 56 tasks

Pass every check or use one of your available skips to open the next task.

← Previous

Next task (pass every check first)

Test with real questions

Test with real questions

Why this works