AnnotationPrep

Outlier AI Math, Physics & Chain-of-Thought Assessment practice test

12 practice questions for this assessment, each with the grading rationale and underlying rule.

Start practising

Math & chain-of-thought verification: practice drill

10 scenarios, graded as you go, with the exact grading principle for every answer. Start free, no sign-up.

Practice tests that prepare you for this assessment

Practise by topic

About this assessment

Platform
Outlier AI
Availability
Remote / Global

Exact question counts, time limits, and project rubrics vary by platform cohort and qualification tier. Always read the platform's live project instructions carefully.

Sample scenarios

An AI solves: 'If 3x - 7 = 2(x + 5), find x.'

Step 1: 3x - 7 = 2x + 10
Step 2: 3x - 2x = 10 - 7
Step 3: x = 3

Where is the first error in the AI's chain of thought?

  1. Step 1: 2(x + 5) is 2x + 5.
  2. Step 2: adding 7 to both sides gives 10 + 7 = 17, not 10 - 7.
  3. Step 3: 3x - 2x is 5x.
  4. There is no error.
Show the answer

B. Step 2: adding 7 to both sides gives 10 + 7 = 17, not 10 - 7.

To move `-7` from the left side to the right side, you add `7` to both sides: `x = 10 + 7 = 17`. Checking `3(17) - 7 = 44` and `2(17 + 5) = 44` confirms `x = 17`.

Principle: CoT Math Verification: Sign Errors in Transposition

Premise: 'If it rains, the grass gets wet.'
Observation: 'The grass is wet.'

An AI concludes: 'Therefore, it definitely rained.'
What logical fallacy did the AI commit?

  1. Modus ponens.
  2. Affirming the consequent—a sprinkler or morning dew could also wet the grass.
  3. Denying the antecedent.
  4. Circular reasoning.
Show the answer

B. Affirming the consequent—a sprinkler or morning dew could also wet the grass.

From `P -> Q` and `Q`, concluding `P` is the formal fallacy of affirming the consequent. Only `P -> Q` and `not Q` validly implies `not P` (modus tollens).

Principle: Formal Logic: Affirming the Consequent

An AI evaluates `(a + b)^2` for `a = 3, b = 4`:
Step 1: `(a + b)^2 = a^2 + b^2`
Step 2: `3^2 + 4^2 = 9 + 16 = 25`

What classic algebraic fallacy did the AI commit?

  1. Division by zero.
  2. Freshman's dream fallacy: omitting the cross term `2ab` (`(3 + 4)^2 = 49`, not `25`).
  3. Sign inversion.
  4. Rounding error.
Show the answer

B. Freshman's dream fallacy: omitting the cross term `2ab` (`(3 + 4)^2 = 49`, not `25`).

`(a + b)^2 = a^2 + 2ab + b^2`. With `a=3, b=4`, the true value is `7^2 = 49`, not `25`.

Principle: CoT Math Verification: Binomial Expansion

Taking this assessment soon?

Tell us what skills or question formats you want more drills on.

Other Math, Logic & STEM assessments