AnnotationPrep

Mercor STEM & Quantitative Reasoning Evaluation practice test

7 practice questions for this assessment, each with the grading rationale and underlying rule.

Start practising

Math & chain-of-thought verification: practice drill

10 scenarios, graded as you go, with the exact grading principle for every answer. Start free, no sign-up.

Have a live AI voice or video interview too?

Platforms like Mercor and Alignerr also screen candidates with an automated AI interviewer. Rehearse out loud with a voiced AI interviewer and get an instant scorecard before the real call.

Practise the live AI interview on AdversaryAI →

Practice tests that prepare you for this assessment

Practise by topic

About this assessment

Platform
Mercor
Availability
Remote / Global

Exact question counts, time limits, and project rubrics vary by platform cohort and qualification tier. Always read the platform's live project instructions carefully.

Sample scenarios

An AI solves: 'If 3x - 7 = 2(x + 5), find x.'

Step 1: 3x - 7 = 2x + 10
Step 2: 3x - 2x = 10 - 7
Step 3: x = 3

Where is the first error in the AI's chain of thought?

  1. Step 1: 2(x + 5) is 2x + 5.
  2. Step 2: adding 7 to both sides gives 10 + 7 = 17, not 10 - 7.
  3. Step 3: 3x - 2x is 5x.
  4. There is no error.
Show the answer

B. Step 2: adding 7 to both sides gives 10 + 7 = 17, not 10 - 7.

To move `-7` from the left side to the right side, you add `7` to both sides: `x = 10 + 7 = 17`. Checking `3(17) - 7 = 44` and `2(17 + 5) = 44` confirms `x = 17`.

Principle: CoT Math Verification: Sign Errors in Transposition

A fair coin is flipped 3 times. An AI claims the probability of getting AT LEAST ONE heads is `3/8`.
What is the actual probability?

  1. `1/2`
  2. `7/8` (since `1 - P(all tails) = 1 - (1/2)^3 = 1 - 1/8 = 7/8`).
  3. `3/8`
  4. `5/8`
Show the answer

B. `7/8` (since `1 - P(all tails) = 1 - (1/2)^3 = 1 - 1/8 = 7/8`).

The AI confused 'exactly one heads' (`3/8`) with 'at least one heads' (`1 - 1/8 = 7/8`).

Principle: Probability: Complement Rule

An AI evaluates `(a + b)^2` for `a = 3, b = 4`:
Step 1: `(a + b)^2 = a^2 + b^2`
Step 2: `3^2 + 4^2 = 9 + 16 = 25`

What classic algebraic fallacy did the AI commit?

  1. Division by zero.
  2. Freshman's dream fallacy: omitting the cross term `2ab` (`(3 + 4)^2 = 49`, not `25`).
  3. Sign inversion.
  4. Rounding error.
Show the answer

B. Freshman's dream fallacy: omitting the cross term `2ab` (`(3 + 4)^2 = 49`, not `25`).

`(a + b)^2 = a^2 + 2ab + b^2`. With `a=3, b=4`, the true value is `7^2 = 49`, not `25`.

Principle: CoT Math Verification: Binomial Expansion

Taking this assessment soon?

Tell us what skills or question formats you want more drills on.

Other Math, Logic & STEM assessments