Research
The AI Coaching Report
An independent blind study comparing Ren against ChatGPT, Gemini, and Microsoft Copilot across 25 real-world leadership scenarios, 400+ coaching responses, and 5 dimensions of coaching quality.
4.22
Overall score
out of 5.0
#1
Ranked first
across all 4 LLMs tested
400+
Responses analyzed
25 scenarios × 4 turns
p<0.05
Statistically significant
Large effect sizes (d>2.0)
Blind Study Results
How Ren compares
Overall coaching quality score (1–5 scale), rated by independent evaluators across all 25 scenarios.
Ren
4.22
ChatGPT
2.84
CoPilot
2.68
Gemini
2.48
Ren leads in 4 of 5 coaching dimensions. All comparisons statistically significant (p < 0.05) with large effect sizes (Cohen’s d > 2.0).
Five Dimensions of Coaching
Where Ren leads
Each response was scored across five dimensions aligned with high-quality executive coaching principles.
Accountability
4.6/5
Returning responsibility to the user vs. prescriptive advice
Tough Love
4.5/5
Direct confrontation of avoidance and self-responsibility
Largest gap: 2.7 pts ahead
Transformation
4.4/5
Interrupting long-standing patterns and producing lasting change
Coaching Depth
4.2/5
Diagnostic questioning — surfacing root causes and blind spots
Comprehensiveness
3.4/5
Breadth of frameworks, best practices, and synthesis
Ren prioritizes depth over breadth
General-purpose AI gives advice. Ren coaches with questions.
The study reveals a fundamental philosophical divide. ChatGPT, CoPilot, and Gemini operate primarily in consulting mode — framework-heavy, solution-providing, externally directive. Ren operates in true coaching mode: question-led, pattern-confronting, ownership-building.
The largest performance gap occurs in Tough Love — the ability to compassionately confront avoidance and invite self-responsibility. General models remain supportive and validating. Ren names the pattern and pushes back.
Download the Full Reports
Get the complete research
Two versions included — a full methodology report with statistical analysis and a visual executive summary for stakeholder presentations.
Full Methodology Report
6 pages · PDF
Complete data, methodology, statistical analysis, and scoring rubrics
Visual Executive Report
9 pages · PDF
Infographics, charts, and key findings for stakeholder presentations
We’ll send you the reports and occasional coaching insights. Unsubscribe anytime.
See what real coaching looks like
Book a demo to experience the difference between advice and coaching.