# Comprehensive Analytics

iframe
## Description

**Comprehensive Analytics** gives you a built-in, **real-time dashboard** for every mentor in mentorAI—no add-ons required.
Track **engagement** (messages, users, topics), **satisfaction**, **transcripts**, and **financial usage** (by week/month/provider/model) to understand learning impact and optimize costs.
Admins can drill down to **sessions, users, and topics** for evidence-based course improvements.

## Target Audience

**Administrator · Instructor**

## Features

#### Single Click Access

Open analytics from any mentor’s chat to see live metrics—**no separate setup**.

#### Overview Tab

Bare-bones totals at the top (messages this month, active users, topics, satisfaction), plus:

- User sessions list
- Most-popular topics
- Active-users bar chart (**Today, Yesterday → 90-day default; custom ranges supported**)


#### Users Tab

- Active users over time
- “Logged-in right now”
- Last-30-days usage
- Time-of-day heatmap
- Total registered users
- Per-user details


#### Topics Tab

- Totals for topics and active users
- Average ratings by conversation/topic
- Sessions over time
- Ratings over time
- Highlighted topics (bar chart)


#### Transcripts Tab

- Full chat histories to see what students ask (including **uncomfortable questions** they avoid in class)
- KPIs: avg messages/session, avg cost/session, avg rating/session
- Search by topic, user, or rating


#### Financials Tab

- Usage over time: weekly, monthly, total cost
- Cost/day
- Cost by provider
- Cost by LLM model (reflecting mentorAI’s LLM-agnostic design: OpenAI, Gemini, Microsoft, etc.)


#### No Extra Cost

Analytics are **included** and available to admins for any mentor.

## How to Use (step by step)

#### Open Analytics

- In a mentor’s chat interface, locate the **analytics icon** (lower-left, above Settings) and click it
- The **Comprehensive Analytics** panel opens


#### Review the Overview

- Scan totals for **Messages, Active Users, Topics, Satisfaction**
- Browse **User Sessions**, **Popular Topics**, and the **Active-Users bar chart (Today → 90 days)**
- Adjust the **date range** if needed (custom ranges supported)


#### Drill into Users

- Open **Users** to view:
  - Active-user trends
  - Who’s online now
  - Last-30-days usage
  - Time-of-day patterns
  - Total registered users
  - User-level details


#### Explore Topics

- Open **Topics** for totals, active users, average ratings by topic/conversation
- View **sessions and ratings over time**
- See highlighted topics (bar chart)


#### Study Transcripts

- Open **Transcripts** to inspect full chat histories
- Use **Search** to filter by topic, user, or rating
- Note KPIs at the top: avg messages/session, avg cost/session, avg rating/session—to spot friction or confusion


#### Monitor Financials

- Open **Financials** for:
  - Weekly/monthly/total cost
  - Cost/day
  - Breakdown by **provider** and **LLM model**
- Use this to choose **cost-effective models** without sacrificing quality


#### Iterate & Improve

- Use insights to **refine prompts, datasets, tools, or LLM choices**
- Recheck analytics after changes to measure impact


## Pedagogical Use Cases

#### Targeted Remediation

Use **Topics + Transcripts** to find concepts with low ratings/high volume, then add materials or adjust prompts.

#### Instructional Timing

**Time-of-day usage** informs when to schedule office hours or auto-released study nudges.

#### Quality Assurance

Track **satisfaction** and **avg rating/session** to verify the mentor’s tone, clarity, and helpfulness.

#### Assessment & Curriculum Tuning

Common queries in **Transcripts** reveal where lessons or assessments need clarification.

#### Cost Optimization

Compare **cost by provider/model** to select LLMs that balance price, speed, and accuracy for each mentor.

#### Program Evaluation

**Overview trends** (messages, active users) offer quick evidence of engagement and learning impact for stakeholders.

With **Comprehensive Analytics**, you gain a **clear, actionable picture** of learner engagement, topic mastery, and cost—so you can continuously improve your mentors and your courses.