Comprehensive Analytics gives you a built-in, real-time dashboard for every mentor in mentorAI—no add-ons required.
Track engagement (messages, users, topics), satisfaction, transcripts, and financial usage (by week/month/provider/model) to understand learning impact and optimize costs.
Admins can drill down to sessions, users, and topics for evidence-based course improvements.
Administrator · Instructor
Open analytics from any mentor’s chat to see live metrics—no separate setup.
Bare-bones totals at the top (messages this month, active users, topics, satisfaction), plus:
- User sessions list
- Most-popular topics
- Active-users bar chart (Today, Yesterday → 90-day default; custom ranges supported)
- Active users over time
- “Logged-in right now”
- Last-30-days usage
- Time-of-day heatmap
- Total registered users
- Per-user details
- Totals for topics and active users
- Average ratings by conversation/topic
- Sessions over time
- Ratings over time
- Highlighted topics (bar chart)
- Full chat histories to see what students ask (including uncomfortable questions they avoid in class)
- KPIs: avg messages/session, avg cost/session, avg rating/session
- Search by topic, user, or rating
- Usage over time: weekly, monthly, total cost
- Cost/day
- Cost by provider
- Cost by LLM model (reflecting mentorAI’s LLM-agnostic design: OpenAI, Gemini, Microsoft, etc.)
Analytics are included and available to admins for any mentor.
- In a mentor’s chat interface, locate the analytics icon (lower-left, above Settings) and click it
- The Comprehensive Analytics panel opens
- Scan totals for Messages, Active Users, Topics, Satisfaction
- Browse User Sessions, Popular Topics, and the Active-Users bar chart (Today → 90 days)
- Adjust the date range if needed (custom ranges supported)
- Open Users to view:
- Active-user trends
- Who’s online now
- Last-30-days usage
- Time-of-day patterns
- Total registered users
- User-level details
- Open Topics for totals, active users, average ratings by topic/conversation
- View sessions and ratings over time
- See highlighted topics (bar chart)
- Open Transcripts to inspect full chat histories
- Use Search to filter by topic, user, or rating
- Note KPIs at the top: avg messages/session, avg cost/session, avg rating/session—to spot friction or confusion
- Open Financials for:
- Weekly/monthly/total cost
- Cost/day
- Breakdown by provider and LLM model
- Use this to choose cost-effective models without sacrificing quality
- Use insights to refine prompts, datasets, tools, or LLM choices
- Recheck analytics after changes to measure impact
Use Topics + Transcripts to find concepts with low ratings/high volume, then add materials or adjust prompts.
Time-of-day usage informs when to schedule office hours or auto-released study nudges.
Track satisfaction and avg rating/session to verify the mentor’s tone, clarity, and helpfulness.
Common queries in Transcripts reveal where lessons or assessments need clarification.
Compare cost by provider/model to select LLMs that balance price, speed, and accuracy for each mentor.
Overview trends (messages, active users) offer quick evidence of engagement and learning impact for stakeholders.
With Comprehensive Analytics, you gain a clear, actionable picture of learner engagement, topic mastery, and cost—so you can continuously improve your mentors and your courses.