For Admins5 min read

Understanding Engagement Scores

Every active match in MentorNeko has an engagement score: a single number from 0 to 100 that summarizes the health of that mentoring relationship. Rather than requiring you to look at six different signals manually, the score aggregates them into one metric so you can quickly identify which matches need attention and which are on track.

Match detail page showing the engagement score gauge at 72, with a breakdown panel listing each component's contribution

Screenshot placeholder

The 7 Components

The engagement score is a weighted composite of seven signals. Each measures a different dimension of partnership health.

Check-In Participation (25%)

The heaviest component. MentorNeko sends periodic check-in surveys to both partners to gauge how things are going. This component measures how consistently both partners respond. Skipped or missed check-ins are an early warning sign; the score rewards regular participation regardless of the sentiment expressed.

Sentiment (15%)

Measures the emotional tone of check-in responses. Positive or neutral sentiment contributes to the score; sustained negative sentiment signals stress in the relationship, even if sessions are being completed on schedule.

Session Completion (20%)

Tracks whether the pair is completing sessions at the pace their program's cadence defines. A pair that is consistently behind on session completion scores lower here, even if they are communicating regularly. Completion is measured relative to the expected session count given how long the match has been active.

Agreement Status (10%)

Reflects whether both partners have signed the partnership agreement. An unsigned agreement in a match that has been active for more than a few weeks is a signal worth acting on.

Goal Progress (10%)

Measures whether goals set by the pair are being worked on and updated. Goals that sit unchanged for extended periods drag this component down. Regular progress updates and goal completions improve it.

Action Items (10%)

Reflects how consistently the pair creates and completes action items between sessions. Active pairs tend to leave each session with clear next steps; this component rewards that behavior.

Recency (10%)

A time-decay signal. If a pair has not had any platform activity (session logging, check-in response, goal update, message) within a recent window, this component decreases. It captures inertia that the other components might not yet reflect.

The Three Bands

Based on the composite score, each match is assigned one of three bands:

| Band | Score Range | Meaning | |---|---|---| | Strong | 70-100 | Relationship is healthy. No action needed unless requested by the pair. | | Steady | 40-69 | Relationship is functional but has one or more areas that could improve. Worth monitoring. | | At-Risk | 0-39 | Relationship shows signs of strain or disengagement. Likely needs admin attention. |

The at-risk band is the trigger for automated alerts if you have the relevant notification category enabled.

Engagement score band legend showing green for Strong, yellow for Steady, and red for At-Risk

Screenshot placeholder

The New-Match Grace Period

A brand-new match does not have enough data to produce a meaningful score. For the first period after a match is activated, the engagement score is suppressed and the match is not flagged as at-risk.

This grace period prevents false alarms for healthy new pairs that simply have not completed their first session yet. Once enough signal has accumulated, the score begins updating on its regular cadence.

Where to See Engagement Scores

Engagement scores appear in several places:

  • Match list: A score column lets you sort all matches by health. Combine with the at-risk filter to isolate the matches needing attention.
  • Match detail page: The full breakdown panel shows each component's contribution, making it easy to diagnose what is dragging the score down.
  • Dashboard match overview: At-risk matches are surfaced at the top, with score visible in the row.

Match list sorted by engagement score with a filter applied to show only at-risk matches

Screenshot placeholder

At-Risk Alerts

When a match's engagement score drops into the at-risk band, an automated email notification is sent to admins who have the At-Risk Alert notification category enabled. The email includes the match name, current score, and a direct link to the match detail page.

The alert is designed to prompt an outreach decision: you might send a direct message to one or both partners, schedule a check-in call, or use the match management tools to intervene more directly.

Using Scores to Prioritize Your Attention

In practice, most matches in a well-run program will be in the steady or strong band. The engagement score system is designed so you can ignore the majority of matches and focus where it matters.

A useful weekly habit: filter the match list to at-risk matches, review the score breakdown for each, and decide on an action. For most at-risk matches, a short personal email from the program coordinator is enough to re-engage a pair that has lost momentum.

Need more help?

Our team is here to help you get the most out of MentorNeko.

Contact Support