The Science Behind DEBI

The usual way to measure engagement is to ask. An annual survey goes out, people rate how they feel across a set of scales, and the averages become the number the organization steers by. It is a reasonable idea with a measurement problem sitting underneath it. The thing being measured, how engaged someone is, and the instrument measuring it, a self-report survey, come from the same person, in the same sitting, with the same reasons to round up. When a predictor and an outcome share a source, that shared method inflates and distorts what you see (Podsakoff et al., 2003).

DEBI takes the other route. The Dynamic Engagement Behavioral Index does not ask people how engaged they are. It reads what they do: five everyday behaviors on the platform, scored continuously and combined into a single number from 0 to 100. It is behavioral because it is built from actions rather than answers, and dynamic because it moves as the behavior moves instead of freezing between survey windows.

This page is the reference for what that number means. It covers why behavior is a more faithful signal than self-report, the five behaviors DEBI reads and how they are weighted, the theory that connects those behaviors to engagement, and, most importantly, how the score behaves when we test it against our own data. Where the evidence is thin, it says so.

Why watching beats asking

Several well-documented problems live inside self-report engagement measurement, and reading behavior sidesteps most of them. People answer surveys in ways that look good, the tendency social-desirability research has measured for decades (Crowne & Marlowe, 1960). They also have limited access to their own mental states, so a rating is often a story told after the fact rather than an accurate readout (Nisbett & Wilson, 1977). And what people say diverges from what they do: the attitude-behavior gap is one of the oldest findings in social science (LaPiere, 1934), and its economic form, revealed preference, holds that choices are a more reliable guide to what someone values than stated intent (Samuelson, 1938).

Cadence is the second problem. A once-a-year survey is a snapshot, and response rates erode as surveys pile up, which biases the sample that remains (Rogelberg & Stanton, 2007). Decades of ecological momentary assessment show that frequent, in-the-moment measurement beats retrospective recall, because it captures experience as it happens instead of asking people to reconstruct it later (Csikszentmihalyi & Larson, 1987; Shiffman, Stone & Hufford, 2008). A daily behavioral read is on the right side of that evidence. An annual questionnaire is not.

None of this means the construct is wrong. Engagement as Kahn (1990) defined it, the investment of one's full self in a role, is real and matters for outcomes, and the instruments that measure it, the Utrecht Work Engagement Scale (Schaufeli, Bakker & Salanova, 2006) and Gallup's Q12 (Harter, Schmidt & Hayes, 2002), are well validated. They are also self-report. DEBI keeps the construct and changes the instrument: the same target, read from behavior instead of a questionnaire.

The five behaviors DEBI reads

DEBI blends five behavioral signals, each weighted, into one score. The weights sum to 1.0 and fall into three families that carry almost equal weight: showing up, speaking up, and lifting others up.

Why these five

Each family maps to a behavior the engagement literature already treats as a marker of engagement, which is what makes the composite more than a convenient sum.

Presence is showing up to the daily pulse, day after day. Consistent participation is the behavioral trace of the attentional and physical investment Kahn (1990) placed at the center of personal engagement, and reading it daily rather than annually is exactly what the momentary-assessment evidence recommends. It carries the largest single weight, 0.34.

Voice is open-ended feedback, split into how often people give it (0.22) and how much effort they put in (0.11). Feedback-giving is voice behavior, the discretionary act of speaking up with ideas and concerns, and it is a validated extra-role behavior distinct from required tasks (Van Dyne & LePine, 1998). Its absence, silence, is a recognized signal of withdrawal (Morrison, 2011). Weighting rate above effort says that speaking up at all matters more than how polished it is.

Recognition is taking part in peer recognition (0.22) and whether that recognition maps to company values (0.11). Recognition is a documented antecedent of engagement through social exchange (Saks, 2006), and well-recognized employees are markedly more likely to stay (Workhuman & Gallup, 2024). The values-alignment component asks not just whether recognition happens but whether it points at the behaviors the company says it cares about.

Read together, the three families line up with self-determination theory's basic needs, autonomy, competence, and relatedness (Ryan & Deci, 2000): voice expresses autonomy, recognition builds relatedness, and steady participation reflects competence in the daily work of a team. The score is a formative index, meaning the behaviors define it rather than reflect a hidden trait (Diamantopoulos & Winklhofer, 2001), and it is assembled the way composite indicators are built and weighted (Nardo et al., 2008). The premise underneath all of it, that behavioral traces carry real signal about latent psychological states, is well supported (Kosinski, Stillwell & Graepel, 2013).

Does the score track engagement?

A definition is only as good as its behavior in the field. A valid measure should do three things: move with what should drive it, correlate with the right things and ignore the wrong ones, and hold up in a second dataset. DEBI does all three.

1. It moves with behavior

Across 633 managers, team DEBI rises monotonically with how often the manager completes the daily check-in, from 3.4 for those who never check in to 51.9 for those who do it most days. That is a fifteen-fold gap and a very large effect (Cohen's d = 2.09). A score that stayed flat while a known engagement driver ranged from zero to daily would not be measuring engagement. This one climbs at every step.

Recognition shows the same shape. Managers who give no recognition in a year sit at a mean team DEBI of 8.8; those who give more than fifty reach 61.0, and every bin in between is higher than the one before it.

2. It tracks the right things and ignores the wrong ones

A good measure is defined as much by what it does not respond to as by what it does. The six behaviors an engaged workforce shows, a manager's own well-being, recognition given and received, replying to feedback and replying well, and checking in, all correlate with team DEBI in a tight band between 0.54 and 0.59. Two things engagement should not depend on, how long a manager has been at the company and how many people report to them, sit at essentially zero (0.04 and -0.04). A score that rewarded tenure or head count would be suspect. DEBI does neither. This is the pattern Campbell and Fiske (1959) named convergent and discriminant validity.

3. It replicates

The pattern holds in a separate sample of 542 managers across 100 companies. Managers who never reply to the feedback they receive score a team DEBI of 31.0, against 45.7 for those who do, a medium effect (d = 0.599). And the theoretically best behavior, high-quality replies given within a few days, reaches 54.1, against 28.5 for rushed, low-quality ones, a large effect (d = 0.988). DEBI separates engaged from disengaged managerial behavior in a dataset it was not tuned on.

Reading the score

DEBI runs from 0 to 100, and Happily reads it in three bands.

Two rules make the number more useful. First, a DEBI score is a level, and a level reads best next to a trend. A team at 55 and climbing is a different story from a team at 55 and sliding, and the sliding one is where attention belongs. Second, a very low score, especially a zero, often means "not enough behavior to read" rather than "actively disengaged." Before treating a zero as a crisis, check whether the person is on the platform at all.

What this means

Used well, DEBI is a continuous early-warning layer that complements periodic surveys and hard outcomes rather than replacing them. The table below is how to read common patterns.

Limitations

• Participation confound. Inactive users score near zero, and about 25% of managers in the drivers study sat at DEBI 0. A behavioral index cannot separate "disengaged" from "absent from the platform" without checking activity first, and this inflates the effect sizes reported above.
• Platform-bounded. DEBI only reads behavior that happens on Happily. Engagement expressed in other places, and disengagement hidden elsewhere, are invisible to it.
• Culture confound. A meaningful share of a DEBI score reflects the company's baseline rather than the individual. Within a single company, individual behavioral differences predict it more weakly, and the raw driver correlations shrink after adjusting for company.
• External validation is still open. In our data DEBI tracks behavioral drivers and self-reported manager happiness, but we have not yet published its correlation against independent gold-standard outcomes such as eNPS, WHO-5 well-being, or retention. Until that is done, the convergent case rests on internal drivers, which is a real but partial form of validation.
• Fixed, proprietary weights. The component weights are set by Happily and have not been independently re-derived from outcomes or audited.
• Proxies, not the felt state. The five signals are behavioral indicators of engagement, not the internal experience itself. They are a good read on it, not a substitute for it.