Calculation method
Counts FreeLing/DiSeg tokens; punctuation and contractions may make this differ from word-count.
MeasurementsActive
Token count
token-count
Number of lexical units produced by the analyzer.
Usage of this metric
When enabled, the report contains exactly one item with this metric_id in result.measurements.
Location in the result
result.measurements[]metric_id = "token-count"Result interpretation
`value` contains the numeric result and `unit` is `count`. Absence means the variant was disabled.
Limitations
The value depends on analyzer normalization and segmentation; it should be interpreted together with the other metrics and the text genre.
Dependencies
- language
en- implementation_version
1.0- unit
count
Valid example
{
"implementation_version": "1.0",
"metric_id": "token-count",
"unit": "count",
"value": 24
}GET /v1/metrics/token-count
Complete request, response and error contracts, generated automatically from the code.