Plugin scoring
Score a plugin
Review the CANARY score, rationale, and supporting evidence.
The forecast comes from the frozen champion configuration applied to the newest panel month; the signals beneath it describe the plugin's current state and are not part of the validated forecast.
AI explanation
Explain this score
Bring your own AI
Copy the prompt below and paste it into Claude, ChatGPT, or any other AI assistant. You control what gets shared.
Show / edit raw prompt
"Explain now" uses the server API key (max 3/hr). "Open in" buttons use your own account with no limits. AI-generated explanations are provided for informational purposes only, may contain inaccuracies or omissions, and should not be relied upon as authoritative security guidance.
CANARY forecast · as of 2026-06
scm-api
Activity-recency clocks + Contributor dynamics · Logistic Regression: the frozen champion fold model (oot_champion/fold_2025-11, trained on months before 2025-11, labels as known 2025-12) applied to the newest month of the panel. Inference only; no outcome for this month is known yet.
Read the rank, not the score. The score is the model's raw output and is not a probability: on the holdout the champion's mean score is about 0.5 against an observed advisory rate of 1 percent. Across the pre-registered holdout, reviewing the top fifth of plugins by this ranking caught about half of the advisories that followed.
Honest track record
Where scm-api ranked before each window
Activity-recency clocks + Contributor dynamics · Logistic Regression, embargoed rolling backtest: the rank this plugin held among every scored plugin at each forecast date, using only what was knowable then. Shaded months are the pre-registered holdout.
Scored at 32 forecast dates; on average in the top 5.1% of plugins (top 1.9% across the holdout). No advisory followed any of those dates within six months.
| Holdout month | Score | Rank | Share of panel | What followed |
|---|---|---|---|---|
| 2025-07 | 66.0% | 72 of 2,053 | top 3.5% | none within six months |
| 2025-08 | 70.5% | 38 of 2,053 | top 1.8% | none within six months |
| 2025-09 | 68.6% | 46 of 2,053 | top 2.2% | none within six months |
| 2025-10 | 69.8% | 38 of 2,053 | top 1.8% | none within six months |
| 2025-11 | 71.0% | 21 of 2,053 | top 0.97% | none within six months |
| 2025-12 | 72.4% | 24 of 2,053 | top 1.1% | none within six months |
Current-state context
Supporting signals
Maintenance history, governance artifacts, SLSA provenance and known advisories in dependencies, read from the plugin's current public state. A practitioner's dashboard, not part of the validated forecast.
Key risk signals
- No advisories found in local dataset.
- Latest release: 2026-02-04.
- Requires Jenkins core 2.504.3.
- Last commit: November 2, 2026 — live data from GitHub.
- No SECURITY.md — vulnerability reporting process undocumented (+3).
- No Dependabot or GitHub Actions detected — limited automated maintenance (+3).
- Dependency risk: 1 of 3 dep(s) have advisories.
- Plugin health score 100/100 — acceptable maintenance posture.
Feature details (34 keys)
{
"advisory_count": 0,
"latest_advisory_date": null,
"days_since_latest_advisory": null,
"advisory_within_90d": 0,
"advisory_within_365d": 0,
"had_advisory_within_365d": false,
"max_cvss_base_score_observed": null,
"max_cvss_severity_label_observed": null,
"swh_present": true,
"swh_days_since_last_commit": 1.3,
"swh_commit_count": 11211,
"swh_has_security_md": false,
"swh_has_dependabot": false,
"swh_has_github_actions": false,
"swh_has_tests_directory": true,
"swh_has_changelog": true,
"swh_security_fix_commit_count": 455,
"has_plugin_snapshot": true,
"required_core": "2.504.3",
"dependency_count": 3,
"security_warning_count": 0,
"active_security_warning_count": 0,
"release_timestamp": "2026-02-04T22:56:48+00:00",
"days_since_release": 277,
"dependency_plugins": [
"asm-api",
"commons-lang3-api",
"structs"
],
"dependency_total": 3,
"dependency_risk_points": 2,
"dependency_risk_summary": {
"deps_with_any_advisory": 1,
"deps_with_recent_advisory_365d": 0,
"deps_with_active_warning": 0,
"worst_dep_max_cvss": null,
"worst_dep_id": null,
"worst_dep_latest_advisory_date": null
},
"dependency_missing_data": {
"snapshot_missing": 0,
"advisories_missing": 0,
"healthscore_missing": 0
},
"dependency_details_top": [
{
"plugin_id": "structs",
"advisory_count": 1,
"latest_advisory_date": "2024-06-26",
"recent_advisory_365d": false,
"max_cvss": null,
"security_warning_count": 1,
"active_security_warning_count": 0,
"healthscore": 100,
"risk_points": 2,
"reasons": [
"1 advisories (+2)."
]
}
],
"healthscore_value": 100,
"healthscore_date": "2026-02-05T14:32:38.748203Z",
"healthscore_collected_at": "2026-02-28T16:43:20+00:00",
"score_components": {
"advisory_history": 0,
"advisory_severity": 0,
"staleness": 0,
"active_warnings": 0,
"governance": 6,
"dependency": 0,
"health_score": 0,
"security_sensitivity": 0
}
}JSON payload
{
"plugin": "scm-api",
"score": 6,
"reasons": [
"No advisories found in local dataset.",
"Latest release: 2026-02-04.",
"Requires Jenkins core 2.504.3.",
"Recent commit activity (1 days ago) suggests active maintenance.",
"No SECURITY.md — vulnerability reporting process undocumented (+3).",
"No Dependabot or GitHub Actions detected — limited automated maintenance (+3).",
"Dependency risk: 1 of 3 dep(s) have advisories.",
"Plugin health score 100/100 — acceptable maintenance posture."
],
"features": {
"advisory_count": 0,
"latest_advisory_date": null,
"days_since_latest_advisory": null,
"advisory_within_90d": 0,
"advisory_within_365d": 0,
"had_advisory_within_365d": false,
"max_cvss_base_score_observed": null,
"max_cvss_severity_label_observed": null,
"swh_present": true,
"swh_days_since_last_commit": 1.3,
"swh_commit_count": 11211,
"swh_has_security_md": false,
"swh_has_dependabot": false,
"swh_has_github_actions": false,
"swh_has_tests_directory": true,
"swh_has_changelog": true,
"swh_security_fix_commit_count": 455,
"has_plugin_snapshot": true,
"required_core": "2.504.3",
"dependency_count": 3,
"security_warning_count": 0,
"active_security_warning_count": 0,
"release_timestamp": "2026-02-04T22:56:48+00:00",
"days_since_release": 277,
"dependency_plugins": [
"asm-api",
"commons-lang3-api",
"structs"
],
"dependency_total": 3,
"dependency_risk_points": 2,
"dependency_risk_summary": {
"deps_with_any_advisory": 1,
"deps_with_recent_advisory_365d": 0,
"deps_with_active_warning": 0,
"worst_dep_max_cvss": null,
"worst_dep_id": null,
"worst_dep_latest_advisory_date": null
},
"dependency_missing_data": {
"snapshot_missing": 0,
"advisories_missing": 0,
"healthscore_missing": 0
},
"dependency_details_top": [
{
"plugin_id": "structs",
"advisory_count": 1,
"latest_advisory_date": "2024-06-26",
"recent_advisory_365d": false,
"max_cvss": null,
"security_warning_count": 1,
"active_security_warning_count": 0,
"healthscore": 100,
"risk_points": 2,
"reasons": [
"1 advisories (+2)."
]
}
],
"healthscore_value": 100,
"healthscore_date": "2026-02-05T14:32:38.748203Z",
"healthscore_collected_at": "2026-02-28T16:43:20+00:00",
"score_components": {
"advisory_history": 0,
"advisory_severity": 0,
"staleness": 0,
"active_warnings": 0,
"governance": 6,
"dependency": 0,
"health_score": 0,
"security_sensitivity": 0
}
}
}