Web interface

CANARY Web Console

A lightweight web UI for scoring Jenkins plugins and exploring ML-based advisory risk.

Plugin scoring

Score a plugin

Review the CANARY score, rationale, and supporting evidence.

Core workflow
Resolved model: baseline_6m

AI explanation

Explain this score

Bring your own AI

Copy the prompt below and paste it into Claude, ChatGPT, or any other AI assistant. You control what gets shared.

Show / edit raw prompt

"Explain now" uses the server API key (max 3/hr). "Open in" buttons use your own account with no limits. AI-generated explanations are provided for informational purposes only, may contain inaccuracies or omissions, and should not be relied upon as authoritative security guidance.

CANARY score

Advisory risk score

Select a model

Select an algorithm, feature set, and evaluation strategy on the left.

Honest track record

Where azure-vm-agents ranked before each window

Activity-recency clocks + Contributor dynamics · Logistic Regression, embargoed rolling backtest: the rank this plugin held among every scored plugin at each forecast date, using only what was knowable then. Shaded months are the pre-registered holdout.

Recorded, not re-scored

Scored at 32 forecast dates; on average in the top 2.2% of plugins (top 0.93% across the holdout). No advisory followed any of those dates within 180 days.

out-of-time holdout0255075100top 20%2023-052023-092024-012024-052024-092025-012025-052025-092025-122023-05 · rank 148 of 2053 · 93th percentile · score 0.686 no advisory within 180 days2023-06 · rank 67 of 2053 · 97th percentile · score 0.733 no advisory within 180 days2023-07 · rank 57 of 2053 · 97th percentile · score 0.760 no advisory within 180 days2023-08 · rank 76 of 2053 · 96th percentile · score 0.733 no advisory within 180 days2023-09 · rank 75 of 2053 · 96th percentile · score 0.742 no advisory within 180 days2023-10 · rank 67 of 2053 · 97th percentile · score 0.752 no advisory within 180 days2023-11 · rank 61 of 2053 · 97th percentile · score 0.756 no advisory within 180 days2023-12 · rank 45 of 2053 · 98th percentile · score 0.776 no advisory within 180 days2024-01 · rank 53 of 2053 · 97th percentile · score 0.759 no advisory within 180 days2024-02 · rank 54 of 2053 · 97th percentile · score 0.760 no advisory within 180 days2024-03 · rank 51 of 2053 · 98th percentile · score 0.772 no advisory within 180 days2024-04 · rank 44 of 2053 · 98th percentile · score 0.780 no advisory within 180 days2024-05 · rank 44 of 2053 · 98th percentile · score 0.761 no advisory within 180 days2024-06 · rank 52 of 2053 · 98th percentile · score 0.757 no advisory within 180 days2024-07 · rank 71 of 2053 · 97th percentile · score 0.716 no advisory within 180 days2024-08 · rank 78 of 2053 · 96th percentile · score 0.706 no advisory within 180 days2024-09 · rank 53 of 2053 · 97th percentile · score 0.746 no advisory within 180 days2024-10 · rank 54 of 2053 · 97th percentile · score 0.757 no advisory within 180 days2024-11 · rank 21 of 2053 · 99th percentile · score 0.781 no advisory within 180 days2024-12 · rank 27 of 2053 · 99th percentile · score 0.765 no advisory within 180 days2025-01 · rank 17 of 2053 · 99th percentile · score 0.766 no advisory within 180 days2025-02 · rank 24 of 2053 · 99th percentile · score 0.753 no advisory within 180 days2025-03 · rank 23 of 2053 · 99th percentile · score 0.748 no advisory within 180 days2025-04 · rank 23 of 2053 · 99th percentile · score 0.745 no advisory within 180 days2025-05 · rank 31 of 2053 · 99th percentile · score 0.724 no advisory within 180 days2025-06 · rank 28 of 2053 · 99th percentile · score 0.734 no advisory within 180 days2025-07 · rank 25 of 2053 · 99th percentile · score 0.729 no advisory within 180 days2025-08 · rank 26 of 2053 · 99th percentile · score 0.738 no advisory within 180 days2025-09 · rank 24 of 2053 · 99th percentile · score 0.738 no advisory within 180 days2025-10 · rank 11 of 2053 · 100th percentile · score 0.763 no advisory within 180 days2025-11 · rank 13 of 2053 · 99th percentile · score 0.730 no advisory within 180 days2025-12 · rank 21 of 2053 · 99th percentile · score 0.736 no advisory within 180 daysadvisory followed within 180 daysno advisory in window
Holdout monthScoreRankShare of panelWhat followed
2025-0772.9%25 of 2,053top 1.2%none within 180 days
2025-0873.8%26 of 2,053top 1.2%none within 180 days
2025-0973.8%24 of 2,053top 1.1%none within 180 days
2025-1076.3%11 of 2,053top 0.49%none within 180 days
2025-1173.0%13 of 2,053top 0.58%none within 180 days
2025-1273.6%21 of 2,053top 0.97%none within 180 days

Risk context

Supporting signals

Maintenance history, governance, and dependency risk indicators for this plugin.

Key risk signals

  • 2 prior advisory record(s) — history +4, recency +0 (0 within 90d, 0 within 365 days); component total +4 (cap 30).
  • No advisory activity in the last 365 days — historical record only.
  • Advisory severity (max CVSS 5.0 — Medium): +3 (cap 15).
  • Latest release: 2026-04-10.
  • Requires Jenkins core 2.516.3.
  • Last commit: September 21, 2026 — live data from GitHub.
  • Recent release activity supports active maintenance.
  • 5 historical security warning(s) — none currently active.
  • No SECURITY.md — vulnerability reporting process undocumented (+3).
  • No Dependabot or GitHub Actions detected — limited automated maintenance (+3).
  • Dependency risk: 4 of 7 dep(s) have advisories; worst: azure-credentials (CVSS 4.3).
  • Plugin health score 96/100 — acceptable maintenance posture.
Feature details (34 keys)
{
  "advisory_count": 2,
  "latest_advisory_date": "2023-05-16",
  "days_since_latest_advisory": 1227,
  "advisory_within_90d": 0,
  "advisory_within_365d": 0,
  "had_advisory_within_365d": false,
  "max_cvss_base_score_observed": 5.0,
  "max_cvss_severity_label_observed": "Medium",
  "swh_present": true,
  "swh_days_since_last_commit": 0.9,
  "swh_commit_count": 16743,
  "swh_has_security_md": false,
  "swh_has_dependabot": false,
  "swh_has_github_actions": false,
  "swh_has_tests_directory": true,
  "swh_has_changelog": true,
  "swh_security_fix_commit_count": 936,
  "has_plugin_snapshot": true,
  "required_core": "2.516.3",
  "dependency_count": 7,
  "security_warning_count": 5,
  "active_security_warning_count": 0,
  "release_timestamp": "2026-04-10T10:34:10+00:00",
  "days_since_release": 167,
  "dependency_plugins": [
    "azure-credentials",
    "caffeine-api",
    "cloud-stats",
    "commons-lang3-api",
    "credentials",
    "jsch",
    "plain-credentials"
  ],
  "dependency_total": 7,
  "dependency_risk_points": 21,
  "dependency_risk_summary": {
    "deps_with_any_advisory": 4,
    "deps_with_recent_advisory_365d": 0,
    "deps_with_active_warning": 0,
    "worst_dep_max_cvss": 4.3,
    "worst_dep_id": "azure-credentials",
    "worst_dep_latest_advisory_date": "2023-02-15"
  },
  "dependency_missing_data": {
    "snapshot_missing": 0,
    "advisories_missing": 0,
    "healthscore_missing": 0
  },
  "dependency_details_top": [
    {
      "plugin_id": "credentials",
      "advisory_count": 4,
      "latest_advisory_date": "2024-10-02",
      "recent_advisory_365d": false,
      "max_cvss": 4.3,
      "security_warning_count": 4,
      "active_security_warning_count": 0,
      "healthscore": 100,
      "risk_points": 10,
      "reasons": [
        "4 advisories (+8).",
        "Max CVSS 4.3 (+2)."
      ]
    },
    {
      "plugin_id": "azure-credentials",
      "advisory_count": 1,
      "latest_advisory_date": "2023-02-15",
      "recent_advisory_365d": false,
      "max_cvss": 4.3,
      "security_warning_count": 2,
      "active_security_warning_count": 0,
      "healthscore": 96,
      "risk_points": 4,
      "reasons": [
        "1 advisories (+2).",
        "Max CVSS 4.3 (+2)."
      ]
    },
    {
      "plugin_id": "plain-credentials",
      "advisory_count": 1,
      "latest_advisory_date": "2024-06-26",
      "recent_advisory_365d": false,
      "max_cvss": 4.3,
      "security_warning_count": 1,
      "active_security_warning_count": 0,
      "healthscore": 96,
      "risk_points": 4,
      "reasons": [
        "1 advisories (+2).",
        "Max CVSS 4.3 (+2)."
      ]
    },
    {
      "plugin_id": "cloud-stats",
      "advisory_count": 1,
      "latest_advisory_date": "2021-03-30",
      "recent_advisory_365d": false,
      "max_cvss": 3.1,
      "security_warning_count": 1,
      "active_security_warning_count": 0,
      "healthscore": 80,
      "risk_points": 3,
      "reasons": [
        "1 advisories (+2).",
        "Health score 80 (+1)."
      ]
    }
  ],
  "healthscore_value": 96,
  "healthscore_date": "2026-02-23T01:27:29.502048Z",
  "healthscore_collected_at": "2026-02-28T16:43:20+00:00",
  "score_components": {
    "advisory_history": 4,
    "advisory_severity": 3,
    "staleness": 0,
    "active_warnings": 0,
    "governance": 6,
    "dependency": 5,
    "health_score": 0,
    "security_sensitivity": 0
  }
}
JSON payload
{
  "plugin": "azure-vm-agents",
  "score": 18,
  "reasons": [
    "2 prior advisory record(s) — history +4, recency +0 (0 within 90d, 0 within 365 days); component total +4 (cap 30).",
    "No advisory activity in the last 365 days — historical record only.",
    "Advisory severity (max CVSS 5.0 — Medium): +3 (cap 15).",
    "Latest release: 2026-04-10.",
    "Requires Jenkins core 2.516.3.",
    "Recent commit activity (0 days ago) suggests active maintenance.",
    "Recent release activity supports active maintenance.",
    "5 historical security warning(s) — none currently active.",
    "No SECURITY.md — vulnerability reporting process undocumented (+3).",
    "No Dependabot or GitHub Actions detected — limited automated maintenance (+3).",
    "Dependency risk: 4 of 7 dep(s) have advisories; worst: azure-credentials (CVSS 4.3).",
    "Plugin health score 96/100 — acceptable maintenance posture."
  ],
  "features": {
    "advisory_count": 2,
    "latest_advisory_date": "2023-05-16",
    "days_since_latest_advisory": 1227,
    "advisory_within_90d": 0,
    "advisory_within_365d": 0,
    "had_advisory_within_365d": false,
    "max_cvss_base_score_observed": 5.0,
    "max_cvss_severity_label_observed": "Medium",
    "swh_present": true,
    "swh_days_since_last_commit": 0.9,
    "swh_commit_count": 16743,
    "swh_has_security_md": false,
    "swh_has_dependabot": false,
    "swh_has_github_actions": false,
    "swh_has_tests_directory": true,
    "swh_has_changelog": true,
    "swh_security_fix_commit_count": 936,
    "has_plugin_snapshot": true,
    "required_core": "2.516.3",
    "dependency_count": 7,
    "security_warning_count": 5,
    "active_security_warning_count": 0,
    "release_timestamp": "2026-04-10T10:34:10+00:00",
    "days_since_release": 167,
    "dependency_plugins": [
      "azure-credentials",
      "caffeine-api",
      "cloud-stats",
      "commons-lang3-api",
      "credentials",
      "jsch",
      "plain-credentials"
    ],
    "dependency_total": 7,
    "dependency_risk_points": 21,
    "dependency_risk_summary": {
      "deps_with_any_advisory": 4,
      "deps_with_recent_advisory_365d": 0,
      "deps_with_active_warning": 0,
      "worst_dep_max_cvss": 4.3,
      "worst_dep_id": "azure-credentials",
      "worst_dep_latest_advisory_date": "2023-02-15"
    },
    "dependency_missing_data": {
      "snapshot_missing": 0,
      "advisories_missing": 0,
      "healthscore_missing": 0
    },
    "dependency_details_top": [
      {
        "plugin_id": "credentials",
        "advisory_count": 4,
        "latest_advisory_date": "2024-10-02",
        "recent_advisory_365d": false,
        "max_cvss": 4.3,
        "security_warning_count": 4,
        "active_security_warning_count": 0,
        "healthscore": 100,
        "risk_points": 10,
        "reasons": [
          "4 advisories (+8).",
          "Max CVSS 4.3 (+2)."
        ]
      },
      {
        "plugin_id": "azure-credentials",
        "advisory_count": 1,
        "latest_advisory_date": "2023-02-15",
        "recent_advisory_365d": false,
        "max_cvss": 4.3,
        "security_warning_count": 2,
        "active_security_warning_count": 0,
        "healthscore": 96,
        "risk_points": 4,
        "reasons": [
          "1 advisories (+2).",
          "Max CVSS 4.3 (+2)."
        ]
      },
      {
        "plugin_id": "plain-credentials",
        "advisory_count": 1,
        "latest_advisory_date": "2024-06-26",
        "recent_advisory_365d": false,
        "max_cvss": 4.3,
        "security_warning_count": 1,
        "active_security_warning_count": 0,
        "healthscore": 96,
        "risk_points": 4,
        "reasons": [
          "1 advisories (+2).",
          "Max CVSS 4.3 (+2)."
        ]
      },
      {
        "plugin_id": "cloud-stats",
        "advisory_count": 1,
        "latest_advisory_date": "2021-03-30",
        "recent_advisory_365d": false,
        "max_cvss": 3.1,
        "security_warning_count": 1,
        "active_security_warning_count": 0,
        "healthscore": 80,
        "risk_points": 3,
        "reasons": [
          "1 advisories (+2).",
          "Health score 80 (+1)."
        ]
      }
    ],
    "healthscore_value": 96,
    "healthscore_date": "2026-02-23T01:27:29.502048Z",
    "healthscore_collected_at": "2026-02-28T16:43:20+00:00",
    "score_components": {
      "advisory_history": 4,
      "advisory_severity": 3,
      "staleness": 0,
      "active_warnings": 0,
      "governance": 6,
      "dependency": 5,
      "health_score": 0,
      "security_sensitivity": 0
    }
  }
}