Web interface

CANARY Web Console

A lightweight web UI for scoring Jenkins plugins and exploring ML-based advisory risk.

Plugin scoring

Score a plugin

Review the CANARY score, rationale, and supporting evidence.

Core workflow
Resolved model: baseline_6m

AI explanation

Explain this score

Bring your own AI

Copy the prompt below and paste it into Claude, ChatGPT, or any other AI assistant. You control what gets shared.

Show / edit raw prompt

"Explain now" uses the server API key (max 3/hr). "Open in" buttons use your own account with no limits. AI-generated explanations are provided for informational purposes only, may contain inaccuracies or omissions, and should not be relied upon as authoritative security guidance.

CANARY score

Advisory risk score

Select a model

Select an algorithm, feature set, and evaluation strategy on the left.

Honest track record

Where active-directory ranked before each window

Activity-recency clocks + Contributor dynamics · Logistic Regression, embargoed rolling backtest: the rank this plugin held among every scored plugin at each forecast date, using only what was knowable then. Shaded months are the pre-registered holdout.

Recorded, not re-scored

Scored at 32 forecast dates; on average in the top 2.4% of plugins (top 1.9% across the holdout). An advisory followed within 180 days of 4 of those dates.

out-of-time holdout0255075100top 20%2023-052023-092024-012024-052024-092025-012025-052025-092025-122023-05 · rank 74 of 2053 · 96th percentile · score 0.719 advisory followed within 180 days2023-06 · rank 74 of 2053 · 96th percentile · score 0.726 advisory followed within 180 days2023-07 · rank 49 of 2053 · 98th percentile · score 0.768 no advisory within 180 days2023-08 · rank 40 of 2053 · 98th percentile · score 0.798 no advisory within 180 days2023-09 · rank 45 of 2053 · 98th percentile · score 0.784 no advisory within 180 days2023-10 · rank 39 of 2053 · 98th percentile · score 0.797 no advisory within 180 days2023-11 · rank 54 of 2053 · 97th percentile · score 0.764 no advisory within 180 days2023-12 · rank 61 of 2053 · 97th percentile · score 0.750 no advisory within 180 days2024-01 · rank 81 of 2053 · 96th percentile · score 0.716 no advisory within 180 days2024-02 · rank 69 of 2053 · 97th percentile · score 0.725 no advisory within 180 days2024-03 · rank 80 of 2053 · 96th percentile · score 0.720 no advisory within 180 days2024-04 · rank 73 of 2053 · 96th percentile · score 0.721 no advisory within 180 days2024-05 · rank 89 of 2053 · 96th percentile · score 0.698 no advisory within 180 days2024-06 · rank 85 of 2053 · 96th percentile · score 0.701 no advisory within 180 days2024-07 · rank 60 of 2053 · 97th percentile · score 0.732 no advisory within 180 days2024-08 · rank 73 of 2053 · 96th percentile · score 0.713 no advisory within 180 days2024-09 · rank 22 of 2053 · 99th percentile · score 0.773 no advisory within 180 days2024-10 · rank 65 of 2053 · 97th percentile · score 0.728 no advisory within 180 days2024-11 · rank 54 of 2053 · 97th percentile · score 0.747 no advisory within 180 days2024-12 · rank 54 of 2053 · 97th percentile · score 0.733 no advisory within 180 days2025-01 · rank 37 of 2053 · 98th percentile · score 0.717 no advisory within 180 days2025-02 · rank 35 of 2053 · 98th percentile · score 0.721 no advisory within 180 days2025-03 · rank 24 of 2053 · 99th percentile · score 0.747 no advisory within 180 days2025-04 · rank 14 of 2053 · 99th percentile · score 0.778 no advisory within 180 days2025-05 · rank 16 of 2053 · 99th percentile · score 0.773 no advisory within 180 days2025-06 · rank 17 of 2053 · 99th percentile · score 0.764 no advisory within 180 days2025-07 · rank 16 of 2053 · 99th percentile · score 0.768 no advisory within 180 days2025-08 · rank 15 of 2053 · 99th percentile · score 0.757 no advisory within 180 days2025-09 · rank 11 of 2053 · 100th percentile · score 0.776 no advisory within 180 days2025-10 · rank 55 of 2053 · 97th percentile · score 0.670 no advisory within 180 days2025-11 · rank 85 of 2053 · 96th percentile · score 0.649 advisory followed within 180 days2025-12 · rank 56 of 2053 · 97th percentile · score 0.683 advisory followed within 180 daysadvisory followed within 180 daysno advisory in window
Holdout monthScoreRankShare of panelWhat followed
2025-0776.8%16 of 2,053top 0.73%none within 180 days
2025-0875.7%15 of 2,053top 0.68%none within 180 days
2025-0977.6%11 of 2,053top 0.49%none within 180 days
2025-1067.0%55 of 2,053top 2.6%none within 180 days
2025-1164.9%85 of 2,053top 4.1%SECURITY-3659 2026-05-27
2025-1268.3%56 of 2,053top 2.7%SECURITY-3659 2026-05-27

Risk context

Supporting signals

Maintenance history, governance, and dependency risk indicators for this plugin.

Key risk signals

  • 7 prior advisory record(s) — history +14, recency +10 (0 within 90d, 2 within 365 days); component total +24 (cap 30).
  • Advisory severity (max CVSS 9.8 — Critical): +15 (cap 15).
  • Latest release: 2026-07-29.
  • Requires Jenkins core 2.541.3.
  • Last commit: September 21, 2026 — live data from GitHub.
  • Recent release activity supports active maintenance.
  • 11 historical security warning(s) — none currently active.
  • No SECURITY.md — vulnerability reporting process undocumented (+3).
  • No Dependabot or GitHub Actions detected — limited automated maintenance (+3).
  • Dependency risk: 2 of 4 dep(s) have advisories; worst: configuration-as-code (CVSS 6.5).
  • Plugin health score 94/100 — acceptable maintenance posture.
Feature details (34 keys)
{
  "advisory_count": 7,
  "latest_advisory_date": "2026-06-24",
  "days_since_latest_advisory": 92,
  "advisory_within_90d": 0,
  "advisory_within_365d": 2,
  "had_advisory_within_365d": true,
  "max_cvss_base_score_observed": 9.8,
  "max_cvss_severity_label_observed": "Critical",
  "swh_present": true,
  "swh_days_since_last_commit": 2.5,
  "swh_commit_count": 8750,
  "swh_has_security_md": false,
  "swh_has_dependabot": false,
  "swh_has_github_actions": false,
  "swh_has_tests_directory": true,
  "swh_has_changelog": true,
  "swh_security_fix_commit_count": 166,
  "has_plugin_snapshot": true,
  "required_core": "2.541.3",
  "dependency_count": 4,
  "security_warning_count": 11,
  "active_security_warning_count": 0,
  "release_timestamp": "2026-07-29T13:40:52+00:00",
  "days_since_release": 57,
  "dependency_plugins": [
    "caffeine-api",
    "configuration-as-code",
    "ionicons-api",
    "mailer"
  ],
  "dependency_total": 4,
  "dependency_risk_points": 18,
  "dependency_risk_summary": {
    "deps_with_any_advisory": 2,
    "deps_with_recent_advisory_365d": 0,
    "deps_with_active_warning": 0,
    "worst_dep_max_cvss": 6.5,
    "worst_dep_id": "configuration-as-code",
    "worst_dep_latest_advisory_date": "2022-01-12"
  },
  "dependency_missing_data": {
    "snapshot_missing": 0,
    "advisories_missing": 0,
    "healthscore_missing": 0
  },
  "dependency_details_top": [
    {
      "plugin_id": "mailer",
      "advisory_count": 4,
      "latest_advisory_date": "2022-01-12",
      "recent_advisory_365d": false,
      "max_cvss": 4.8,
      "security_warning_count": 4,
      "active_security_warning_count": 0,
      "healthscore": 100,
      "risk_points": 10,
      "reasons": [
        "4 advisories (+8).",
        "Max CVSS 4.8 (+2)."
      ]
    },
    {
      "plugin_id": "configuration-as-code",
      "advisory_count": 3,
      "latest_advisory_date": "2022-01-12",
      "recent_advisory_365d": false,
      "max_cvss": 6.5,
      "security_warning_count": 9,
      "active_security_warning_count": 0,
      "healthscore": 100,
      "risk_points": 8,
      "reasons": [
        "3 advisories (+6).",
        "Max CVSS 6.5 (+2)."
      ]
    }
  ],
  "healthscore_value": 94,
  "healthscore_date": "2026-02-20T01:28:07.52325Z",
  "healthscore_collected_at": "2026-02-28T16:43:20+00:00",
  "score_components": {
    "advisory_history": 24,
    "advisory_severity": 15,
    "staleness": 0,
    "active_warnings": 0,
    "governance": 6,
    "dependency": 4,
    "health_score": 0,
    "security_sensitivity": 0
  }
}
JSON payload
{
  "plugin": "active-directory",
  "score": 49,
  "reasons": [
    "7 prior advisory record(s) — history +14, recency +10 (0 within 90d, 2 within 365 days); component total +24 (cap 30).",
    "Advisory severity (max CVSS 9.8 — Critical): +15 (cap 15).",
    "Latest release: 2026-07-29.",
    "Requires Jenkins core 2.541.3.",
    "Recent commit activity (2 days ago) suggests active maintenance.",
    "Recent release activity supports active maintenance.",
    "11 historical security warning(s) — none currently active.",
    "No SECURITY.md — vulnerability reporting process undocumented (+3).",
    "No Dependabot or GitHub Actions detected — limited automated maintenance (+3).",
    "Dependency risk: 2 of 4 dep(s) have advisories; worst: configuration-as-code (CVSS 6.5).",
    "Plugin health score 94/100 — acceptable maintenance posture."
  ],
  "features": {
    "advisory_count": 7,
    "latest_advisory_date": "2026-06-24",
    "days_since_latest_advisory": 92,
    "advisory_within_90d": 0,
    "advisory_within_365d": 2,
    "had_advisory_within_365d": true,
    "max_cvss_base_score_observed": 9.8,
    "max_cvss_severity_label_observed": "Critical",
    "swh_present": true,
    "swh_days_since_last_commit": 2.5,
    "swh_commit_count": 8750,
    "swh_has_security_md": false,
    "swh_has_dependabot": false,
    "swh_has_github_actions": false,
    "swh_has_tests_directory": true,
    "swh_has_changelog": true,
    "swh_security_fix_commit_count": 166,
    "has_plugin_snapshot": true,
    "required_core": "2.541.3",
    "dependency_count": 4,
    "security_warning_count": 11,
    "active_security_warning_count": 0,
    "release_timestamp": "2026-07-29T13:40:52+00:00",
    "days_since_release": 57,
    "dependency_plugins": [
      "caffeine-api",
      "configuration-as-code",
      "ionicons-api",
      "mailer"
    ],
    "dependency_total": 4,
    "dependency_risk_points": 18,
    "dependency_risk_summary": {
      "deps_with_any_advisory": 2,
      "deps_with_recent_advisory_365d": 0,
      "deps_with_active_warning": 0,
      "worst_dep_max_cvss": 6.5,
      "worst_dep_id": "configuration-as-code",
      "worst_dep_latest_advisory_date": "2022-01-12"
    },
    "dependency_missing_data": {
      "snapshot_missing": 0,
      "advisories_missing": 0,
      "healthscore_missing": 0
    },
    "dependency_details_top": [
      {
        "plugin_id": "mailer",
        "advisory_count": 4,
        "latest_advisory_date": "2022-01-12",
        "recent_advisory_365d": false,
        "max_cvss": 4.8,
        "security_warning_count": 4,
        "active_security_warning_count": 0,
        "healthscore": 100,
        "risk_points": 10,
        "reasons": [
          "4 advisories (+8).",
          "Max CVSS 4.8 (+2)."
        ]
      },
      {
        "plugin_id": "configuration-as-code",
        "advisory_count": 3,
        "latest_advisory_date": "2022-01-12",
        "recent_advisory_365d": false,
        "max_cvss": 6.5,
        "security_warning_count": 9,
        "active_security_warning_count": 0,
        "healthscore": 100,
        "risk_points": 8,
        "reasons": [
          "3 advisories (+6).",
          "Max CVSS 6.5 (+2)."
        ]
      }
    ],
    "healthscore_value": 94,
    "healthscore_date": "2026-02-20T01:28:07.52325Z",
    "healthscore_collected_at": "2026-02-28T16:43:20+00:00",
    "score_components": {
      "advisory_history": 24,
      "advisory_severity": 15,
      "staleness": 0,
      "active_warnings": 0,
      "governance": 6,
      "dependency": 4,
      "health_score": 0,
      "security_sensitivity": 0
    }
  }
}