Web interface

CANARY Web Console

A lightweight web UI for scoring Jenkins plugins and exploring ML-based advisory risk.

Plugin scoring

Score a plugin

Review the CANARY score, rationale, and supporting evidence.

Core workflow
Resolved model: baseline_6m

AI explanation

Explain this score

Bring your own AI

Copy the prompt below and paste it into Claude, ChatGPT, or any other AI assistant. You control what gets shared.

Show / edit raw prompt

"Explain now" uses the server API key (max 3/hr). "Open in" buttons use your own account with no limits. AI-generated explanations are provided for informational purposes only, may contain inaccuracies or omissions, and should not be relied upon as authoritative security guidance.

CANARY score

Advisory risk score

Select a model

Select an algorithm, feature set, and evaluation strategy on the left.

Honest track record

Where ldap ranked before each window

Activity-recency clocks + Contributor dynamics · Logistic Regression, embargoed rolling backtest: the rank this plugin held among every scored plugin at each forecast date, using only what was knowable then. Shaded months are the pre-registered holdout.

Recorded, not re-scored

Scored at 32 forecast dates; on average in the top 1.5% of plugins (top 1.6% across the holdout). An advisory followed within 180 days of 2 of those dates.

out-of-time holdout0255075100top 20%2023-052023-092024-012024-052024-092025-012025-052025-092025-122023-05 · rank 36 of 2053 · 98th percentile · score 0.809 no advisory within 180 days2023-06 · rank 42 of 2053 · 98th percentile · score 0.798 no advisory within 180 days2023-07 · rank 39 of 2053 · 98th percentile · score 0.803 no advisory within 180 days2023-08 · rank 26 of 2053 · 99th percentile · score 0.834 no advisory within 180 days2023-09 · rank 23 of 2053 · 99th percentile · score 0.859 no advisory within 180 days2023-10 · rank 25 of 2053 · 99th percentile · score 0.849 no advisory within 180 days2023-11 · rank 28 of 2053 · 99th percentile · score 0.839 no advisory within 180 days2023-12 · rank 25 of 2053 · 99th percentile · score 0.851 no advisory within 180 days2024-01 · rank 34 of 2053 · 98th percentile · score 0.831 no advisory within 180 days2024-02 · rank 32 of 2053 · 98th percentile · score 0.842 no advisory within 180 days2024-03 · rank 34 of 2053 · 98th percentile · score 0.840 no advisory within 180 days2024-04 · rank 39 of 2053 · 98th percentile · score 0.798 no advisory within 180 days2024-05 · rank 40 of 2053 · 98th percentile · score 0.785 no advisory within 180 days2024-06 · rank 44 of 2053 · 98th percentile · score 0.783 no advisory within 180 days2024-07 · rank 46 of 2053 · 98th percentile · score 0.760 no advisory within 180 days2024-08 · rank 22 of 2053 · 99th percentile · score 0.781 no advisory within 180 days2024-09 · rank 9 of 2053 · 100th percentile · score 0.826 no advisory within 180 days2024-10 · rank 16 of 2053 · 99th percentile · score 0.799 no advisory within 180 days2024-11 · rank 15 of 2053 · 99th percentile · score 0.797 no advisory within 180 days2024-12 · rank 20 of 2053 · 99th percentile · score 0.769 no advisory within 180 days2025-01 · rank 34 of 2053 · 98th percentile · score 0.726 no advisory within 180 days2025-02 · rank 49 of 2053 · 98th percentile · score 0.702 no advisory within 180 days2025-03 · rank 20 of 2053 · 99th percentile · score 0.756 no advisory within 180 days2025-04 · rank 31 of 2053 · 99th percentile · score 0.731 no advisory within 180 days2025-05 · rank 25 of 2053 · 99th percentile · score 0.735 no advisory within 180 days2025-06 · rank 39 of 2053 · 98th percentile · score 0.700 no advisory within 180 days2025-07 · rank 34 of 2053 · 98th percentile · score 0.706 no advisory within 180 days2025-08 · rank 48 of 2053 · 98th percentile · score 0.688 no advisory within 180 days2025-09 · rank 10 of 2053 · 100th percentile · score 0.783 no advisory within 180 days2025-10 · rank 27 of 2053 · 99th percentile · score 0.724 no advisory within 180 days2025-11 · rank 22 of 2053 · 99th percentile · score 0.710 advisory followed within 180 days2025-12 · rank 58 of 2053 · 97th percentile · score 0.679 advisory followed within 180 daysadvisory followed within 180 daysno advisory in window
Holdout monthScoreRankShare of panelWhat followed
2025-0770.6%34 of 2,053top 1.6%none within 180 days
2025-0868.8%48 of 2,053top 2.3%none within 180 days
2025-0978.3%10 of 2,053top 0.44%none within 180 days
2025-1072.4%27 of 2,053top 1.3%none within 180 days
2025-1171.0%22 of 2,053top 1.0%SECURITY-3654 2026-05-27
2025-1267.9%58 of 2,053top 2.8%SECURITY-3654 2026-05-27

Risk context

Supporting signals

Maintenance history, governance, and dependency risk indicators for this plugin.

Key risk signals

  • 2 prior advisory record(s) — history +4, recency +5 (0 within 90d, 1 within 365 days); component total +9 (cap 30).
  • Advisory severity (max CVSS 6.6 — Medium): +6 (cap 15).
  • Latest release: 2026-05-20.
  • Requires Jenkins core 2.504.3.
  • Last commit: September 21, 2026 — live data from GitHub.
  • Recent release activity supports active maintenance.
  • 2 historical security warning(s) — none currently active.
  • No SECURITY.md — vulnerability reporting process undocumented (+3).
  • No Dependabot or GitHub Actions detected — limited automated maintenance (+3).
  • Dependency risk: 1 of 1 dep(s) have advisories; worst: mailer (CVSS 4.8).
  • Plugin health score 97/100 — acceptable maintenance posture.
  • Plugin name suggests auth/security sensitivity (ldap): +20 (cap 20).
Feature details (34 keys)
{
  "advisory_count": 2,
  "latest_advisory_date": "2026-05-27",
  "days_since_latest_advisory": 120,
  "advisory_within_90d": 0,
  "advisory_within_365d": 1,
  "had_advisory_within_365d": true,
  "max_cvss_base_score_observed": 6.6,
  "max_cvss_severity_label_observed": "Medium",
  "swh_present": true,
  "swh_days_since_last_commit": 10.4,
  "swh_commit_count": 12161,
  "swh_has_security_md": false,
  "swh_has_dependabot": false,
  "swh_has_github_actions": false,
  "swh_has_tests_directory": true,
  "swh_has_changelog": true,
  "swh_security_fix_commit_count": 222,
  "has_plugin_snapshot": true,
  "required_core": "2.504.3",
  "dependency_count": 1,
  "security_warning_count": 2,
  "active_security_warning_count": 0,
  "release_timestamp": "2026-05-20T11:06:25+00:00",
  "days_since_release": 127,
  "dependency_plugins": [
    "mailer"
  ],
  "dependency_total": 1,
  "dependency_risk_points": 10,
  "dependency_risk_summary": {
    "deps_with_any_advisory": 1,
    "deps_with_recent_advisory_365d": 0,
    "deps_with_active_warning": 0,
    "worst_dep_max_cvss": 4.8,
    "worst_dep_id": "mailer",
    "worst_dep_latest_advisory_date": "2022-01-12"
  },
  "dependency_missing_data": {
    "snapshot_missing": 0,
    "advisories_missing": 0,
    "healthscore_missing": 0
  },
  "dependency_details_top": [
    {
      "plugin_id": "mailer",
      "advisory_count": 4,
      "latest_advisory_date": "2022-01-12",
      "recent_advisory_365d": false,
      "max_cvss": 4.8,
      "security_warning_count": 4,
      "active_security_warning_count": 0,
      "healthscore": 100,
      "risk_points": 10,
      "reasons": [
        "4 advisories (+8).",
        "Max CVSS 4.8 (+2)."
      ]
    }
  ],
  "healthscore_value": 97,
  "healthscore_date": "2026-01-29T03:27:23.763981Z",
  "healthscore_collected_at": "2026-02-28T16:43:20+00:00",
  "score_components": {
    "advisory_history": 9,
    "advisory_severity": 6,
    "staleness": 0,
    "active_warnings": 0,
    "governance": 6,
    "dependency": 2,
    "health_score": 0,
    "security_sensitivity": 20
  }
}
JSON payload
{
  "plugin": "ldap",
  "score": 43,
  "reasons": [
    "2 prior advisory record(s) — history +4, recency +5 (0 within 90d, 1 within 365 days); component total +9 (cap 30).",
    "Advisory severity (max CVSS 6.6 — Medium): +6 (cap 15).",
    "Latest release: 2026-05-20.",
    "Requires Jenkins core 2.504.3.",
    "Recent commit activity (10 days ago) suggests active maintenance.",
    "Recent release activity supports active maintenance.",
    "2 historical security warning(s) — none currently active.",
    "No SECURITY.md — vulnerability reporting process undocumented (+3).",
    "No Dependabot or GitHub Actions detected — limited automated maintenance (+3).",
    "Dependency risk: 1 of 1 dep(s) have advisories; worst: mailer (CVSS 4.8).",
    "Plugin health score 97/100 — acceptable maintenance posture.",
    "Plugin name suggests auth/security sensitivity (ldap): +20 (cap 20)."
  ],
  "features": {
    "advisory_count": 2,
    "latest_advisory_date": "2026-05-27",
    "days_since_latest_advisory": 120,
    "advisory_within_90d": 0,
    "advisory_within_365d": 1,
    "had_advisory_within_365d": true,
    "max_cvss_base_score_observed": 6.6,
    "max_cvss_severity_label_observed": "Medium",
    "swh_present": true,
    "swh_days_since_last_commit": 10.4,
    "swh_commit_count": 12161,
    "swh_has_security_md": false,
    "swh_has_dependabot": false,
    "swh_has_github_actions": false,
    "swh_has_tests_directory": true,
    "swh_has_changelog": true,
    "swh_security_fix_commit_count": 222,
    "has_plugin_snapshot": true,
    "required_core": "2.504.3",
    "dependency_count": 1,
    "security_warning_count": 2,
    "active_security_warning_count": 0,
    "release_timestamp": "2026-05-20T11:06:25+00:00",
    "days_since_release": 127,
    "dependency_plugins": [
      "mailer"
    ],
    "dependency_total": 1,
    "dependency_risk_points": 10,
    "dependency_risk_summary": {
      "deps_with_any_advisory": 1,
      "deps_with_recent_advisory_365d": 0,
      "deps_with_active_warning": 0,
      "worst_dep_max_cvss": 4.8,
      "worst_dep_id": "mailer",
      "worst_dep_latest_advisory_date": "2022-01-12"
    },
    "dependency_missing_data": {
      "snapshot_missing": 0,
      "advisories_missing": 0,
      "healthscore_missing": 0
    },
    "dependency_details_top": [
      {
        "plugin_id": "mailer",
        "advisory_count": 4,
        "latest_advisory_date": "2022-01-12",
        "recent_advisory_365d": false,
        "max_cvss": 4.8,
        "security_warning_count": 4,
        "active_security_warning_count": 0,
        "healthscore": 100,
        "risk_points": 10,
        "reasons": [
          "4 advisories (+8).",
          "Max CVSS 4.8 (+2)."
        ]
      }
    ],
    "healthscore_value": 97,
    "healthscore_date": "2026-01-29T03:27:23.763981Z",
    "healthscore_collected_at": "2026-02-28T16:43:20+00:00",
    "score_components": {
      "advisory_history": 9,
      "advisory_severity": 6,
      "staleness": 0,
      "active_warnings": 0,
      "governance": 6,
      "dependency": 2,
      "health_score": 0,
      "security_sensitivity": 20
    }
  }
}