Web interface

CANARY Web Console

A lightweight web UI for scoring Jenkins plugins and exploring ML-based advisory risk.

Plugin scoring

Score a plugin

Review the CANARY score, rationale, and supporting evidence.

Core workflow
Resolved model: baseline_6m

AI explanation

Explain this score

Bring your own AI

Copy the prompt below and paste it into Claude, ChatGPT, or any other AI assistant. You control what gets shared.

Show / edit raw prompt

"Explain now" uses the server API key (max 3/hr). "Open in" buttons use your own account with no limits. AI-generated explanations are provided for informational purposes only, may contain inaccuracies or omissions, and should not be relied upon as authoritative security guidance.

CANARY score

Advisory risk score

Select a model

Select an algorithm, feature set, and evaluation strategy on the left.

Honest track record

Where datadog ranked before each window

Activity-recency clocks + Contributor dynamics · Logistic Regression, embargoed rolling backtest: the rank this plugin held among every scored plugin at each forecast date, using only what was knowable then. Shaded months are the pre-registered holdout.

Recorded, not re-scored

Scored at 32 forecast dates; on average in the top 1.8% of plugins (top 0.44% across the holdout). An advisory followed within 180 days of 2 of those dates.

out-of-time holdout0255075100top 20%2023-052023-092024-012024-052024-092025-012025-052025-092025-122023-05 · rank 37 of 2053 · 98th percentile · score 0.809 advisory followed within 180 days2023-06 · rank 34 of 2053 · 98th percentile · score 0.823 advisory followed within 180 days2023-07 · rank 25 of 2053 · 99th percentile · score 0.846 no advisory within 180 days2023-08 · rank 42 of 2053 · 98th percentile · score 0.789 no advisory within 180 days2023-09 · rank 46 of 2053 · 98th percentile · score 0.781 no advisory within 180 days2023-10 · rank 38 of 2053 · 98th percentile · score 0.797 no advisory within 180 days2023-11 · rank 43 of 2053 · 98th percentile · score 0.797 no advisory within 180 days2023-12 · rank 49 of 2053 · 98th percentile · score 0.767 no advisory within 180 days2024-01 · rank 47 of 2053 · 98th percentile · score 0.767 no advisory within 180 days2024-02 · rank 43 of 2053 · 98th percentile · score 0.788 no advisory within 180 days2024-03 · rank 52 of 2053 · 98th percentile · score 0.770 no advisory within 180 days2024-04 · rank 47 of 2053 · 98th percentile · score 0.770 no advisory within 180 days2024-05 · rank 65 of 2053 · 97th percentile · score 0.733 no advisory within 180 days2024-06 · rank 62 of 2053 · 97th percentile · score 0.738 no advisory within 180 days2024-07 · rank 63 of 2053 · 97th percentile · score 0.726 no advisory within 180 days2024-08 · rank 62 of 2053 · 97th percentile · score 0.732 no advisory within 180 days2024-09 · rank 76 of 2053 · 96th percentile · score 0.706 no advisory within 180 days2024-10 · rank 76 of 2053 · 96th percentile · score 0.706 no advisory within 180 days2024-11 · rank 72 of 2053 · 97th percentile · score 0.708 no advisory within 180 days2024-12 · rank 63 of 2053 · 97th percentile · score 0.706 no advisory within 180 days2025-01 · rank 35 of 2053 · 98th percentile · score 0.724 no advisory within 180 days2025-02 · rank 34 of 2053 · 98th percentile · score 0.722 no advisory within 180 days2025-03 · rank 17 of 2053 · 99th percentile · score 0.764 no advisory within 180 days2025-04 · rank 17 of 2053 · 99th percentile · score 0.769 no advisory within 180 days2025-05 · rank 13 of 2053 · 99th percentile · score 0.797 no advisory within 180 days2025-06 · rank 14 of 2053 · 99th percentile · score 0.794 no advisory within 180 days2025-07 · rank 9 of 2053 · 100th percentile · score 0.804 no advisory within 180 days2025-08 · rank 8 of 2053 · 100th percentile · score 0.804 no advisory within 180 days2025-09 · rank 7 of 2053 · 100th percentile · score 0.817 no advisory within 180 days2025-10 · rank 6 of 2053 · 100th percentile · score 0.812 no advisory within 180 days2025-11 · rank 10 of 2053 · 100th percentile · score 0.759 no advisory within 180 days2025-12 · rank 20 of 2053 · 99th percentile · score 0.736 no advisory within 180 daysadvisory followed within 180 daysno advisory in window
Holdout monthScoreRankShare of panelWhat followed
2025-0780.4%9 of 2,053top 0.39%none within 180 days
2025-0880.4%8 of 2,053top 0.34%none within 180 days
2025-0981.7%7 of 2,053top 0.29%none within 180 days
2025-1081.2%6 of 2,053top 0.24%none within 180 days
2025-1175.9%10 of 2,053top 0.44%none within 180 days
2025-1273.6%20 of 2,053top 0.93%none within 180 days

Risk context

Supporting signals

Maintenance history, governance, and dependency risk indicators for this plugin.

Key risk signals

  • 2 prior advisory record(s) — history +4, recency +0 (0 within 90d, 0 within 365 days); component total +4 (cap 30).
  • No advisory activity in the last 365 days — historical record only.
  • Advisory severity (max CVSS 4.2 — Medium): +3 (cap 15).
  • Latest release: 2026-04-13.
  • Requires Jenkins core 2.361.4.
  • Last commit: April 13, 2026 — live data from GitHub.
  • Recent release activity supports active maintenance.
  • 2 historical security warning(s) — none currently active.
  • No SECURITY.md — vulnerability reporting process undocumented (+3).
  • No Dependabot or GitHub Actions detected — limited automated maintenance (+3).
  • Dependency risk: 8 of 10 dep(s) have advisories; worst: git-client (CVSS 8.8).
  • Plugin health score 93/100 — acceptable maintenance posture.
Feature details (34 keys)
{
  "advisory_count": 2,
  "latest_advisory_date": "2023-07-12",
  "days_since_latest_advisory": 1170,
  "advisory_within_90d": 0,
  "advisory_within_365d": 0,
  "had_advisory_within_365d": false,
  "max_cvss_base_score_observed": 4.2,
  "max_cvss_severity_label_observed": "Medium",
  "swh_present": true,
  "swh_days_since_last_commit": 22.4,
  "swh_commit_count": 14468,
  "swh_has_security_md": false,
  "swh_has_dependabot": false,
  "swh_has_github_actions": false,
  "swh_has_tests_directory": true,
  "swh_has_changelog": true,
  "swh_security_fix_commit_count": 144,
  "has_plugin_snapshot": true,
  "required_core": "2.361.4",
  "dependency_count": 10,
  "security_warning_count": 2,
  "active_security_warning_count": 0,
  "release_timestamp": "2026-04-13T09:15:13+00:00",
  "days_since_release": 164,
  "dependency_plugins": [
    "credentials",
    "git-client",
    "jnr-posix-api",
    "matrix-project",
    "pipeline-model-definition",
    "pipeline-rest-api",
    "plain-credentials",
    "workflow-cps",
    "workflow-durable-task-step",
    "workflow-job"
  ],
  "dependency_total": 10,
  "dependency_risk_points": 64,
  "dependency_risk_summary": {
    "deps_with_any_advisory": 8,
    "deps_with_recent_advisory_365d": 2,
    "deps_with_active_warning": 0,
    "worst_dep_max_cvss": 8.8,
    "worst_dep_id": "git-client",
    "worst_dep_latest_advisory_date": "2026-06-24"
  },
  "dependency_missing_data": {
    "snapshot_missing": 0,
    "advisories_missing": 0,
    "healthscore_missing": 0
  },
  "dependency_details_top": [
    {
      "plugin_id": "git-client",
      "advisory_count": 6,
      "latest_advisory_date": "2026-06-24",
      "recent_advisory_365d": true,
      "max_cvss": 8.8,
      "security_warning_count": 6,
      "active_security_warning_count": 0,
      "healthscore": 100,
      "risk_points": 17,
      "reasons": [
        "6 advisories (+10).",
        "Max CVSS 8.8 (+4).",
        "Recent advisory within 365d (+3)."
      ]
    },
    {
      "plugin_id": "workflow-cps",
      "advisory_count": 11,
      "latest_advisory_date": "2026-06-24",
      "recent_advisory_365d": true,
      "max_cvss": 8.8,
      "security_warning_count": 13,
      "active_security_warning_count": 0,
      "healthscore": 100,
      "risk_points": 17,
      "reasons": [
        "11 advisories (+10).",
        "Max CVSS 8.8 (+4).",
        "Recent advisory within 365d (+3)."
      ]
    },
    {
      "plugin_id": "matrix-project",
      "advisory_count": 4,
      "latest_advisory_date": "2024-01-24",
      "recent_advisory_365d": false,
      "max_cvss": 8.8,
      "security_warning_count": 5,
      "active_security_warning_count": 0,
      "healthscore": 97,
      "risk_points": 12,
      "reasons": [
        "4 advisories (+8).",
        "Max CVSS 8.8 (+4)."
      ]
    },
    {
      "plugin_id": "credentials",
      "advisory_count": 4,
      "latest_advisory_date": "2024-10-02",
      "recent_advisory_365d": false,
      "max_cvss": 4.3,
      "security_warning_count": 4,
      "active_security_warning_count": 0,
      "healthscore": 100,
      "risk_points": 10,
      "reasons": [
        "4 advisories (+8).",
        "Max CVSS 4.3 (+2)."
      ]
    },
    {
      "plugin_id": "pipeline-model-definition",
      "advisory_count": 2,
      "latest_advisory_date": "2024-11-13",
      "recent_advisory_365d": false,
      "max_cvss": 8.0,
      "security_warning_count": 2,
      "active_security_warning_count": 0,
      "healthscore": 96,
      "risk_points": 8,
      "reasons": [
        "2 advisories (+4).",
        "Max CVSS 8.0 (+4)."
      ]
    }
  ],
  "healthscore_value": 93,
  "healthscore_date": "2025-10-09T09:36:43.721554Z",
  "healthscore_collected_at": "2026-02-28T16:43:20+00:00",
  "score_components": {
    "advisory_history": 4,
    "advisory_severity": 3,
    "staleness": 0,
    "active_warnings": 0,
    "governance": 6,
    "dependency": 5,
    "health_score": 0,
    "security_sensitivity": 0
  }
}
JSON payload
{
  "plugin": "datadog",
  "score": 18,
  "reasons": [
    "2 prior advisory record(s) — history +4, recency +0 (0 within 90d, 0 within 365 days); component total +4 (cap 30).",
    "No advisory activity in the last 365 days — historical record only.",
    "Advisory severity (max CVSS 4.2 — Medium): +3 (cap 15).",
    "Latest release: 2026-04-13.",
    "Requires Jenkins core 2.361.4.",
    "Recent commit activity (22 days ago) suggests active maintenance.",
    "Recent release activity supports active maintenance.",
    "2 historical security warning(s) — none currently active.",
    "No SECURITY.md — vulnerability reporting process undocumented (+3).",
    "No Dependabot or GitHub Actions detected — limited automated maintenance (+3).",
    "Dependency risk: 8 of 10 dep(s) have advisories; worst: git-client (CVSS 8.8).",
    "Plugin health score 93/100 — acceptable maintenance posture."
  ],
  "features": {
    "advisory_count": 2,
    "latest_advisory_date": "2023-07-12",
    "days_since_latest_advisory": 1170,
    "advisory_within_90d": 0,
    "advisory_within_365d": 0,
    "had_advisory_within_365d": false,
    "max_cvss_base_score_observed": 4.2,
    "max_cvss_severity_label_observed": "Medium",
    "swh_present": true,
    "swh_days_since_last_commit": 22.4,
    "swh_commit_count": 14468,
    "swh_has_security_md": false,
    "swh_has_dependabot": false,
    "swh_has_github_actions": false,
    "swh_has_tests_directory": true,
    "swh_has_changelog": true,
    "swh_security_fix_commit_count": 144,
    "has_plugin_snapshot": true,
    "required_core": "2.361.4",
    "dependency_count": 10,
    "security_warning_count": 2,
    "active_security_warning_count": 0,
    "release_timestamp": "2026-04-13T09:15:13+00:00",
    "days_since_release": 164,
    "dependency_plugins": [
      "credentials",
      "git-client",
      "jnr-posix-api",
      "matrix-project",
      "pipeline-model-definition",
      "pipeline-rest-api",
      "plain-credentials",
      "workflow-cps",
      "workflow-durable-task-step",
      "workflow-job"
    ],
    "dependency_total": 10,
    "dependency_risk_points": 64,
    "dependency_risk_summary": {
      "deps_with_any_advisory": 8,
      "deps_with_recent_advisory_365d": 2,
      "deps_with_active_warning": 0,
      "worst_dep_max_cvss": 8.8,
      "worst_dep_id": "git-client",
      "worst_dep_latest_advisory_date": "2026-06-24"
    },
    "dependency_missing_data": {
      "snapshot_missing": 0,
      "advisories_missing": 0,
      "healthscore_missing": 0
    },
    "dependency_details_top": [
      {
        "plugin_id": "git-client",
        "advisory_count": 6,
        "latest_advisory_date": "2026-06-24",
        "recent_advisory_365d": true,
        "max_cvss": 8.8,
        "security_warning_count": 6,
        "active_security_warning_count": 0,
        "healthscore": 100,
        "risk_points": 17,
        "reasons": [
          "6 advisories (+10).",
          "Max CVSS 8.8 (+4).",
          "Recent advisory within 365d (+3)."
        ]
      },
      {
        "plugin_id": "workflow-cps",
        "advisory_count": 11,
        "latest_advisory_date": "2026-06-24",
        "recent_advisory_365d": true,
        "max_cvss": 8.8,
        "security_warning_count": 13,
        "active_security_warning_count": 0,
        "healthscore": 100,
        "risk_points": 17,
        "reasons": [
          "11 advisories (+10).",
          "Max CVSS 8.8 (+4).",
          "Recent advisory within 365d (+3)."
        ]
      },
      {
        "plugin_id": "matrix-project",
        "advisory_count": 4,
        "latest_advisory_date": "2024-01-24",
        "recent_advisory_365d": false,
        "max_cvss": 8.8,
        "security_warning_count": 5,
        "active_security_warning_count": 0,
        "healthscore": 97,
        "risk_points": 12,
        "reasons": [
          "4 advisories (+8).",
          "Max CVSS 8.8 (+4)."
        ]
      },
      {
        "plugin_id": "credentials",
        "advisory_count": 4,
        "latest_advisory_date": "2024-10-02",
        "recent_advisory_365d": false,
        "max_cvss": 4.3,
        "security_warning_count": 4,
        "active_security_warning_count": 0,
        "healthscore": 100,
        "risk_points": 10,
        "reasons": [
          "4 advisories (+8).",
          "Max CVSS 4.3 (+2)."
        ]
      },
      {
        "plugin_id": "pipeline-model-definition",
        "advisory_count": 2,
        "latest_advisory_date": "2024-11-13",
        "recent_advisory_365d": false,
        "max_cvss": 8.0,
        "security_warning_count": 2,
        "active_security_warning_count": 0,
        "healthscore": 96,
        "risk_points": 8,
        "reasons": [
          "2 advisories (+4).",
          "Max CVSS 8.0 (+4)."
        ]
      }
    ],
    "healthscore_value": 93,
    "healthscore_date": "2025-10-09T09:36:43.721554Z",
    "healthscore_collected_at": "2026-02-28T16:43:20+00:00",
    "score_components": {
      "advisory_history": 4,
      "advisory_severity": 3,
      "staleness": 0,
      "active_warnings": 0,
      "governance": 6,
      "dependency": 5,
      "health_score": 0,
      "security_sensitivity": 0
    }
  }
}