Eval results - graded verdicts on capability output, one row per run. About this list · Site contents
ContentType.EvalResult
Lineage: ContentType.Item -> ContentType.EvalResultEval Eval.DailyBrief: Fail (Quality)... |
System Account (SPICE.Web) | Eval.DailyBrief | Workflow.DailyBrief | Quality | Fail | 89 | Forbid: forbidden '[Echo agent' present | 2026-09-15T06:52:31.9614492 | ||
Eval Eval.ResearchFinding: Fail (Quality)... |
System Account (SPICE.Web) | Eval.ResearchFinding | Workflow.Research | Quality | Fail | 80 | Forbid: forbidden '[Echo agent' present | OutputIsContentType: no row landed (output-is-contenttype cannot be checked) | 2026-09-15T06:52:31.9497118 | ||
Eval Eval.DeepResearch: Fail (Quality)... |
System Account (SPICE.Web) | Eval.DeepResearch | Tool.DeepResearch | Quality | Fail | 67 | Forbid: forbidden '(synthesis unavailable)' present | 2026-09-15T06:52:31.9331279 | ||
Eval Eval.HealthReview: Degraded (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Degraded | 0 | OutputIsContentType: endpoint degraded: SqlException - Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding. | 2026-09-15T06:50:30.1014073 | ||
Eval Eval.DailyBrief: Fail (Quality)... |
System Account (SPICE.Web) | Eval.DailyBrief | Workflow.DailyBrief | Quality | Fail | 89 | Forbid: forbidden '[Echo agent' present | 2026-09-14T21:02:55.7131703 | ||
Eval Eval.ResearchFinding: Fail (Quality)... |
System Account (SPICE.Web) | Eval.ResearchFinding | Workflow.Research | Quality | Fail | 80 | Forbid: forbidden '[Echo agent' present | OutputIsContentType: no row landed (output-is-contenttype cannot be checked) | 2026-09-14T21:02:55.6878691 | ||
Eval Eval.DeepResearch: Fail (Quality)... |
System Account (SPICE.Web) | Eval.DeepResearch | Tool.DeepResearch | Quality | Fail | 67 | Forbid: forbidden '(synthesis unavailable)' present | 2026-09-14T21:02:55.6706868 | ||
Eval Eval.HealthReview: Degraded (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Degraded | 0 | OutputIsContentType: tool-loop provider degraded to the Echo stub mid-run (real provider 504/timeout) - infra, not subject | 2026-09-14T21:00:02.8358312 | ||
Eval Eval.DailyBrief: Fail (Quality)... |
System Account (SPICE.Web) | Eval.DailyBrief | Workflow.DailyBrief | Quality | Fail | 89 | Forbid: forbidden '[Echo agent' present | 2026-09-14T20:45:07.7094673 | ||
Eval Eval.ResearchFinding: Fail (Quality)... |
System Account (SPICE.Web) | Eval.ResearchFinding | Workflow.Research | Quality | Fail | 80 | Forbid: forbidden '[Echo agent' present | OutputIsContentType: no row landed (output-is-contenttype cannot be checked) | 2026-09-14T20:45:07.6951919 | ||
Eval Eval.DeepResearch: Fail (Quality)... |
System Account (SPICE.Web) | Eval.DeepResearch | Tool.DeepResearch | Quality | Fail | 67 | Forbid: forbidden '(synthesis unavailable)' present | 2026-09-14T20:45:07.6791937 | ||
Eval Eval.HealthReview: Fail (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Fail | 75 | ToolTrajectory: 'Tool.FetchKnowledge' not called in the declared order; actual [] | 2026-09-14T20:39:03.5404111 | ||
Eval Eval.HealthReview: Degraded (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Degraded | 0 | OutputIsContentType: tool-loop provider degraded to the Echo stub mid-run (real provider 504/timeout) - infra, not subject | 2026-09-07T17:58:02.7628353 | ||
Eval Eval.HealthReview: Degraded (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Degraded | 0 | OutputIsContentType: tool-loop provider degraded to the Echo stub mid-run (real provider 504/timeout) - infra, not subject | 2026-09-07T15:38:02.0056408 | ||
Eval Eval.HealthReview: Degraded (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Degraded | 0 | OutputIsContentType: tool-loop provider degraded to the Echo stub mid-run (real provider 504/timeout) - infra, not subject | 2026-09-07T15:32:02.1817686 | ||
Eval Eval.DailyBrief: Fail (Quality)... |
System Account (SPICE.Web) | Eval.DailyBrief | Workflow.DailyBrief | Quality | Fail | 89 | Forbid: forbidden '[Echo agent' present | 2026-09-07T15:28:09.1078216 | ||
Eval Eval.DeepResearch: Fail (Quality)... |
System Account (SPICE.Web) | Eval.DeepResearch | Tool.DeepResearch | Quality | Fail | 67 | Forbid: forbidden '(synthesis unavailable)' present | 2026-09-07T15:28:09.0583260 | ||
Eval Eval.HealthReview: Degraded (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Degraded | 0 | OutputIsContentType: tool-loop provider degraded to the Echo stub mid-run (real provider 504/timeout) - infra, not subject | 2026-09-07T15:22:02.7564863 | ||
Eval Eval.HealthReview: Fail (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Fail | 75 | ToolTrajectory: 'Tool.FetchKnowledge' not called in the declared order; actual [] | 2026-09-07T15:00:48.9024575 | ||
Eval Eval.DailyBrief: Fail (Quality)... |
System Account (SPICE.Web) | Eval.DailyBrief | Workflow.DailyBrief | Quality | Fail | 89 | Forbid: forbidden '[Echo agent' present | 2026-09-07T12:50:05.8784155 | ||
Eval Eval.DeepResearch: Fail (Quality)... |
System Account (SPICE.Web) | Eval.DeepResearch | Tool.DeepResearch | Quality | Fail | 67 | Forbid: forbidden '(synthesis unavailable)' present | 2026-09-07T12:50:05.8609581 | ||
Eval Eval.HealthReview: Degraded (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Degraded | 0 | OutputIsContentType: tool-loop provider degraded to the Echo stub mid-run (real provider 504/timeout) - infra, not subject | 2026-09-07T12:47:02.4103950 | ||
Eval Eval.HealthReview: Fail (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Fail | 75 | ToolTrajectory: 'Tool.FetchKnowledge' not called in the declared order; actual [] | 2026-09-01T07:43:30.9597647 | ||
Eval Eval.HealthReview: Degraded (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Degraded | 0 | OutputIsContentType: tool-loop provider degraded to the Echo stub mid-run (real provider 504/timeout) - infra, not subject | 2026-08-24T22:56:02.9538091 | ||
Eval Eval.DeepResearch: Fail (Quality)... |
System Account (SPICE.Web) | Eval.DeepResearch | Tool.DeepResearch | Quality | Fail | 67 | MinCount: found 0 of 'http', need >= 3 | 2026-08-24T22:21:41.8362509 | ||
Eval Eval.HealthReview: Fail (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Fail | 75 | ToolTrajectory: 'Tool.FetchKnowledge' not called in the declared order; actual [] | 2026-08-24T22:21:22.5791507 | ||
Eval Eval.DeepResearch: Fail (Quality)... |
System Account (SPICE.Web) | Eval.DeepResearch | Tool.DeepResearch | Quality | Fail | 67 | MinCount: found 0 of 'http', need >= 3 | 2026-08-24T21:55:44.3647228 | ||
Eval Eval.HealthReview: Fail (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Fail | 75 | ToolTrajectory: 'Tool.FetchKnowledge' not called in the declared order; actual [] | 2026-08-24T21:52:30.0778545 | ||
Eval Eval.HealthReview: Fail (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Fail | 75 | ToolTrajectory: 'Tool.FetchKnowledge' not called in the declared order; actual [] | 2026-08-23T17:33:20.7862283 | ||
Eval Eval.HealthReview: Fail (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Fail | 75 | ToolTrajectory: 'Tool.FetchKnowledge' not called in the declared order; actual [] | 2026-08-23T16:52:32.0994305 |