Eval results - graded verdicts on capability output, one row per run. About this list · Site contents
ContentType.EvalResult
Lineage: ContentType.Item -> ContentType.EvalResultEval Eval.HealthReview: Pass (Quality)... |
2026-09-23T06:27:07.8943881+00:00 | System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Pass | 100 | 2026-09-23T06:27:07.8957970 | ||
Eval Eval.HealthReview: Pass (Quality)... |
2026-09-22T10:32:06.9310419+00:00 | System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Pass | 100 | 2026-09-22T10:32:06.9319318 | ||
Eval Eval.HealthReview: Degraded (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Degraded | 0 | OutputIsContentType: endpoint degraded: SqlException - Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding. | 2026-09-15T06:50:30.1014073 | ||
Eval Eval.HealthReview: Degraded (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Degraded | 0 | OutputIsContentType: tool-loop provider degraded to the Echo stub mid-run (real provider 504/timeout) - infra, not subject | 2026-09-14T21:00:02.8358312 | ||
Eval Eval.HealthReview: Fail (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Fail | 75 | ToolTrajectory: 'Tool.FetchKnowledge' not called in the declared order; actual [] | 2026-09-14T20:39:03.5404111 | ||
Eval Eval.HealthReview: Degraded (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Degraded | 0 | OutputIsContentType: tool-loop provider degraded to the Echo stub mid-run (real provider 504/timeout) - infra, not subject | 2026-09-07T17:58:02.7628353 | ||
Eval Eval.HealthReview: Degraded (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Degraded | 0 | OutputIsContentType: tool-loop provider degraded to the Echo stub mid-run (real provider 504/timeout) - infra, not subject | 2026-09-07T15:38:02.0056408 | ||
Eval Eval.HealthReview: Degraded (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Degraded | 0 | OutputIsContentType: tool-loop provider degraded to the Echo stub mid-run (real provider 504/timeout) - infra, not subject | 2026-09-07T15:32:02.1817686 | ||
Eval Eval.HealthReview: Degraded (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Degraded | 0 | OutputIsContentType: tool-loop provider degraded to the Echo stub mid-run (real provider 504/timeout) - infra, not subject | 2026-09-07T15:22:02.7564863 | ||
Eval Eval.HealthReview: Fail (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Fail | 75 | ToolTrajectory: 'Tool.FetchKnowledge' not called in the declared order; actual [] | 2026-09-07T15:00:48.9024575 | ||
Eval Eval.HealthReview: Degraded (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Degraded | 0 | OutputIsContentType: tool-loop provider degraded to the Echo stub mid-run (real provider 504/timeout) - infra, not subject | 2026-09-07T12:47:02.4103950 | ||
Eval Eval.HealthReview: Fail (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Fail | 75 | ToolTrajectory: 'Tool.FetchKnowledge' not called in the declared order; actual [] | 2026-09-01T07:43:30.9597647 | ||
Eval Eval.HealthReview: Degraded (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Degraded | 0 | OutputIsContentType: tool-loop provider degraded to the Echo stub mid-run (real provider 504/timeout) - infra, not subject | 2026-08-24T22:56:02.9538091 | ||
Eval Eval.HealthReview: Fail (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Fail | 75 | ToolTrajectory: 'Tool.FetchKnowledge' not called in the declared order; actual [] | 2026-08-24T22:21:22.5791507 | ||
Eval Eval.HealthReview: Fail (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Fail | 75 | ToolTrajectory: 'Tool.FetchKnowledge' not called in the declared order; actual [] | 2026-08-24T21:52:30.0778545 | ||
Eval Eval.HealthReview: Fail (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Fail | 75 | ToolTrajectory: 'Tool.FetchKnowledge' not called in the declared order; actual [] | 2026-08-23T17:33:20.7862283 | ||
Eval Eval.HealthReview: Fail (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Fail | 75 | ToolTrajectory: 'Tool.FetchKnowledge' not called in the declared order; actual [] | 2026-08-23T16:52:32.0994305 | ||
Eval Eval.HealthReview: Fail (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Fail | 75 | ToolTrajectory: 'Tool.FetchKnowledge' not called in the declared order; actual [] | 2026-08-04T14:27:08.3513454 | ||
Eval Eval.HealthReview: Fail (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Fail | 75 | ToolTrajectory: 'Tool.FetchKnowledge' not called in the declared order; actual [] | 2026-08-04T14:11:02.4941595 | ||
Eval Eval.HealthReview: Fail (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Fail | 75 | ToolTrajectory: 'Tool.FetchKnowledge' not called in the declared order; actual [] | 2026-08-04T08:02:21.6904561 | ||
Eval Eval.HealthReview: Pass (Deterministic)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Deterministic | Pass | 100 | 2026-08-04T08:01:39.3702771 | |||
Eval Eval.DeepResearch: Fail (Quality)... |
2026-09-23T06:27:29.7671981+00:00 | System Account (SPICE.Web) | Eval.DeepResearch | Tool.DeepResearch | Quality | Fail | 67 | MinCount: found 0 of 'http', need >= 3 | 2026-09-23T06:27:29.7681046 | |
Eval Eval.DeepResearch: Fail (Quality)... |
2026-09-22T10:32:29.9952464+00:00 | System Account (SPICE.Web) | Eval.DeepResearch | Tool.DeepResearch | Quality | Fail | 67 | MinCount: found 0 of 'http', need >= 3 | 2026-09-22T10:32:29.9963483 | |
Eval Eval.DeepResearch: Fail (Quality)... |
System Account (SPICE.Web) | Eval.DeepResearch | Tool.DeepResearch | Quality | Fail | 67 | Forbid: forbidden '(synthesis unavailable)' present | 2026-09-15T06:52:31.9331279 | ||
Eval Eval.DeepResearch: Fail (Quality)... |
System Account (SPICE.Web) | Eval.DeepResearch | Tool.DeepResearch | Quality | Fail | 67 | Forbid: forbidden '(synthesis unavailable)' present | 2026-09-14T21:02:55.6706868 | ||
Eval Eval.DeepResearch: Fail (Quality)... |
System Account (SPICE.Web) | Eval.DeepResearch | Tool.DeepResearch | Quality | Fail | 67 | Forbid: forbidden '(synthesis unavailable)' present | 2026-09-14T20:45:07.6791937 | ||
Eval Eval.DeepResearch: Fail (Quality)... |
System Account (SPICE.Web) | Eval.DeepResearch | Tool.DeepResearch | Quality | Fail | 67 | Forbid: forbidden '(synthesis unavailable)' present | 2026-09-07T15:28:09.0583260 | ||
Eval Eval.DeepResearch: Fail (Quality)... |
System Account (SPICE.Web) | Eval.DeepResearch | Tool.DeepResearch | Quality | Fail | 67 | Forbid: forbidden '(synthesis unavailable)' present | 2026-09-07T12:50:05.8609581 | ||
Eval Eval.DeepResearch: Fail (Quality)... |
System Account (SPICE.Web) | Eval.DeepResearch | Tool.DeepResearch | Quality | Fail | 67 | MinCount: found 0 of 'http', need >= 3 | 2026-08-24T22:21:41.8362509 | ||
Eval Eval.DeepResearch: Fail (Quality)... |
System Account (SPICE.Web) | Eval.DeepResearch | Tool.DeepResearch | Quality | Fail | 67 | MinCount: found 0 of 'http', need >= 3 | 2026-08-24T21:55:44.3647228 |