Eval results - graded verdicts on capability output, one row per run. About this list · Site contents
ContentType.EvalResult
Lineage: ContentType.Item -> ContentType.EvalResultEval Eval.HealthReview: Degraded (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Degraded | 0 | OutputIsContentType: endpoint degraded: SqlException - Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding. | 2026-09-15T06:50:30.1014073 | ||
Eval Eval.HealthReview: Degraded (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Degraded | 0 | OutputIsContentType: tool-loop provider degraded to the Echo stub mid-run (real provider 504/timeout) - infra, not subject | 2026-09-14T21:00:02.8358312 | ||
Eval Eval.HealthReview: Degraded (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Degraded | 0 | OutputIsContentType: tool-loop provider degraded to the Echo stub mid-run (real provider 504/timeout) - infra, not subject | 2026-09-07T17:58:02.7628353 | ||
Eval Eval.HealthReview: Degraded (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Degraded | 0 | OutputIsContentType: tool-loop provider degraded to the Echo stub mid-run (real provider 504/timeout) - infra, not subject | 2026-09-07T15:38:02.0056408 | ||
Eval Eval.HealthReview: Degraded (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Degraded | 0 | OutputIsContentType: tool-loop provider degraded to the Echo stub mid-run (real provider 504/timeout) - infra, not subject | 2026-09-07T15:32:02.1817686 | ||
Eval Eval.HealthReview: Degraded (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Degraded | 0 | OutputIsContentType: tool-loop provider degraded to the Echo stub mid-run (real provider 504/timeout) - infra, not subject | 2026-09-07T15:22:02.7564863 | ||
Eval Eval.HealthReview: Degraded (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Degraded | 0 | OutputIsContentType: tool-loop provider degraded to the Echo stub mid-run (real provider 504/timeout) - infra, not subject | 2026-09-07T12:47:02.4103950 | ||
Eval Eval.HealthReview: Degraded (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Degraded | 0 | OutputIsContentType: tool-loop provider degraded to the Echo stub mid-run (real provider 504/timeout) - infra, not subject | 2026-08-24T22:56:02.9538091 | ||
Eval Eval.CatalogExtract.SolarPanel: Fail (Quality)... |
2026-09-25T10:21:57.7401781+00:00 | System Account (SPICE.Web) | Eval.CatalogExtract.SolarPanel | Workflow.CatalogExtract.SolarPanel | Quality | Fail | 86 | OutputIsContentType: contenttype '' != 'ContentType.SolarPanel' | 2026-09-25T10:21:57.7410732 | |
Eval Eval.CatalogExtract.SolarPanel: Fail (Quality)... |
2026-09-25T10:18:23.5521218+00:00 | System Account (SPICE.Web) | Eval.CatalogExtract.SolarPanel | Workflow.CatalogExtract.SolarPanel | Quality | Fail | 29 | OutputIsContentType: no row landed (output-is-contenttype cannot be checked) | RequiredFields: no row landed (required-fields cannot be checked) | FieldInEnum: no row landed (field-in-enum cannot be checked) | FieldInEnum: no row landed (field-in-enum cannot be checked) | FieldInEnum: no row landed (field-in-enum cannot be checked) | 2026-09-25T10:18:23.5533180 | |
Eval Eval.ResearchFinding: Fail (Quality)... |
2026-09-23T06:27:57.8097623+00:00 | System Account (SPICE.Web) | Eval.ResearchFinding | Workflow.Research | Quality | Fail | 90 | OutputIsContentType: no row landed (output-is-contenttype cannot be checked) | 2026-09-23T06:27:57.8106436 | |
Eval Eval.DeepResearch: Fail (Quality)... |
2026-09-23T06:27:29.7671981+00:00 | System Account (SPICE.Web) | Eval.DeepResearch | Tool.DeepResearch | Quality | Fail | 67 | MinCount: found 0 of 'http', need >= 3 | 2026-09-23T06:27:29.7681046 | |
Eval Eval.ResearchFinding: Fail (Quality)... |
2026-09-22T10:33:03.1682580+00:00 | System Account (SPICE.Web) | Eval.ResearchFinding | Workflow.Research | Quality | Fail | 90 | OutputIsContentType: no row landed (output-is-contenttype cannot be checked) | 2026-09-22T10:33:03.1690544 | |
Eval Eval.DeepResearch: Fail (Quality)... |
2026-09-22T10:32:29.9952464+00:00 | System Account (SPICE.Web) | Eval.DeepResearch | Tool.DeepResearch | Quality | Fail | 67 | MinCount: found 0 of 'http', need >= 3 | 2026-09-22T10:32:29.9963483 | |
Eval Eval.DailyBrief: Fail (Quality)... |
System Account (SPICE.Web) | Eval.DailyBrief | Workflow.DailyBrief | Quality | Fail | 89 | Forbid: forbidden '[Echo agent' present | 2026-09-15T06:52:31.9614492 | ||
Eval Eval.ResearchFinding: Fail (Quality)... |
System Account (SPICE.Web) | Eval.ResearchFinding | Workflow.Research | Quality | Fail | 80 | Forbid: forbidden '[Echo agent' present | OutputIsContentType: no row landed (output-is-contenttype cannot be checked) | 2026-09-15T06:52:31.9497118 | ||
Eval Eval.DeepResearch: Fail (Quality)... |
System Account (SPICE.Web) | Eval.DeepResearch | Tool.DeepResearch | Quality | Fail | 67 | Forbid: forbidden '(synthesis unavailable)' present | 2026-09-15T06:52:31.9331279 | ||
Eval Eval.DailyBrief: Fail (Quality)... |
System Account (SPICE.Web) | Eval.DailyBrief | Workflow.DailyBrief | Quality | Fail | 89 | Forbid: forbidden '[Echo agent' present | 2026-09-14T21:02:55.7131703 | ||
Eval Eval.ResearchFinding: Fail (Quality)... |
System Account (SPICE.Web) | Eval.ResearchFinding | Workflow.Research | Quality | Fail | 80 | Forbid: forbidden '[Echo agent' present | OutputIsContentType: no row landed (output-is-contenttype cannot be checked) | 2026-09-14T21:02:55.6878691 | ||
Eval Eval.DeepResearch: Fail (Quality)... |
System Account (SPICE.Web) | Eval.DeepResearch | Tool.DeepResearch | Quality | Fail | 67 | Forbid: forbidden '(synthesis unavailable)' present | 2026-09-14T21:02:55.6706868 | ||
Eval Eval.DailyBrief: Fail (Quality)... |
System Account (SPICE.Web) | Eval.DailyBrief | Workflow.DailyBrief | Quality | Fail | 89 | Forbid: forbidden '[Echo agent' present | 2026-09-14T20:45:07.7094673 | ||
Eval Eval.ResearchFinding: Fail (Quality)... |
System Account (SPICE.Web) | Eval.ResearchFinding | Workflow.Research | Quality | Fail | 80 | Forbid: forbidden '[Echo agent' present | OutputIsContentType: no row landed (output-is-contenttype cannot be checked) | 2026-09-14T20:45:07.6951919 | ||
Eval Eval.DeepResearch: Fail (Quality)... |
System Account (SPICE.Web) | Eval.DeepResearch | Tool.DeepResearch | Quality | Fail | 67 | Forbid: forbidden '(synthesis unavailable)' present | 2026-09-14T20:45:07.6791937 | ||
Eval Eval.HealthReview: Fail (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Fail | 75 | ToolTrajectory: 'Tool.FetchKnowledge' not called in the declared order; actual [] | 2026-09-14T20:39:03.5404111 | ||
Eval Eval.DailyBrief: Fail (Quality)... |
System Account (SPICE.Web) | Eval.DailyBrief | Workflow.DailyBrief | Quality | Fail | 89 | Forbid: forbidden '[Echo agent' present | 2026-09-07T15:28:09.1078216 | ||
Eval Eval.DeepResearch: Fail (Quality)... |
System Account (SPICE.Web) | Eval.DeepResearch | Tool.DeepResearch | Quality | Fail | 67 | Forbid: forbidden '(synthesis unavailable)' present | 2026-09-07T15:28:09.0583260 | ||
Eval Eval.HealthReview: Fail (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Fail | 75 | ToolTrajectory: 'Tool.FetchKnowledge' not called in the declared order; actual [] | 2026-09-07T15:00:48.9024575 | ||
Eval Eval.DailyBrief: Fail (Quality)... |
System Account (SPICE.Web) | Eval.DailyBrief | Workflow.DailyBrief | Quality | Fail | 89 | Forbid: forbidden '[Echo agent' present | 2026-09-07T12:50:05.8784155 | ||
Eval Eval.DeepResearch: Fail (Quality)... |
System Account (SPICE.Web) | Eval.DeepResearch | Tool.DeepResearch | Quality | Fail | 67 | Forbid: forbidden '(synthesis unavailable)' present | 2026-09-07T12:50:05.8609581 | ||
Eval Eval.HealthReview: Fail (Quality)... |
System Account (SPICE.Web) | Eval.HealthReview | Skill.HealthReview | Quality | Fail | 75 | ToolTrajectory: 'Tool.FetchKnowledge' not called in the declared order; actual [] | 2026-09-01T07:43:30.9597647 |