SPICE

Hub › Lists › EvalResults

Eval results - graded verdicts on capability output, one row per run. About this list · Site contents

EvalResultsCheck items, then use the ITEMS tab; list tools are on the LIST tab.
Manage
Manage Views
Share & Track
This siteDocumentsDropOffLibraryRoutingRulesDocumentsActorsCopilotsInboxConversationsSavedSearchesHealthIssuesEvalResultsWorkflowHistory
30 items of 66 Next ▶All lists
ContentType: ContentType.EvalResult   Lineage: ContentType.Item -> ContentType.EvalResult
Title *
CreatedAt
Author
EvalId *
EvalTarget *
EvalTier *
EvalOutcome *
EvalScore ▼
EvalFailedAssertions
Modified
Eval Eval.ResearchFinding: Fail (Quality)
...
2026-09-23T06:27:57.8097623+00:00 System Account (SPICE.Web) Eval.ResearchFinding Workflow.Research Quality Fail 90 OutputIsContentType: no row landed (output-is-contenttype cannot be checked) 2026-09-23T06:27:57.8106436
Eval Eval.ResearchFinding: Fail (Quality)
...
2026-09-22T10:33:03.1682580+00:00 System Account (SPICE.Web) Eval.ResearchFinding Workflow.Research Quality Fail 90 OutputIsContentType: no row landed (output-is-contenttype cannot be checked) 2026-09-22T10:33:03.1690544
Eval Eval.DailyBrief: Fail (Quality)
...
System Account (SPICE.Web) Eval.DailyBrief Workflow.DailyBrief Quality Fail 89 Forbid: forbidden '[Echo agent' present 2026-09-15T06:52:31.9614492
Eval Eval.DailyBrief: Fail (Quality)
...
System Account (SPICE.Web) Eval.DailyBrief Workflow.DailyBrief Quality Fail 89 Forbid: forbidden '[Echo agent' present 2026-09-14T21:02:55.7131703
Eval Eval.DailyBrief: Fail (Quality)
...
System Account (SPICE.Web) Eval.DailyBrief Workflow.DailyBrief Quality Fail 89 Forbid: forbidden '[Echo agent' present 2026-09-14T20:45:07.7094673
Eval Eval.DailyBrief: Fail (Quality)
...
System Account (SPICE.Web) Eval.DailyBrief Workflow.DailyBrief Quality Fail 89 Forbid: forbidden '[Echo agent' present 2026-09-07T15:28:09.1078216
Eval Eval.DailyBrief: Fail (Quality)
...
System Account (SPICE.Web) Eval.DailyBrief Workflow.DailyBrief Quality Fail 89 Forbid: forbidden '[Echo agent' present 2026-09-07T12:50:05.8784155
Eval Eval.DailyBrief: Fail (Quality)
...
Eval.DailyBrief Workflow.DailyBrief Quality Fail 88 Forbid: forbidden '[Echo agent' present 2026-07-11T18:36:13.8855574
Eval Eval.DailyBrief: Fail (Quality)
...
Eval.DailyBrief Workflow.DailyBrief Quality Fail 88 Forbid: echo 2026-07-07T16:34:49.0400609
Eval Eval.CatalogExtract.SolarPanel: Fail (Quality)
...
2026-09-25T10:21:57.7401781+00:00 System Account (SPICE.Web) Eval.CatalogExtract.SolarPanel Workflow.CatalogExtract.SolarPanel Quality Fail 86 OutputIsContentType: contenttype '' != 'ContentType.SolarPanel' 2026-09-25T10:21:57.7410732
Eval Eval.ResearchFinding: Fail (Quality)
...
System Account (SPICE.Web) Eval.ResearchFinding Workflow.Research Quality Fail 80 Forbid: forbidden '[Echo agent' present | OutputIsContentType: no row landed (output-is-contenttype cannot be checked) 2026-09-15T06:52:31.9497118
Eval Eval.ResearchFinding: Fail (Quality)
...
System Account (SPICE.Web) Eval.ResearchFinding Workflow.Research Quality Fail 80 Forbid: forbidden '[Echo agent' present | OutputIsContentType: no row landed (output-is-contenttype cannot be checked) 2026-09-14T21:02:55.6878691
Eval Eval.ResearchFinding: Fail (Quality)
...
System Account (SPICE.Web) Eval.ResearchFinding Workflow.Research Quality Fail 80 Forbid: forbidden '[Echo agent' present | OutputIsContentType: no row landed (output-is-contenttype cannot be checked) 2026-09-14T20:45:07.6951919
Eval Eval.HealthReview: Fail (Quality)
...
System Account (SPICE.Web) Eval.HealthReview Skill.HealthReview Quality Fail 75 ToolTrajectory: 'Tool.FetchKnowledge' not called in the declared order; actual [] 2026-09-14T20:39:03.5404111
Eval Eval.HealthReview: Fail (Quality)
...
System Account (SPICE.Web) Eval.HealthReview Skill.HealthReview Quality Fail 75 ToolTrajectory: 'Tool.FetchKnowledge' not called in the declared order; actual [] 2026-09-07T15:00:48.9024575
Eval Eval.HealthReview: Fail (Quality)
...
System Account (SPICE.Web) Eval.HealthReview Skill.HealthReview Quality Fail 75 ToolTrajectory: 'Tool.FetchKnowledge' not called in the declared order; actual [] 2026-09-01T07:43:30.9597647
Eval Eval.HealthReview: Fail (Quality)
...
System Account (SPICE.Web) Eval.HealthReview Skill.HealthReview Quality Fail 75 ToolTrajectory: 'Tool.FetchKnowledge' not called in the declared order; actual [] 2026-08-24T22:21:22.5791507
Eval Eval.HealthReview: Fail (Quality)
...
System Account (SPICE.Web) Eval.HealthReview Skill.HealthReview Quality Fail 75 ToolTrajectory: 'Tool.FetchKnowledge' not called in the declared order; actual [] 2026-08-24T21:52:30.0778545
Eval Eval.HealthReview: Fail (Quality)
...
System Account (SPICE.Web) Eval.HealthReview Skill.HealthReview Quality Fail 75 ToolTrajectory: 'Tool.FetchKnowledge' not called in the declared order; actual [] 2026-08-23T17:33:20.7862283
Eval Eval.HealthReview: Fail (Quality)
...
System Account (SPICE.Web) Eval.HealthReview Skill.HealthReview Quality Fail 75 ToolTrajectory: 'Tool.FetchKnowledge' not called in the declared order; actual [] 2026-08-23T16:52:32.0994305
Eval Eval.HealthReview: Fail (Quality)
...
System Account (SPICE.Web) Eval.HealthReview Skill.HealthReview Quality Fail 75 ToolTrajectory: 'Tool.FetchKnowledge' not called in the declared order; actual [] 2026-08-04T14:27:08.3513454
Eval Eval.HealthReview: Fail (Quality)
...
System Account (SPICE.Web) Eval.HealthReview Skill.HealthReview Quality Fail 75 ToolTrajectory: 'Tool.FetchKnowledge' not called in the declared order; actual [] 2026-08-04T14:11:02.4941595
Eval Eval.HealthReview: Fail (Quality)
...
System Account (SPICE.Web) Eval.HealthReview Skill.HealthReview Quality Fail 75 ToolTrajectory: 'Tool.FetchKnowledge' not called in the declared order; actual [] 2026-08-04T08:02:21.6904561
Eval Eval.DeepResearch: Fail (Quality)
...
2026-09-23T06:27:29.7671981+00:00 System Account (SPICE.Web) Eval.DeepResearch Tool.DeepResearch Quality Fail 67 MinCount: found 0 of 'http', need >= 3 2026-09-23T06:27:29.7681046
Eval Eval.DeepResearch: Fail (Quality)
...
2026-09-22T10:32:29.9952464+00:00 System Account (SPICE.Web) Eval.DeepResearch Tool.DeepResearch Quality Fail 67 MinCount: found 0 of 'http', need >= 3 2026-09-22T10:32:29.9963483
Eval Eval.DeepResearch: Fail (Quality)
...
System Account (SPICE.Web) Eval.DeepResearch Tool.DeepResearch Quality Fail 67 Forbid: forbidden '(synthesis unavailable)' present 2026-09-15T06:52:31.9331279
Eval Eval.DeepResearch: Fail (Quality)
...
System Account (SPICE.Web) Eval.DeepResearch Tool.DeepResearch Quality Fail 67 Forbid: forbidden '(synthesis unavailable)' present 2026-09-14T21:02:55.6706868
Eval Eval.DeepResearch: Fail (Quality)
...
System Account (SPICE.Web) Eval.DeepResearch Tool.DeepResearch Quality Fail 67 Forbid: forbidden '(synthesis unavailable)' present 2026-09-14T20:45:07.6791937
Eval Eval.DeepResearch: Fail (Quality)
...
System Account (SPICE.Web) Eval.DeepResearch Tool.DeepResearch Quality Fail 67 Forbid: forbidden '(synthesis unavailable)' present 2026-09-07T15:28:09.0583260
Eval Eval.DeepResearch: Fail (Quality)
...
System Account (SPICE.Web) Eval.DeepResearch Tool.DeepResearch Quality Fail 67 Forbid: forbidden '(synthesis unavailable)' present 2026-09-07T12:50:05.8609581