EvalResults

Eval results - graded verdicts on capability output, one row per run. About this list · Site contents

BROWSEITEMSLIST

EvalResultsCheck items, then use the ITEMS tab; list tools are on the LIST tab.

Manage

Standard View Board: EvalTier Board: EvalOutcome

View Format

Manage Views

RSS Feed Export to Excel

Share & Track

List Settings Recycle Bin

Settings

This siteDocuments DropOffLibrary RoutingRules Documents Actors Copilots Inbox Conversations SavedSearches Health Issues EvalResults WorkflowHistory

Title

EvalId

EvalTarget

EvalTier

EvalOutcome

ContentType: ContentType.EvalResult Lineage: ContentType.Item -> ContentType.EvalResult

Title * Ascending Descending Filter by Title Eval Eval.CatalogExtract.SolarPanel: Fail (Quality) (2) Eval Eval.CatalogExtract.SolarPanel: Pass (Quality) (1) Eval Eval.DailyBrief: Fail (Quality) (7) Eval Eval.DailyBrief: Pass (Quality) (19) Eval Eval.DeepResearch: Fail (Quality) (9) Eval Eval.DeepResearch: Pass (Quality) (2) Eval Eval.HealthReview: Degraded (Quality) (8) Eval Eval.HealthReview: Fail (Quality) (10) Eval Eval.HealthReview: Pass (Deterministic) (1) Eval Eval.HealthReview: Pass (Quality) (2) Eval Eval.ResearchFinding: Fail (Quality) (5)	CreatedAt Ascending Descending	Author Ascending Descending	EvalId * Ascending Descending Filter by EvalId Eval.CatalogExtract.SolarPanel (3) Eval.DailyBrief (26) Eval.DeepResearch (11) Eval.HealthReview (21) Eval.ResearchFinding (5)	EvalTarget * Ascending Descending Filter by EvalTarget Skill.HealthReview (21) Tool.DeepResearch (11) Workflow.CatalogExtract.SolarPanel (3) Workflow.DailyBrief (26) Workflow.Research (5)	EvalTier * Ascending Descending Filter by EvalTier Deterministic (1) Quality (65)	EvalOutcome * Ascending Descending Filter by EvalOutcome Degraded (8) Fail (33) Pass (25)	EvalScore Ascending Descending	EvalFailedAssertions Ascending Descending	Modified Ascending Descending
Eval Eval.CatalogExtract.SolarPanel: Pass (Quality) ... View Item Version History	2026-09-25T10:26:53.2080372+00:00	System Account (SPICE.Web)	Eval.CatalogExtract.SolarPanel	Workflow.CatalogExtract.SolarPanel	Quality	Pass	100		2026-09-25T10:26:53.2088955
Eval Eval.CatalogExtract.SolarPanel: Fail (Quality) ... View Item Version History	2026-09-25T10:21:57.7401781+00:00	System Account (SPICE.Web)	Eval.CatalogExtract.SolarPanel	Workflow.CatalogExtract.SolarPanel	Quality	Fail	86	OutputIsContentType: contenttype '' != 'ContentType.SolarPanel'	2026-09-25T10:21:57.7410732
Eval Eval.CatalogExtract.SolarPanel: Fail (Quality) ... View Item Version History	2026-09-25T10:18:23.5521218+00:00	System Account (SPICE.Web)	Eval.CatalogExtract.SolarPanel	Workflow.CatalogExtract.SolarPanel	Quality	Fail	29	OutputIsContentType: no row landed (output-is-contenttype cannot be checked) \| RequiredFields: no row landed (required-fields cannot be checked) \| FieldInEnum: no row landed (field-in-enum cannot be checked) \| FieldInEnum: no row landed (field-in-enum cannot be checked) \| FieldInEnum: no row landed (field-in-enum cannot be checked)	2026-09-25T10:18:23.5533180
Eval Eval.DailyBrief: Pass (Quality) ... View Item Version History	2026-09-23T06:28:15.9420642+00:00	System Account (SPICE.Web)	Eval.DailyBrief	Workflow.DailyBrief	Quality	Pass	100		2026-09-23T06:28:15.9429653
Eval Eval.ResearchFinding: Fail (Quality) ... View Item Version History	2026-09-23T06:27:57.8097623+00:00	System Account (SPICE.Web)	Eval.ResearchFinding	Workflow.Research	Quality	Fail	90	OutputIsContentType: no row landed (output-is-contenttype cannot be checked)	2026-09-23T06:27:57.8106436
Eval Eval.DeepResearch: Fail (Quality) ... View Item Version History	2026-09-23T06:27:29.7671981+00:00	System Account (SPICE.Web)	Eval.DeepResearch	Tool.DeepResearch	Quality	Fail	67	MinCount: found 0 of 'http', need >= 3	2026-09-23T06:27:29.7681046
Eval Eval.HealthReview: Pass (Quality) ... View Item Version History	2026-09-23T06:27:07.8943881+00:00	System Account (SPICE.Web)	Eval.HealthReview	Skill.HealthReview	Quality	Pass	100		2026-09-23T06:27:07.8957970
Eval Eval.DailyBrief: Pass (Quality) ... View Item Version History	2026-09-22T10:33:22.9313312+00:00	System Account (SPICE.Web)	Eval.DailyBrief	Workflow.DailyBrief	Quality	Pass	100		2026-09-22T10:33:22.9321221
Eval Eval.ResearchFinding: Fail (Quality) ... View Item Version History	2026-09-22T10:33:03.1682580+00:00	System Account (SPICE.Web)	Eval.ResearchFinding	Workflow.Research	Quality	Fail	90	OutputIsContentType: no row landed (output-is-contenttype cannot be checked)	2026-09-22T10:33:03.1690544
Eval Eval.DeepResearch: Fail (Quality) ... View Item Version History	2026-09-22T10:32:29.9952464+00:00	System Account (SPICE.Web)	Eval.DeepResearch	Tool.DeepResearch	Quality	Fail	67	MinCount: found 0 of 'http', need >= 3	2026-09-22T10:32:29.9963483
Eval Eval.HealthReview: Pass (Quality) ... View Item Version History	2026-09-22T10:32:06.9310419+00:00	System Account (SPICE.Web)	Eval.HealthReview	Skill.HealthReview	Quality	Pass	100		2026-09-22T10:32:06.9319318
Eval Eval.DailyBrief: Fail (Quality) ... View Item Version History		System Account (SPICE.Web)	Eval.DailyBrief	Workflow.DailyBrief	Quality	Fail	89	Forbid: forbidden '[Echo agent' present	2026-09-15T06:52:31.9614492
Eval Eval.ResearchFinding: Fail (Quality) ... View Item Version History		System Account (SPICE.Web)	Eval.ResearchFinding	Workflow.Research	Quality	Fail	80	Forbid: forbidden '[Echo agent' present \| OutputIsContentType: no row landed (output-is-contenttype cannot be checked)	2026-09-15T06:52:31.9497118
Eval Eval.DeepResearch: Fail (Quality) ... View Item Version History		System Account (SPICE.Web)	Eval.DeepResearch	Tool.DeepResearch	Quality	Fail	67	Forbid: forbidden '(synthesis unavailable)' present	2026-09-15T06:52:31.9331279
Eval Eval.HealthReview: Degraded (Quality) ... View Item Version History		System Account (SPICE.Web)	Eval.HealthReview	Skill.HealthReview	Quality	Degraded	0	OutputIsContentType: endpoint degraded: SqlException - Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding.	2026-09-15T06:50:30.1014073
Eval Eval.DailyBrief: Fail (Quality) ... View Item Version History		System Account (SPICE.Web)	Eval.DailyBrief	Workflow.DailyBrief	Quality	Fail	89	Forbid: forbidden '[Echo agent' present	2026-09-14T21:02:55.7131703
Eval Eval.ResearchFinding: Fail (Quality) ... View Item Version History		System Account (SPICE.Web)	Eval.ResearchFinding	Workflow.Research	Quality	Fail	80	Forbid: forbidden '[Echo agent' present \| OutputIsContentType: no row landed (output-is-contenttype cannot be checked)	2026-09-14T21:02:55.6878691
Eval Eval.DeepResearch: Fail (Quality) ... View Item Version History		System Account (SPICE.Web)	Eval.DeepResearch	Tool.DeepResearch	Quality	Fail	67	Forbid: forbidden '(synthesis unavailable)' present	2026-09-14T21:02:55.6706868
Eval Eval.HealthReview: Degraded (Quality) ... View Item Version History		System Account (SPICE.Web)	Eval.HealthReview	Skill.HealthReview	Quality	Degraded	0	OutputIsContentType: tool-loop provider degraded to the Echo stub mid-run (real provider 504/timeout) - infra, not subject	2026-09-14T21:00:02.8358312
Eval Eval.DailyBrief: Fail (Quality) ... View Item Version History		System Account (SPICE.Web)	Eval.DailyBrief	Workflow.DailyBrief	Quality	Fail	89	Forbid: forbidden '[Echo agent' present	2026-09-14T20:45:07.7094673
Eval Eval.ResearchFinding: Fail (Quality) ... View Item Version History		System Account (SPICE.Web)	Eval.ResearchFinding	Workflow.Research	Quality	Fail	80	Forbid: forbidden '[Echo agent' present \| OutputIsContentType: no row landed (output-is-contenttype cannot be checked)	2026-09-14T20:45:07.6951919
Eval Eval.DeepResearch: Fail (Quality) ... View Item Version History		System Account (SPICE.Web)	Eval.DeepResearch	Tool.DeepResearch	Quality	Fail	67	Forbid: forbidden '(synthesis unavailable)' present	2026-09-14T20:45:07.6791937
Eval Eval.HealthReview: Fail (Quality) ... View Item Version History		System Account (SPICE.Web)	Eval.HealthReview	Skill.HealthReview	Quality	Fail	75	ToolTrajectory: 'Tool.FetchKnowledge' not called in the declared order; actual []	2026-09-14T20:39:03.5404111
Eval Eval.HealthReview: Degraded (Quality) ... View Item Version History		System Account (SPICE.Web)	Eval.HealthReview	Skill.HealthReview	Quality	Degraded	0	OutputIsContentType: tool-loop provider degraded to the Echo stub mid-run (real provider 504/timeout) - infra, not subject	2026-09-07T17:58:02.7628353
Eval Eval.HealthReview: Degraded (Quality) ... View Item Version History		System Account (SPICE.Web)	Eval.HealthReview	Skill.HealthReview	Quality	Degraded	0	OutputIsContentType: tool-loop provider degraded to the Echo stub mid-run (real provider 504/timeout) - infra, not subject	2026-09-07T15:38:02.0056408
Eval Eval.HealthReview: Degraded (Quality) ... View Item Version History		System Account (SPICE.Web)	Eval.HealthReview	Skill.HealthReview	Quality	Degraded	0	OutputIsContentType: tool-loop provider degraded to the Echo stub mid-run (real provider 504/timeout) - infra, not subject	2026-09-07T15:32:02.1817686
Eval Eval.DailyBrief: Fail (Quality) ... View Item Version History		System Account (SPICE.Web)	Eval.DailyBrief	Workflow.DailyBrief	Quality	Fail	89	Forbid: forbidden '[Echo agent' present	2026-09-07T15:28:09.1078216
Eval Eval.DeepResearch: Fail (Quality) ... View Item Version History		System Account (SPICE.Web)	Eval.DeepResearch	Tool.DeepResearch	Quality	Fail	67	Forbid: forbidden '(synthesis unavailable)' present	2026-09-07T15:28:09.0583260
Eval Eval.HealthReview: Degraded (Quality) ... View Item Version History		System Account (SPICE.Web)	Eval.HealthReview	Skill.HealthReview	Quality	Degraded	0	OutputIsContentType: tool-loop provider degraded to the Echo stub mid-run (real provider 504/timeout) - infra, not subject	2026-09-07T15:22:02.7564863
Eval Eval.HealthReview: Fail (Quality) ... View Item Version History		System Account (SPICE.Web)	Eval.HealthReview	Skill.HealthReview	Quality	Fail	75	ToolTrajectory: 'Tool.FetchKnowledge' not called in the declared order; actual []	2026-09-07T15:00:48.9024575