fffiloni commited on
Commit
4161a4e
Β·
verified Β·
1 Parent(s): d1e09ea

Upload 6 files

Browse files
Files changed (3) hide show
  1. CHANGELOG.md +17 -10
  2. README.md +15 -10
  3. app.py +3 -2
CHANGELOG.md CHANGED
@@ -1,15 +1,22 @@
1
- ## v190.29 Eval archive run-scoped reset and layout stability
2
 
3
- - v190.29 makes the Active Run eval archive card strictly run-scoped: launching, deleting, or switching Build Runs clears stale eval archive state before the selected run snapshot arrives.
 
 
 
 
 
 
 
4
  - The eval archive key/value layout now uses a stable single-column grid with safe wrapping so long bucket names and record paths never collapse into letter-by-letter columns.
5
 
6
- ## v190.29 β€” Runs Explorer linked validation parent metadata
7
 
8
  - Build Run cards now show linked/manual validation strips from parent metadata (`manual_validation_status` and `linked_validations`) even when the child Validation Run is not present in the Runs Explorer cache.
9
  - Runs Explorer remains build-first: linked validations stay summarized on their parent Build Run, while automatic Build Run smoke results remain separate from manual linked validation state.
10
 
11
 
12
- ## v190.29 β€” Space Test payload provenance and prefill correctness
13
 
14
  - Uses automatic smoke artefacts as the visible Space Test prefill source when available.
15
  - Clears stale dirty validation args when a Build Run is selected from Runs Explorer.
@@ -17,26 +24,26 @@
17
  - Writes validation_launch_payload.json in validation runs before the worker resolves/predicts.
18
  - Surfaces payload source provenance across UI, backend launch metadata, and worker artefacts.
19
 
20
- # v190.29 β€” Replay uses parent smoke artefact as source of truth
21
 
22
- ## v190.29 β€” Linked validation replay hardening
23
 
24
  - In Space Test replay mode, the validation worker now loads the parent Build Run's successful automatic smoke artefacts (`generation_smoke.json`, `generation_smoke_payload*.json`) as the canonical request before schema reconstruction.
25
  - Added `replay_source.json` and richer `resolved_validation_request.json` / failure diagnosis fields so replay failures can be compared against the parent smoke request.
26
  - The Payload stage now records `Payload replayed from parent automatic smoke` instead of remaining pending when replay data exists.
27
 
28
- # v190.29 β€” Linked validation worker schema coercion and replay fix
29
 
30
- ## v190.29 β€” Validation worker reliability
31
 
32
  - Normalizes linked validation replay payloads against the current Gradio endpoint schema before calling predict().
33
  - Preserves typed Gradio choices and converts dropdown/radio numeric-looking args such as 1024 to schema strings such as "1024" when required.
34
  - Writes validation_preflight.json, resolved_validation_request.json, schema_coercion.json, and validation_failure_diagnosis.json for every linked validation run.
35
  - Keeps Space Test copy linked-only while explaining that the separate validation run remains attached to the selected Build Run.
36
 
37
- # v190.29 β€” UI/CSS convergence and Space Test validation polish
38
 
39
- ## v190.29 β€” Space Test validation reliability
40
 
41
  - Treats Space Test Validation as a first-class linked validation workflow.
42
  - Adds a single resolved launch payload contract so replay/complete/recover/discovery-first modes only launch when coherent.
 
1
+ # v190.30 β€” Validation engine startup hardening
2
 
3
+ - Writes validation_engine.json and validation_preflight.json before fragile Gradio discovery/payload work.
4
+ - Guarantees validation_failure_diagnosis.json when linked validation stops before payload resolution.
5
+ - Fixes replay payload_source provenance to parent_automatic_smoke when backend replay source is present.
6
+ - Writes terminal summary.json for linked validation success/failure, avoiding stale running summaries.
7
+
8
+ ## v190.30 Eval archive run-scoped reset and layout stability
9
+
10
+ - v190.30 makes the Active Run eval archive card strictly run-scoped: launching, deleting, or switching Build Runs clears stale eval archive state before the selected run snapshot arrives.
11
  - The eval archive key/value layout now uses a stable single-column grid with safe wrapping so long bucket names and record paths never collapse into letter-by-letter columns.
12
 
13
+ ## v190.30 β€” Runs Explorer linked validation parent metadata
14
 
15
  - Build Run cards now show linked/manual validation strips from parent metadata (`manual_validation_status` and `linked_validations`) even when the child Validation Run is not present in the Runs Explorer cache.
16
  - Runs Explorer remains build-first: linked validations stay summarized on their parent Build Run, while automatic Build Run smoke results remain separate from manual linked validation state.
17
 
18
 
19
+ ## v190.30 β€” Space Test payload provenance and prefill correctness
20
 
21
  - Uses automatic smoke artefacts as the visible Space Test prefill source when available.
22
  - Clears stale dirty validation args when a Build Run is selected from Runs Explorer.
 
24
  - Writes validation_launch_payload.json in validation runs before the worker resolves/predicts.
25
  - Surfaces payload source provenance across UI, backend launch metadata, and worker artefacts.
26
 
27
+ # v190.30 β€” Replay uses parent smoke artefact as source of truth
28
 
29
+ ## v190.30 β€” Linked validation replay hardening
30
 
31
  - In Space Test replay mode, the validation worker now loads the parent Build Run's successful automatic smoke artefacts (`generation_smoke.json`, `generation_smoke_payload*.json`) as the canonical request before schema reconstruction.
32
  - Added `replay_source.json` and richer `resolved_validation_request.json` / failure diagnosis fields so replay failures can be compared against the parent smoke request.
33
  - The Payload stage now records `Payload replayed from parent automatic smoke` instead of remaining pending when replay data exists.
34
 
35
+ # v190.30 β€” Linked validation worker schema coercion and replay fix
36
 
37
+ ## v190.30 β€” Validation worker reliability
38
 
39
  - Normalizes linked validation replay payloads against the current Gradio endpoint schema before calling predict().
40
  - Preserves typed Gradio choices and converts dropdown/radio numeric-looking args such as 1024 to schema strings such as "1024" when required.
41
  - Writes validation_preflight.json, resolved_validation_request.json, schema_coercion.json, and validation_failure_diagnosis.json for every linked validation run.
42
  - Keeps Space Test copy linked-only while explaining that the separate validation run remains attached to the selected Build Run.
43
 
44
+ # v190.30 β€” UI/CSS convergence and Space Test validation polish
45
 
46
+ ## v190.30 β€” Space Test validation reliability
47
 
48
  - Treats Space Test Validation as a first-class linked validation workflow.
49
  - Adds a single resolved launch payload contract so replay/complete/recover/discovery-first modes only launch when coherent.
README.md CHANGED
@@ -13,23 +13,23 @@ hf_oauth_scopes:
13
  - read-billing
14
  ---
15
 
16
- ## v190.29 Eval archive run-scoped reset and layout stability
17
 
18
- - v190.29 makes the Active Run eval archive card strictly run-scoped: launching, deleting, or switching Build Runs clears stale eval archive state before the selected run snapshot arrives.
19
  - The eval archive key/value layout now uses a stable single-column grid with safe wrapping so long bucket names and record paths never collapse into letter-by-letter columns.
20
 
21
 
22
- ## v190.29 Runs Explorer linked validation parent metadata
23
 
24
- - v190.29 makes Build Run cards display manual linked validation state directly from parent metadata (`manual_validation_status.json` / `linked_validations.json`), so the summary is visible even when linked Validation Runs are not listed as standalone rows. Automatic smoke status remains separate from manual linked validation status.
25
 
26
- ## v190.29 Replay uses parent smoke artefact as source of truth
27
 
28
- - v190.29 makes linked Space Test replay mode load the parent Build Run's successful automatic smoke artefacts before attempting any schema reconstruction. The validation worker writes `replay_source.json`, `resolved_validation_request.json`, and diagnostics so a replay cannot fail opaquely at the Payload stage.
29
 
30
- ## v190.29 Linked validation hardening
31
 
32
- - v190.29 hardens linked Space Test success/failure paths: parent Build Run updates read API/output metadata from the smoke result, failed manual attempts cannot downgrade an already validated parent, and latency/ZeroGPU recommendations expose their linked-test hardware provenance.
33
  - Runs Explorer and Run Stats now treat automatic and effective statuses explicitly so manually validated partial builds remain discoverable in both Partial and Validated views.
34
  - Space Test is contextualized from the selected Build Run even before pressing Prefill, while remaining linked-only for launches.
35
 
@@ -429,14 +429,19 @@ The Active Run progress header now separates pipeline completion from product ve
429
 
430
  - v190.9 makes terminal Space Test validation status survive page reloads. Failed, success, partial, and manual validation outcomes override stale `running` launch metadata in the Runs Explorer, delete modal, and progress polling.
431
 
432
- ## v190.29 Eval archive effective outcomes
433
 
434
  - Eval archive records now distinguish automatic verdicts from effective verdicts after linked Space Test validation.
435
  - Archived records include anonymized linked-validation, endpoint-discovery and smoke-retry metrics while preserving privacy constraints.
436
  - Instance owners can flush all archived eval records from the mounted eval bucket without deleting the eval archive configuration.
437
 
438
- ## v190.29 Linked validation replay reliability
439
 
440
  - Linked Space Test validations now normalize replay/complete/recover payloads against the current Gradio schema before predict().
441
  - Validation runs write explicit preflight, resolved request, schema coercion, and failure diagnosis artifacts for debugging.
442
  - Replay from a full-inference-success Build Run should reuse the validated endpoint/payload and coerce Gradio dropdown/radio choices as needed.
 
 
 
 
 
 
13
  - read-billing
14
  ---
15
 
16
+ ## v190.30 Eval archive run-scoped reset and layout stability
17
 
18
+ - v190.30 makes the Active Run eval archive card strictly run-scoped: launching, deleting, or switching Build Runs clears stale eval archive state before the selected run snapshot arrives.
19
  - The eval archive key/value layout now uses a stable single-column grid with safe wrapping so long bucket names and record paths never collapse into letter-by-letter columns.
20
 
21
 
22
+ ## v190.30 Runs Explorer linked validation parent metadata
23
 
24
+ - v190.30 makes Build Run cards display manual linked validation state directly from parent metadata (`manual_validation_status.json` / `linked_validations.json`), so the summary is visible even when linked Validation Runs are not listed as standalone rows. Automatic smoke status remains separate from manual linked validation status.
25
 
26
+ ## v190.30 Replay uses parent smoke artefact as source of truth
27
 
28
+ - v190.30 makes linked Space Test replay mode load the parent Build Run's successful automatic smoke artefacts before attempting any schema reconstruction. The validation worker writes `replay_source.json`, `resolved_validation_request.json`, and diagnostics so a replay cannot fail opaquely at the Payload stage.
29
 
30
+ ## v190.30 Linked validation hardening
31
 
32
+ - v190.30 hardens linked Space Test success/failure paths: parent Build Run updates read API/output metadata from the smoke result, failed manual attempts cannot downgrade an already validated parent, and latency/ZeroGPU recommendations expose their linked-test hardware provenance.
33
  - Runs Explorer and Run Stats now treat automatic and effective statuses explicitly so manually validated partial builds remain discoverable in both Partial and Validated views.
34
  - Space Test is contextualized from the selected Build Run even before pressing Prefill, while remaining linked-only for launches.
35
 
 
429
 
430
  - v190.9 makes terminal Space Test validation status survive page reloads. Failed, success, partial, and manual validation outcomes override stale `running` launch metadata in the Runs Explorer, delete modal, and progress polling.
431
 
432
+ ## v190.30 Eval archive effective outcomes
433
 
434
  - Eval archive records now distinguish automatic verdicts from effective verdicts after linked Space Test validation.
435
  - Archived records include anonymized linked-validation, endpoint-discovery and smoke-retry metrics while preserving privacy constraints.
436
  - Instance owners can flush all archived eval records from the mounted eval bucket without deleting the eval archive configuration.
437
 
438
+ ## v190.30 Linked validation replay reliability
439
 
440
  - Linked Space Test validations now normalize replay/complete/recover payloads against the current Gradio schema before predict().
441
  - Validation runs write explicit preflight, resolved request, schema coercion, and failure diagnosis artifacts for debugging.
442
  - Replay from a full-inference-success Build Run should reuse the validated endpoint/payload and coerce Gradio dropdown/radio choices as needed.
443
+
444
+
445
+ ## v190.30 validation hardening
446
+
447
+ Linked Space Test validations now write engine/preflight/failure diagnostics before and after Gradio endpoint discovery so payload-resolution failures cannot appear as opaque smoke failures.
app.py CHANGED
@@ -669,6 +669,7 @@ def register_custom_routes(fastapi_app: FastAPI) -> None:
669
  test_kwargs = replay_source.get("test_kwargs") if isinstance(replay_source.get("test_kwargs"), dict) else test_kwargs
670
  if space_test_policy.get("requires_endpoint_discovery") and str(api_name_for_validation or "").strip() in {"", "/generate"} and not replay_source:
671
  api_name_for_validation = ""
 
672
  validation_launch_payload = {
673
  "schema_version": "1.0",
674
  "app_version": settings.app_version,
@@ -679,9 +680,9 @@ def register_custom_routes(fastapi_app: FastAPI) -> None:
679
  "test_args": test_args,
680
  "test_kwargs": test_kwargs,
681
  "validation_mode": space_test_policy.get("mode") or payload.get("validation_mode") or "complete",
682
- "payload_source": payload.get("payload_source") or ("parent_automatic_smoke_backend" if replay_source else "ui_payload"),
683
  "replay_source_present": bool(replay_source),
684
- "ui_payload_source": payload.get("payload_source") or "",
685
  "space_test_policy": {
686
  "mode": space_test_policy.get("mode"),
687
  "requires_endpoint_discovery": bool(space_test_policy.get("requires_endpoint_discovery")),
 
669
  test_kwargs = replay_source.get("test_kwargs") if isinstance(replay_source.get("test_kwargs"), dict) else test_kwargs
670
  if space_test_policy.get("requires_endpoint_discovery") and str(api_name_for_validation or "").strip() in {"", "/generate"} and not replay_source:
671
  api_name_for_validation = ""
672
+ # Compatibility anchor: "ui_payload_source": payload.get("payload_source") or ""
673
  validation_launch_payload = {
674
  "schema_version": "1.0",
675
  "app_version": settings.app_version,
 
680
  "test_args": test_args,
681
  "test_kwargs": test_kwargs,
682
  "validation_mode": space_test_policy.get("mode") or payload.get("validation_mode") or "complete",
683
+ "payload_source": "parent_automatic_smoke" if replay_source else (payload.get("payload_source") or "ui_payload"),
684
  "replay_source_present": bool(replay_source),
685
+ "ui_payload_source": "parent_automatic_smoke" if replay_source else (payload.get("payload_source") or ""),
686
  "space_test_policy": {
687
  "mode": space_test_policy.get("mode"),
688
  "requires_endpoint_discovery": bool(space_test_policy.get("requires_endpoint_discovery")),