Repository navigation
feat: Control Plane Hardening & Mock Chaos Verification - #1
Merged
Merged
Conversation
This commit repairs the primary inference path, which was previously disconnected from the API, and removes hardcoded testing artifacts from the control plane. Changes in LlamaEngine: - Inherit explicitly from BaseAetherEngine to satisfy the factory contract. - Implement missing _map_mode_to_layers() to prevent AttributeError during Fast-Swap. - Implement missing generate() method to execute real llama-cpp-python inference and yield required telemetry (tps, generation time). Changes in Server/Control Plane: - Delete the inline spoofed HardwareMonitor (which hardcoded temps to 90C). - Import and bind the real HardwareMonitor from src.hardware_monitor. - Wire the /generate endpoint to actually invoke state.hardware_engine.generate(), closing the loop between the API and physical execution. Why: The API was previously routing requests perfectly but failing at the final execution step due to an incomplete engine contract. Additionally, the leftover Cold Burn-In spoof trapped the server in a permanent Emergency Thermal Lockout state.
…rify 503 circuit breakers under Mock - Enforced BaseAetherEngine contract across all muscle implementations (added temperature). - Added AETHER_ENGINE and AETHER_CHAOS toggles for headless development. - Verified sticky thermal 503 lockouts against concurrent API load in Mock mode. - Restored missing /system/tools and /system/cache endpoints.
…rs and swap matrix - Validates system discovery endpoints (/cache, /metrics, /tools) - Asserts Economic Gatekeeper ROI routing for strategy swaps - Codifies thermal 503 protection enforcement for both /generate and /system/strategy
Owner
Author
|
test: add comprehensive hypervisor test suite covering circuit breakers and swap matrix
|
jayjz
changed the title
- Restored missing generate() method and temperature propagation. - Added basic emergency teardown sequence (del -> GC). - Added aggressive_quant fallback on load failure. - Note: Fast-Swap VRAM barriers remain unproven on 8GB cards. DO NOT run in production without process isolation.
- Replaced brittle print() statements with robust logging. - Created stdout (console), ops (aetherforge.log), and safety (hardware_safety.log) streams. - Added log rotation (10MB limit) to prevent SSD bloat. - Ops log now successfully captures live TPS and Gatekeeper math routing.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
This PR hardens the FastAPI control plane and strictly enforces the engine abstraction layer. It decouples development from the physical GPU by introducing a robust Mock engine with sticky thermal chaos, proving that the 503 circuit breakers hold under concurrent load.
Verified in this PR
Remaining Technical Debt (Unverified - DO NOT MERGE)