Skip to content

feat(observability): scan stage histograms, analyzer saturation, failure taxonomy, and throughput dashboard - #1281

Merged
mijinummi merged 1 commit into
MDTechLabs:mainfrom
software321dev:feat/batch-1259-1260-1261-1264
Oct 20, 2026
Merged

mijinummi merged 1 commit into
MDTechLabs:mainfrom
software321dev:feat/batch-1259-1260-1261-1264

Conversation

@software321dev

Copy link
Copy Markdown
Contributor

Summary

This PR resolves issues #1259, #1260, #1261, and #1264 with end-to-end observability implementations:

  1. Scan Stage Duration Histograms (Closes Add scan stage duration histograms #1259):

    • Implemented ScanStageHistogramService tracking millisecond latency distributions across all scan pipeline stages (queue, validation, bytecode_analysis, simulation, report_generation).
    • Computes counts, sums, min, max, average, and p50, p90, p95, p99 percentile latencies with configurable histogram buckets.
  2. Analyzer Saturation & Queue Pressure Metrics (Closes Expose analyzer saturation and queue pressure metrics #1260):

    • Implemented AnalyzerSaturationMetricsService capturing queue length, active concurrency, worker capacity utilization percentage, and saturation status flags.
    • Computes weighted saturation indices and triggers alerts when thresholds are exceeded.
  3. Structured Scan Failure Taxonomy (Closes Create structured scan failure taxonomy #1261):

    • Implemented ScanFailureTaxonomyService classifying failures into standard categories (BYTECODE_INVALID, RPC_TIMEOUT, SIMULATION_REVERT, RATE_LIMITED, ANALYZER_CRASH, etc.) with severity levels, retryability classifications, and remediation hints.
    • Provides aggregation by error code and category over observation windows.
  4. Operational Dashboard for Scan Throughput (Closes Add operational dashboard for scan throughput #1264):

    • Implemented ScanThroughputDashboardService aggregating completed, failed, and in-flight scans across sliding time windows (1m, 5m, 15m, 1h).
    • Computes scans-per-second, success/failure rates, error breakdown, queue health, stage latency summaries, and health status indicators (HEALTHY, DEGRADED, CRITICAL).

Issues Addressed

…ure taxonomy, and throughput dashboard

- Issue MDTechLabs#1259: Add scan stage duration histograms with configurable buckets
- Issue MDTechLabs#1260: Expose analyzer saturation and queue pressure metrics
- Issue MDTechLabs#1261: Create structured scan failure taxonomy with retryable classification
- Issue MDTechLabs#1264: Add operational dashboard for scan throughput and files-per-second metrics

Closes MDTechLabs#1259, Closes MDTechLabs#1260, Closes MDTechLabs#1261, Closes MDTechLabs#1264
@drips-wave

drips-wave Bot commented Oct 18, 2026

Copy link
Copy Markdown

@software321dev Great news! 🎉 Based on an automated assessment of this PR, the linked Wave issue(s) no longer count against your application limits.

You can now already apply to more issues while waiting for a review of this PR. Keep up the great work! 🚀

Learn more about application limits

@mijinummi
mijinummi merged commit 30c5e63 into MDTechLabs:main Oct 20, 2026
10 of 13 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

2 participants