Skip to content

Stop the no_std CI job hanging on apt - #18

Draft
richardanaya wants to merge 3 commits into
masterfrom
cursor/fix-nostd-apt-hang-fec3
Draft

richardanaya wants to merge 3 commits into
masterfrom
cursor/fix-nostd-apt-hang-fec3

Conversation

@richardanaya

@richardanaya richardanaya commented Oct 8, 2026 •

Copy link
Copy Markdown
Owner

The no_std job on master commit b3c0332 (run 37679549289, job 112991706416) never built or booted QEMU. GitHub cancelled it at the 6-hour limit. The same job passed on PR #17 (67074c3).

Root cause

sudo apt-get update hung. GitHub's Ubuntu image lists mirrors in /etc/apt/apt-mirrors.txt:

  1. http://azure.archive.ubuntu.com/ubuntu/ (priority 1)
  2. https://archive.ubuntu.com/ubuntu/ (priority 2)

On the cancelled run, Azure ignored InRelease (Ign at 20:07:07Z). Apt then logged Ign for noble-updates package indexes on that same host (20:07:09Z) and printed nothing else until the cancel at 02:07Z. It did not fail over, even though https://archive.ubuntu.com had already returned InRelease in that run. The passing run used Azure too, and Azure answered, so this is the mirror stall, not the harness.

Fix

  • Point apt at https://archive.ubuntu.com only, so the broken failover path is not used.
  • Set apt acquire timeouts (30s, 3 retries) and kill a still-stuck apt-get after 180s with a message.
  • timeout-minutes: 15 on the job.
  • Run QEMU under timeout (60s). A guest that never semihost-exits fails immediately instead of holding the runner.

No library changes.

CI

Three separate runs, each with every job green, including no_std build and qemu:

The first run's apt log fetched only from https://archive.ubuntu.com (mirror list was 46 bytes, not the 144-byte Azure list) and QEMU printed executor nostd tests ok.

Open in Web Open in Cursor 

cursoragent and others added 3 commits October 8, 2026 02:34
GitHub runners prefer azure.archive.ubuntu.com. When that mirror ignores InRelease, apt can stall forever in mirror failover and never reach the build or QEMU. Use archive.ubuntu.com only, bound apt and QEMU with timeout, and cap the job at 15 minutes.

Co-authored-by: richardanaya2_2048b.Q6_K_M.gguf <richardanaya@users.noreply.github.com>
Co-authored-by: richardanaya2_2048b.Q6_K_M.gguf <richardanaya@users.noreply.github.com>
Co-authored-by: richardanaya2_2048b.Q6_K_M.gguf <richardanaya@users.noreply.github.com>

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants