fix(codex): sidecar fallback for metadata-coverage and pm-rate-limits - #1823
Open
Flotapponnier wants to merge 5 commits into
Open
fix(codex): sidecar fallback for metadata-coverage and pm-rate-limits#1823Flotapponnier wants to merge 5 commits into
Flotapponnier wants to merge 5 commits into
Conversation
* fix: remove dead providers (BlastAPI shutdown, Ankr key-gated, dRPC/1RPC not supported) * fix: remove dead providers (BlastAPI shutdown, Ankr key-gated, dRPC/1RPC not supported) (#1789) * feat: add wave 7 chains to /chains hub (fantom, kusama, hydration, zetachain, haqq, etherlink, chiliz, wemix, songbird, etc-classic, telos, pulsechain, warden, oraichain, peaq) * feat: add 15 wave 7 chains to /chains hub (#1790) * fix: remove dead providers (BlastAPI shutdown, Ankr key-gated, dRPC/1RPC not supported) * feat: add wave 7 chains to /chains hub (fantom, kusama, hydration, zetachain, haqq, etherlink, chiliz, wemix, songbird, etc-classic, telos, pulsechain, warden, oraichain, peaq) * fix: remove drift and variational from perp venue meta (404 on /perp redirect) * fix: filter non-provider result links in answers, add bridge to footer * fix: drop dead RPC providers across 14 chains (DNS failures, 404s, paid-plan blocks) * fix: hydration draft+placeholder provider, zetachain/songbird em-dash in findings * fix: hydration draft+placeholder provider, zetachain/songbird em-dash in findings (#1794) * feat: add /apps leaderboard foundation — specs, Go harness, Postgres schema, alerting * fix: interface ctx type, float-free toMicroUSDC, goroutine error capture, pagination cursor * feat: /apps leaderboard foundation (#1797) * feat: add /apps leaderboard foundation — specs, Go harness, Postgres schema, alerting * fix: interface ctx type, float-free toMicroUSDC, goroutine error capture, pagination cursor * fix: dydx collector json key megavaultPnl, cumulative-to-delta PnL, Decimals=0 * feat: add Hyperliquid collector via DeFiLlama (perps/HLP/spot breakdown, 590 days) * feat: /apps leaderboard page + Go API service (Hyperliquid $45M/30d, dYdX $25K/30d) * feat(apps): first-party data sources — HL node fills + GMX Subsquid (#1801) * feat(apps): switch HL collector to node fills, add hl-fills-agg Replace DeFiLlama proxy with first-party Hyperliquid node fills. - Reads fee/builderFee from node_fills_by_block on SGP (15.235.224.14) - hl-fills-agg.py aggregates daily totals, runs as pm2 on SGP:2116 - net_usdc = gross - builder = amount flowing to AF + HLP + deployers - Fills archive starts 2026-06-01, backfill runs automatically * feat(apps): add GMX v2 collector (Arbitrum + Avalanche) via Subsquid First-party data from GMX-operated Subsquid GraphQL endpoint. Position fees (63% LP / 37% protocol) + swap fees split per governance. Borrowing fees classified as LP revenue (pool-only, no protocol cut). Amounts in GMX internal 1e30 precision, stored with Decimals=30. * fix: dYdX collector — volume×fee-rate instead of MegaVault PnL * feat: add Gains.trade collector (The Graph, needs THEGRAPH_API_KEY) * feat: Gains.trade collector via DeFiLlama public API (no key needed) * feat: gains-trade real-time WS collector via gTrade backend + eth_getTransactionReceipt * fix: leaderboard UI polish + map treasury->burn bucket for Gains.trade * feat: add logos + /perp links to apps leaderboard table * chore: remove defillama gains collector, WS handles gains going forward * fix: update codex/defined auth to use defined-attestation-token + CODEX_JWT bypass * feat: add Drift, Jupiter Perps, Vertex to apps leaderboard via DeFiLlama (#1803) - Generic DeFiLlama collector (defillama_generic.go): daily fees + revenue split into treasury/lp events - Correct DeFiLlama slugs: drift-trade, jupiter-perpetual-exchange, vertex-perps - Fix h24 window to 2 days so daily-bucket protocols show data (was missing for HL/GMX/dYdX) - Add new deployments to materializer and API meta - Frontend VENUE map updated with logos for all 3 new protocols * fix: dYdX fee rate 5bps → 3.5bps (blended effective rate) (#1804) * feat: add Drift, Jupiter Perps, Vertex to apps leaderboard via DeFiLlama - Generic DeFiLlama collector (defillama_generic.go): daily fees + revenue split into treasury/lp events - Correct DeFiLlama slugs: drift-trade, jupiter-perpetual-exchange, vertex-perps - Fix h24 window to 2 days so daily-bucket protocols show data (was missing for HL/GMX/dYdX) - Add new deployments to materializer and API meta - Frontend VENUE map updated with logos for all 3 new protocols * fix: dYdX fee rate 5bps -> 3.5bps (blended effective rate) * fix: dYdX full history — 90d limit → 1000d (Nov 2023 launch) (#1805) * feat: add Drift, Jupiter Perps, Vertex to apps leaderboard via DeFiLlama - Generic DeFiLlama collector (defillama_generic.go): daily fees + revenue split into treasury/lp events - Correct DeFiLlama slugs: drift-trade, jupiter-perpetual-exchange, vertex-perps - Fix h24 window to 2 days so daily-bucket protocols show data (was missing for HL/GMX/dYdX) - Add new deployments to materializer and API meta - Frontend VENUE map updated with logos for all 3 new protocols * fix: dYdX fee rate 5bps -> 3.5bps (blended effective rate) * fix: dYdX full history backfill — limit 90d -> 1000d (covers Nov 2023 launch) * perf: use recording rules for lz/bridge histogram queries, drop raw rate([24h]) * fix: truncate tron/token-quote methodology strings, telos em-dash in findings * perf: recording rules for hyperlane histogram queries * revert: layerzero back to raw queries * fix(agg-head-lag): update Codex mint to new /api/codex/token endpoint www.defined.fi/api (createApiTokens GraphQL mutation) is dead as of 2026-08. New endpoint is /api/codex/token which returns JWE directly. Still blocked by Vercel TLS checkpoint for Go HTTP — use CODEX_JWT env var or DEFINED_TOKEN_SERVICE_URL sidecar (Paris box) for automatic refresh. scrape-cookie: add awaitPromise fix, diagnostic headers, in-browser fetch test. * revert: layerzero back to raw queries (lz rate24h rule too expensive for VPS) * fix: remove em dashes in kaia-rpc and aurora-rpc findings * fix(agg-head-lag): update Codex mint to new /api/codex/token endpoint www.defined.fi/api (createApiTokens GraphQL mutation) is dead as of 2026-08. New endpoint is /api/codex/token which returns JWE directly. Still blocked by Vercel TLS checkpoint for Go HTTP — use CODEX_JWT env var or DEFINED_TOKEN_SERVICE_URL sidecar (Paris box) for automatic refresh. scrape-cookie: add awaitPromise fix, diagnostic headers, in-browser fetch test. * revert: layerzero back to raw queries (lz rate24h rule too expensive for VPS) * fix: agg head-lag uses DEFINED_TOKEN_SERVICE_URL sidecar for Codex JWE * feat: add solana-exec harness (pump.fun passive collector) + /apps/exec page * fix: materializer includes current hour, collector skips failed sigs, api 24h window correct * fix: remove em dashes in kaia-rpc and aurora-rpc findings * feat: add solana-exec harness + /apps/exec page (#1811) * fix(agg-head-lag): update Codex mint to new /api/codex/token endpoint www.defined.fi/api (createApiTokens GraphQL mutation) is dead as of 2026-08. New endpoint is /api/codex/token which returns JWE directly. Still blocked by Vercel TLS checkpoint for Go HTTP — use CODEX_JWT env var or DEFINED_TOKEN_SERVICE_URL sidecar (Paris box) for automatic refresh. scrape-cookie: add awaitPromise fix, diagnostic headers, in-browser fetch test. * revert: layerzero back to raw queries (lz rate24h rule too expensive for VPS) * fix: agg head-lag uses DEFINED_TOKEN_SERVICE_URL sidecar for Codex JWE * feat: add solana-exec harness (pump.fun passive collector) + /apps/exec page * fix: materializer includes current hour, collector skips failed sigs, api 24h window correct * fix: remove em dashes in kaia-rpc and aurora-rpc findings * fix(codex-ws): direct dialer + local JWE mint to fix 4403 IP mismatch * fix: weighted avg for fee/jito metrics across hourly buckets * fix: log warning when solana-exec collector hits sig limit (#1812) * fix(agg-head-lag): update Codex mint to new /api/codex/token endpoint www.defined.fi/api (createApiTokens GraphQL mutation) is dead as of 2026-08. New endpoint is /api/codex/token which returns JWE directly. Still blocked by Vercel TLS checkpoint for Go HTTP — use CODEX_JWT env var or DEFINED_TOKEN_SERVICE_URL sidecar (Paris box) for automatic refresh. scrape-cookie: add awaitPromise fix, diagnostic headers, in-browser fetch test. * revert: layerzero back to raw queries (lz rate24h rule too expensive for VPS) * fix: agg head-lag uses DEFINED_TOKEN_SERVICE_URL sidecar for Codex JWE * feat: add solana-exec harness (pump.fun passive collector) + /apps/exec page * fix: materializer includes current hour, collector skips failed sigs, api 24h window correct * fix: remove em dashes in kaia-rpc and aurora-rpc findings * fix(codex-ws): direct dialer + local JWE mint to fix 4403 IP mismatch * fix: weighted avg for fee/jito metrics across hourly buckets * fix(codex-ws): resolve merge conflict in defined_auth * fix: log warning when sig limit hit on incremental poll * feat: paginate getSignaturesForAddress for complete tx coverage (#1813) * fix: remove dead RPC providers, allow optional p90/p99 for gauge benches * feat: paginate getSignaturesForAddress for complete tx coverage * fix(codex-ws): in-process chromedp scraper for fresh JWE every 5min * fix: remove dead providers from xdc/etc-rpc, allow optional p90/p99 in load.ts * remove: delete indexing-freshness bench * feat: paginate getSignaturesForAddress for complete tx coverage * fix(codex-ws): in-process chromedp scraper for fresh JWE every 5min * fix: remove dead providers from xdc/etc-rpc, allow optional p90/p99 in load.ts * feat(solana-exec): accurate tx volume via raw sig pagination + 100-sig enhanced cap * remove: delete indexing-freshness bench (no data) * remove: delete indexing-freshness bench * feat: paginate getSignaturesForAddress for complete tx coverage * fix(codex-ws): in-process chromedp scraper for fresh JWE every 5min * fix: remove dead providers from xdc/etc-rpc, allow optional p90/p99 in load.ts * feat(solana-exec): accurate tx volume via raw sig pagination + 100-sig enhanced cap * remove: delete indexing-freshness bench (no data) * fix(codex): utls scraper + GitHub Actions token push (#1818) * fix(codex): utls scraper + GitHub Actions token push * fix: use un.defined.fi legacy API for codex JWE minting un.defined.fi/api createApiTokens still returns valid JWE tokens without requiring session cookies or CSRF. Try this first via utls, fall back to www.defined.fi/api/codex/token (needs page visit + CSRF). generateDefinedJWTToken also switched to un.defined.fi.
- harnesses/evm-exec: Go collector + materializer tracking GMGN fee collector 0xb8159ba378904f803639d274cec79f788931c9c8 across Ethereum, BSC, Base - ETH native via Etherscan v2 txlist+txlistinternal; BSC BNB via NodeReal nr_getAssetTransfers (paginated); ERC-20 USDC via eth_getLogs adaptive range - All amounts use *big.Int end-to-end; event_key disambiguates intra-tx transfers - Migration 004_evm_exec.sql: evm_exec_events, cursors, block_times, facts - solana-exec-api: new /api/evm-revenue route with CoinGecko price cache (15min) - UI: RevenueSummary card (platform x chain 24h USD), ExecChainTabs (Solana/Ethereum/BSC/Base selector), updated /apps/exec page
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Both harnesses were calling www.defined.fi/api (dead) with no sidecar fallback. metadata-coverage is 100% failing. Adds tryTokenService + DEFINED_TOKEN_SERVICE_URL env check before the legacy mint path.