All pull requests

Pull requests

• Support Qwen3 models: bump transformers to >=4.51 and fix optimum/colpali compatibility

  #674·hassanraha opened Sep 9, 2026·

  ·
  2

  4

• feat: resolve oci:// model references via llmman serve

  #672·ericcurtin opened Aug 30, 2026·

  ·
  6

• fix(classifier): adopt the tokenizer pad_token_id when the model config lacks one

  #670·olesxg opened Aug 24, 2026·

  ·
  1

  1

• fix(cache): a failed disk-cache write no longer kills the writer thread

  #669·olesxg opened Aug 24, 2026·

  ·
  1

• fix: prevent persistent 429 responses after model worker failures

  #668·cyb-fox opened Aug 10, 2026·

  ·
  5

• feat(rerank): add per-model token limits for cross-encoder rerank

  #666·vlsi opened Jun 17, 2026·

  ·
  11

• chore: add publication for linux/arm64 for -cpu containers

  #665·vlsi opened Jun 17, 2026·

  ·
  1

  10

• fix(deps): bump typer to >=0.20.0 so the CLI works with click >=8.3 (#650)

  #663·Anai-Guo opened Jun 4, 2026·

  ·
  1

  4

• fix(classify): honor raw_scores flag (return logits, softmax only when raw_scores=False)

  #662·Anai-Guo opened Jun 4, 2026·

  ·
  9

• feat: Support Customizable Logging Format in Infinity

  #644·shalousun opened Sep 19, 2025·

  ·
  1

  3

• Fix BetterTransformer compatibility with transformers >= 4.49

  #643·AimoreRRD opened Sep 18, 2025·

  ·
  3

• WIP: add back better_transformer without version check

  #641·wirthual opened Aug 29, 2025·

  ·
  9

• fix: implement lazy imports for BetterTransformer

  #619·aryasaatvik opened Jul 10, 2025·

  ·
  6

• fix: migrate FP8 support from float8_experimental to torchao

  #618·aryasaatvik opened Jul 10, 2025·

  ·
  3

• fixed super.init in SentenceTransformerPatched

  #617·raul3820 opened Jul 10, 2025·

  ·
  2

• WIP: add changes for 3.13 support

  #604·wirthual opened Jun 23, 2025·

  ·
  3

• allow numpy >= 2.0

  #594·cztchoice opened May 29, 2025·

  ·
  2

• docker image overwrite

  #572·michaelfeil opened Apr 17, 2025·

  ·
  5

• Changes by create-pull-request action

  #571·github-actions[bot] opened Apr 16, 2025·

  ·
  9

• auto get modality

  #567·lloydzhou opened Apr 15, 2025·

  ·
  6

• Support --dimensions parameter in CLI

  #564·persiyanov opened Apr 7, 2025·

  ·
  2

• refactor -> select_model(functional)

  #468·michaelfeil opened Nov 16, 2024·

  ·
  10

• optimum openvino

  #467·michaelfeil opened Nov 16, 2024·

  ·
  11

• [Feature] [Optimum] [Intel] [OpenVINO] Add OpenVINO backend support through Optimum-Intel

  #454·tjtanaa opened Nov 7, 2024·

  ·
  17

• v0 add autoquant

  #402·michaelfeil opened Oct 7, 2024·

  ·
  6