Issues

• Support for Phi 4 multimodal

  casper-hansen/AutoAWQ#758 · Filter by author avinash31d opened on May 5, 2025
  2

• Error on multi-GPU, likely caused by PyTorch 2.7

  casper-hansen/AutoAWQ#754 · Filter by author BenjaminBossan opened on Apr 29, 2025

• Qwen3 support

  casper-hansen/AutoAWQ#753 · Filter by author Minami-su opened on Apr 29, 2025
  1

• How to use export_compatible in vLLM Compressor?

  casper-hansen/AutoAWQ#752 · Filter by author iswangyk opened on Apr 28, 2025

• TypeError: Qwen2Attention.forward() missing 1 required positional argument: 'attention_mask'

  casper-hansen/AutoAWQ#749 · Filter by author Charimanhua opened on Apr 24, 2025
  3

• Suggest a new release

  casper-hansen/AutoAWQ#747 · Filter by author fangyinc opened on Apr 15, 2025
  2

• RuntimeError: "rshift_cuda" not implemented for 'Half'

  casper-hansen/AutoAWQ#745 · Filter by author RoadToNowhereX opened on Apr 14, 2025
  2

• Is there a plan for llama4

  casper-hansen/AutoAWQ#741 · Filter by author Skyseaee opened on Apr 10, 2025

• Add support for Blackwell 50 series cards CUDA 12.8 and Torch >= 2.7.0 (nightly)

  casper-hansen/AutoAWQ#739 · Filter by author bi1101 opened on Apr 9, 2025
  1

• lm_eval result is not reproducible in multiple runs

  casper-hansen/AutoAWQ#738 · Filter by author oj9040 opened on Apr 9, 2025
  1

• internvl_chat isn't supported yet.

  casper-hansen/AutoAWQ#737 · Filter by author Maglanyulan opened on Apr 1, 2025

• Why hasn't the deepseek-v3 MTP layer of the 61st layer been quantized?

  casper-hansen/AutoAWQ#736 · Filter by author Yang851828 opened on Mar 31, 2025
  2

• Reason of occupying all gpus' memories but not using all gpus to compute

  casper-hansen/AutoAWQ#735 · Filter by author Helicopt opened on Mar 30, 2025

• About the quantization parameters when calling

  casper-hansen/AutoAWQ#734 · Filter by author 191220042 opened on Mar 27, 2025

• support aya vision

  casper-hansen/AutoAWQ#733 · Filter by author devops724 opened on Mar 22, 2025

• support gemma 3

  casper-hansen/AutoAWQ#732 · Filter by author devops724 opened on Mar 22, 2025
  2

• Error with transformers 4.48+

  casper-hansen/AutoAWQ#731 · Filter by author ghost opened on Mar 19, 2025
  2

• An error occurred when quantizing deepseek-r1-bf16 with longer data.

  casper-hansen/AutoAWQ#729 · Filter by author taishan1994 opened on Mar 19, 2025
  3

• Support for Mistral Small 3.1

  casper-hansen/AutoAWQ#728 · Filter by author Leflak opened on Mar 18, 2025

• Converting ph-4-mini model

  casper-hansen/AutoAWQ#727 · Filter by author farzanehnakhaee70 opened on Mar 14, 2025

• Support for Google Gemma 3

  casper-hansen/AutoAWQ#726 · Filter by author stelterlab opened on Mar 14, 2025
  2

• not working on wsl, impossible to install

  casper-hansen/AutoAWQ#725 · Filter by author Aveline67 opened on Mar 12, 2025
  2

• Quantizing DeepSeek-R1-Distill-Qwen-7B produces garbage and repetitive tokens

  casper-hansen/AutoAWQ#724 · Filter by author hav4ik opened on Mar 11, 2025
  4

• macos support

  casper-hansen/AutoAWQ#723 · Filter by author lucasjinreal opened on Mar 9, 2025

• backward

  casper-hansen/AutoAWQ#722 · Filter by author shuyuan-wang opened on Mar 8, 2025