Skip to content
View figkcoci-debug's full-sized avatar

Block or report figkcoci-debug

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
figkcoci-debug/README.md

figkcoci

Mobile AI, ternary quantization, C++ and Rust.

I build tools for running large language models on phones.

  • PEHT folded Hadamard ternary 27B models on Android, 13x faster than the vendor PQ2_0 path at the same quality
  • phone-cluster one local LLM across two Android phones over USB with ggml-rpc
  • upstream work in llama.cpp Vulkan device fault handling and ggml-rpc reliability

Focused on ternary weights, phone memory bandwidth, and NPU/CPU scheduling.

Main profile · PEHT whitepaper

Popular repositories Loading

  1. peht peht Public

    Hadamard-rotated ternary LLMs on Android. 13x faster than the vendor PQ2_0 path at the same quality. PQ2_0 to TQ2_0 converter, bit-exact TQ1_0 repacker and verifier.

    Python 4 1

  2. llama.cpp llama.cpp Public

    Forked from ggml-org/llama.cpp

    LLM inference in C/C++

    C++ 1 1

  3. llama.rn llama.rn Public

    Forked from mybigday/llama.rn

    React Native binding of llama.cpp

    C

  4. figkcoci-debug figkcoci-debug Public

    Mobile AI, ternary quantization, C++/Rust. PEHT and phone-cluster.

  5. actions-test actions-test Public

  6. snapdragon-build snapdragon-build Public

    C++