Skip to content
View PhilipJohnBasile's full-sized avatar
🥅
Let's collaborate!
🥅
Let's collaborate!

Sponsoring

@unslothai

Block or report PhilipJohnBasile

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
PhilipJohnBasile/README.md

Philip John Basile — Make something matter. Open the project lab below.
The patches — jump to upstream contributionsThe lab — jump to expandable projectsField notes — jump to writing and experimentsSay hello — jump to contact

Pick a door. Open a project. Follow the thread.

I’m Philip John Basile. Principal AI systems engineer at Basilcom Inc., open-source contributor, and a maker since 1998. I’ve worked on creative campaigns, commerce, telehealth, enterprise search, and mission planning. Today I build AI systems teams can rely on, from enterprise agents to small code models and the runtimes behind local inference on Apple Silicon.

Explore the full portfolio ↗ · Try a live model ↗ · Browse my models & data ↗

01 / Upstream — Good code travels.

I contribute to the tools I use. Start with three merged fixes in Apple’s MLX and MLX-LM:

Merged patch What changed
MLX #3922 ↗ Correct results beyond 32K rows in sorted quantized matrix multiplication.
MLX #4202 ↗ Correct scale and bias indexing for small quantization groups.
MLX-LM #1623 ↗ Prevent a second normalization shift when converting Qwen weights.

All upstream work ↗

Pull out the full patch drawer — Unsloth, MTPLX, oMLX, and more

I contribute to the tools I use. That includes merged fixes in Apple's MLX and MLX-LM, along with ongoing work on Unsloth Studio, MTPLX, and oMLX.

Project What I've been working on Status
Apple MLX Fixed issues in quantized matrix multiplication involving row overflow and small quantization groups. Merged
Apple MLX-LM Fixed a Qwen model conversion bug that applied a normalization adjustment twice. Merged
Unsloth Studio Working on agents that make changes in separate Git worktrees and run tests and builds with execution limits. Open PRs
MTPLX Contributed Hy3 and Qwen native MTP backends, plus JSON-schema output, structured tool calls, and recovery after daemon crashes. Shipped upstream; more PRs open
oMLX Fixed MLX memory reclamation and Python version compatibility checks for bundled kernels. Merged; more PRs open
AirRunner's MLX-LM Improved MTP cache handling, token probabilities, and validation. Merged

I've also submitted PRs to MLX Serve, vLLM Metal, dflash, Google Ads MCP, Nixpkgs, conda-forge, MacPorts, Rust, and Bootstrap.

See my upstream pull requests

02 / The lab — Click a cover to open a project.

The patches lead into the work itself: training a model, making it run, and giving it useful tools. Open a cover to explore the project, then launch the demo or follow the evidence. Keyboard: focus a cover and press Enter.

Open or close case 01: Wisp Coder

A small model. The whole training story.

I trained Wisp Coder from tokenizer to released weights on Apple Silicon: a 32K-token tokenizer, 108.2M parameters, and 5 billion training tokens, with fill-in-the-middle and native multi-token prediction. The trunk has 100.7M parameters; 108.2M includes the MTP module.

Try this: open the demo, edit the code around the cursor, and ask Wisp to fill the gap. The free CPU demo uses the standard decoder.

Try Wisp in your browser — opens the live demo

Model card & weights ↗ · Training case study ↗ · Portfolio story ↗

The record includes comparisons that didn’t favor Wisp. The packaged MTP runtime checks correctness; the release does not claim a production MTP speedup.

Open or close case 02: Agent Systems

Connect the tools. Keep the boundaries.

MCP integrations, reusable skills, identity, and approval workflows for the systems a business already uses. At Basilecom / Transmission Agency, my platform work supports 120 staff across the UK, US, and APJ, with 12+ production MCP integrations.

The current open-source direction brings that work onto the desktop: isolated coding workspaces, bounded execution, and one visible browser a person and an agent can use together. The shared-browser work is in progress, with recovery and human takeover part of what is being built and qualified.

Explore this: follow how access, tool contracts, operational controls, and adoption fit together in the case study.

Explore the agent platform — opens the portfolio case study

Engineering case study ↗ · MCP is a governance problem ↗

Open or close case 03: Local Inference

Closer to the hardware.

MLX conversions, native multi-token prediction in MTPLX, and SSD-backed expert streaming with iliria. The work spans runtime behavior, weights, memory, and storage.

Explore this: start with the architecture, then inspect source revisions, runtime recipes, and published measurement records before choosing a model.

Explore local inference — opens the portfolio case study

iliria source ↗ · Measuring inference fairly ↗ · Apple Silicon AI catalog ↗

Open or close case 04: RAG & Releases

Make retrieval earn its place in production.

RAG systems with evaluation across retrieval, answer grounding, latency, cost, and regression behavior. The useful part is the release process around the answer.

Explore this: follow the retrieval and evaluation loop, including the checks used to catch regressions before release.

Explore the RAG system — opens the portfolio case study

Learn by building the loop ↗ · More engineering case studies ↗

Open the toolbox — iliria, racecontrol, CallSieve, VecStore, and PhilJS
  • iliria: C/Metal inference that streams large MoE models from SSD, built on colibri. I also published the GLM-5.2 int4 container it serves.
  • racecontrol: routing and failure recovery across local inference engines, with a runnable HTTP demo.
  • CallSieve: local code retrieval for coding agents, with CLI and MCP interfaces.
  • VecStore: embedded vector search with metadata filtering and persistence.
  • PhilJS: an experimental TypeScript UI framework with a dependency-free signals demo.

More projects, model experiments, and creative work

Inspect the evidence — five engineering case studies

Browse the engineering case studies.

Five examples of the work behind the project list:

All projects ↗ · ↑ Back to the doors

03 / Models, data & demos — Take it for a spin. Open the Local AI Guide.

This is where the model work lands: original training, compression, MLX conversions, data, and live demos. The Local AI Guide connects each release to its model card, inspected revision, runtime requirements, and evaluation records.

Start with Wisp’s code-completion playground, follow the Hy3 compression experiments, or inspect the training and calibration data.

20 public model repositories · 1 public dataset · 2 public Spaces
Hugging Face Hub snapshot, September 11, 2026.

Models ↗ · Training data ↗ · Full catalog ↗

Unpack the releases — training, conversions, datasets, and results

My Hugging Face work covers original models, conversions, experimental derivatives, and training data. I work on both the models themselves and the engineering needed to run them locally.

20 public model repositories · 1 public dataset · 2 public Spaces · 11,388 monthly model downloads

Hugging Face Hub snapshot, September 11, 2026; downloads summed across my public model repositories.

Explore my Local AI Guide. I built a searchable catalog of the releases so you can browse by project, use case, artifact type, and download size. Each entry links to the model card, the inspected revision, and available evaluation records, with the runtime requirements explained alongside it.

Wisp Coder: a model I built from scratch

Try Wisp in your browser. Edit the code around the cursor and ask it to fill the gap. The free demo runs the standard decoder on CPU.

With Wisp Coder 110M, I took the work from tokenizer training to released weights. I trained a 32K-token tokenizer on 400,000 documents and a 108.2M-parameter code model on 5 billion tokens using MLX on Apple Silicon. Fill-in-the-middle and multi-token prediction were part of training from the start.

I checked the export against Transformers, published decoding correctness checks, and evaluated five models across 1,372 code-completion tasks. I published the comparisons even when they didn't favor Wisp. The Wisp case study covers the design decisions, evidence, and limitations.

Model compression and conversions

  • Hy3 and GLM-5.2 compression — Pruned mixture-of-experts models, trained LoRA adapters, and published smaller MLX builds. The Hy3 release removes 25% of experts per layer, then uses LoRA training to recover capability. The cards include evaluations, regressions, and the exact runtime recipes.
  • Qwen Fable-Fusion for MLX and MTPLX — Reconstructed DavidAU's GGUF release for MLX, published 4-, 6-, and 8-bit builds, and calibrated the multi-token prediction head. The featured 6-bit build includes vision support through MTPLX, with conversion details and measured decoding results in the card.
  • Ornith 1.5 for MTPLX — Converted Ornith AI's model for Apple Silicon with mixed-precision weights and a BF16 MTP head. The card documents source provenance, runtime requirements, and what has and hasn't been validated.
  • Akka for MLX — Converted nightmedia's merge to 6-bit MLX and checked its draft head against the target model. Calibration failed, so I released it without the MTP head and published the results.
  • DeepSeek V4 Flash for MLX — Built an experimental conversion and published comparisons against the original model, including a full 198-question GPQA Diamond run. Retained as a reference, with the quality regressions and faster alternative documented.

Datasets and training pipelines

I published GLM-5.2 Demolition training and calibration data: 154 JSONL files covering code training, agent tool-use examples, repair, domain-specific adapters, and expert-pruning calibration.

I also built the import and verification tools around it: sampling by domain, normalizing chat and tool messages, keeping source labels, and separating training examples from calibration prompts. The data-to-model case study follows the public code and records into the Hy3 model experiments.

Explore the datasets, training methods, and all 20 model repositories

I also group featured releases in Selected Work and research artifacts in Apple Silicon — Experimental Models.

Browse all models · Browse datasets

04 / The person behind the patches — Still building.

I started building university websites at Fordham in 1998. At 360i, I worked on campaign experiences including Oreo Daily Twist and the Super Bowl blackout response; at BaubleBar, on commerce and launches. That is where my interest in craft, motion, and participation comes from.

Then came telehealth, clinical systems, enterprise search, cybersecurity, and mission planning. Today’s AI work draws on all of it: an interface should feel good to use, and the system behind it needs to hold up.

More about my background ↗

Open the backstory — platforms, outcomes, and team development

I started building university websites at Fordham. Since then, I've worked on IBM's enterprise search, Atlas Air's flight scheduling, Dragos's cybersecurity products, and U.S. Air Force mission-planning software through client engagements. My healthcare work includes Teladoc and IntegraMed; earlier, I helped build commerce at BaubleBar and campaign experiences at 360i.

That range matters when a project gets complicated. I've had to balance user experience, sensitive data, uptime, budgets, and deadlines—and help other engineers do the same.

At Teladoc, I worked on telehealth through its NYSE debut. At IntegraMed, on clinical systems and machine learning. The environments changed, but the work kept coming back to user experience, sensitive data, performance, and dependable releases.

A few examples from my recent work:

  • AI platform ownership: Architecture and technical direction for a global agency, supporting 120 staff across the UK, US, and APJ, including 12+ production MCP integrations.
  • Operating cost: A Snowflake permissions and governance cleanup that reduced credit consumption by 35%, about £2,800 a month.
  • Team development: Led teams of 4–20 and coached five engineers into senior roles.

I’m based in New Rochelle. Away from software, I’ve volunteered with the Civil Air Patrol, photographed staff portraits pro bono for Pelham Children’s Center, and spent years involved in youth hockey.

Full career record · Career background and case studies

05 / Field notes — Leave a paper trail.

A note in the margin — what didn’t work

A useful research record includes the misses. Wisp’s published comparisons include results that favored other models. The Akka conversion shipped without its MTP head after calibration failed. The experimental DeepSeek conversion documents quality regressions and a faster alternative.

That’s part of leaving a trail someone else can actually use.

More writing ↗ · Medium ↗ · ↑ Back to the doors

Let’s make a useful dent — start a conversation

I'm interested in principal and staff engineering roles where I can own the architecture, stay close to the code, and help a team ship useful AI systems. If that sounds like your team—or you've tried one of these projects—I'd like to hear from you.

Email · Portfolio · Hugging Face · Writing · More links · Support my open-source work

Pinned Loading

  1. ml-explore/mlx ml-explore/mlx Public

    MLX: An array framework for Apple silicon

    C++ 28.4k 2.2k

  2. engineering-case-studies engineering-case-studies Public

    Engineering case studies: model training, dataset pipelines, Apple MLX fixes, local inference, and enterprise AI platform ownership.

  3. callsieve callsieve Public

    Local code retrieval for AI coding agents. Rust CLI and MCP server with indexing, compact context, and reproducible evaluation tools.

    Rust 3

  4. iliria iliria Public

    Experimental C/Metal inference engine for SSD-streamed MoE models on Apple Silicon. Built on colibri, with published measurement records.

    Python 3

  5. vecstore vecstore Public

    Embeddable vector search in Rust: metadata filtering, persistence, and optional Python/WASM interfaces. Alpha.

    Rust 16 2

  6. racecontrol racecontrol Public

    OpenAI-compatible local inference router with configurable tiers, circuit breakers, streaming, and fallback. Includes a model-free HTTP demo.

    Python 1