LLM alignment and inference-time control — and shipping the results as software people actually run.
-
📄 Test-time alignment. Second author on Test-Time Alignment for Large Language Models via Textual Model Predictive Control (ICLR 2026), which treats generation as a predictive-planning problem: draft, score segment contributions with a reward model, re-plan. Preference alignment without touching the weights, aimed at long-form outputs where sequence-level rewards are too coarse.
-
🔨 Now. Building agent tooling and AI infrastructure — local-first observability for multi-agent coding sessions, and the workflow systems around them.
-
🎓 Background. M.S. Data Science & Engineering, National Yang Ming Chiao Tung University (2025) · B.S. Applied Mathematics, National Chengchi University (2023) · RL & Bandit Lab.
-
🧭 Working on: Large Language Models · Test-Time Alignment · Reinforcement Learning · Edge AI Deployment
| pixel-agents-multi | A local-first VS Code control room for Claude and Codex agents — pixel-office visualization, usage intelligence, timeline replay, and a handoff/executor queue. TypeScript |
| Plan2Align | Research code for the ICLR 2026 test-time alignment work: algorithm variants, reward-model tooling, math-reasoning and translation experiments. Python |
| Baseline_of_Plan2Align | Baseline implementations for the same work — ARGS, RAIN, and MetricX-24 evaluation. Python |
| CVAE_for_Human_Preference | Conditional VAE experiments: contextual-bandit regret minimization, and BERT-embedding human-preference/reward prediction on WebGPT comparisons. Python |
| ViT_MIL | Attention-based Multiple Instance Learning over ViT embeddings — bag-level classification from weak supervision only. Python |
| NCF_BERT4Rec | News click prediction: NCF, NCF-Layer, and a Transformer that scores a candidate slate jointly rather than item by item. Python |
| RL_from_Scratch | Policy/value iteration, REINFORCE (vanilla/baseline/GAE), and DDPG. Python |
| Deep_RL_Labs | TD learning (2048), DQN (Atari), PPO (Atari), and TD3 (CarRacing). Python |
| Convex_Optimization_Labs | Convex analysis proofs, first-order methods, variance-reduced SGD/SVRG, and QP/conic programming with Gurobi. Python |
