Training A Not-So-Large Language Model for $50
September 08, 2023 | 3 min readWhat I cannot create, I do not understand. Let's train your own LLM!
![[object Object]](/static/2d0f4e01d6e61412b3e92139e5695299/d8057/profile-pic.webp)
Tuning Large Language Models with Reinforcement Learning on a Single GPU
March 30, 2023 | 7 min readA quick guide for RLHF using trlX, OPT-1.5B, and LoRA.
Transformers Now: A Survey of Recent Advances
November 02, 2020 | 10 min readTransformer has undergone various application studies, model enhancements, etc. This post aims to provide an overview of these studies.
BERT That Works on Browser
May 22, 2020 | 4 min readThis post explains how MobileBERT succeeded in reducing both model size and inference time and introduce its implementation in TensorFlow.js that works on web browsers.
