Kaggle Competition Report: Automated Essay Scoring 2.0
July 07, 2024 | 5 min readThis competition was all about distribution shift. Let's learn how the winners conquered the challenge.
![[object Object]](/static/2d0f4e01d6e61412b3e92139e5695299/d8057/profile-pic.webp)
Aligning LLMs without Paired Preference Labels
May 08, 2024 | 3 min readIt's hard to collect paired preferences. Can we align LLMs without them? Yes, with KTO!
Aligning LLMs without Reinforcement Learning
April 27, 2024 | 3 min readDPO reduces the effort required to align LLMs. Here is how I created the Reviewer #2 Bot from TinyLlama using DPO.
Kaggle Competition Report: LLM Science Exam
November 19, 2023 | 4 min readCan LLMs answer scientific questions? See how Kaggle winners used LLMs and RAG!
Training A Not-So-Large Language Model for $50
September 08, 2023 | 3 min readWhat I cannot create, I do not understand. Let's train your own LLM!
Kaggle Competition Report: Stable Diffusion
June 25, 2023 | 3 min readHow do you invert the text-to-image generation by Stable Diffusion? Let's take a look at the solutions by the winning teams.
Tuning Large Language Models with Reinforcement Learning on a Single GPU
March 30, 2023 | 7 min readA quick guide for RLHF using trlX, OPT-1.5B, and LoRA.
Transformers Now: A Survey of Recent Advances
November 02, 2020 | 10 min readTransformer has undergone various application studies, model enhancements, etc. This post aims to provide an overview of these studies.
BERT That Works on Browser
May 22, 2020 | 4 min readThis post explains how MobileBERT succeeded in reducing both model size and inference time and introduce its implementation in TensorFlow.js that works on web browsers.
