Pass@k and Pass^k Tell Different Stories from Mean Success Rate
These metrics capture coverage and reliability.
Topic
nlp
10 posts
Kaggle Competition Report: Automated Essay Scoring 2.0
This competition was all about distribution shift. Let's learn how the winners conquered the challenge.
Aligning LLMs without Paired Preference Labels
It's hard to collect paired preferences. Can we align LLMs without them? Yes, with KTO!
Aligning LLMs without Reinforcement Learning
DPO reduces the effort required to align LLMs. Here is how I created the Reviewer #2 Bot from TinyLlama using DPO.
Kaggle Competition Report: LLM Science Exam
Can LLMs answer scientific questions? See how Kaggle winners used LLMs and RAG!
Training A Not-So-Large Language Model for $50
What I cannot create, I do not understand. Let's train your own LLM!
Kaggle Competition Report: Stable Diffusion
How do you invert the text-to-image generation by Stable Diffusion? Let's take a look at the solutions by the winning teams.
Tuning Large Language Models with Reinforcement Learning on a Single GPU
A quick guide for RLHF using trlX, OPT-1.5B, and LoRA.
Transformers Now: A Survey of Recent Advances
Transformer has undergone various application studies, model enhancements, etc. This post aims to provide an overview of these studies.
BERT That Works on Browser
This post explains how MobileBERT succeeded in reducing both model size and inference time and introduce its implementation in TensorFlow.js that works on web browsers.