Hippocampus's Garden

RLHF is not the only method for AI alignment. This article introduces modern algorithms like DPO and KTO that offer simpler and more stable alternatives.

パリ移住で様々な失敗を経ながら学んだ「生活の知恵」をまとめました。

NotebookLMを使って青空文庫版『罪と罰』をまとめました。

新天地で働き始めてもうすぐ1年になるので、所感をまとめました。

This competition was all about distribution shift. Let's learn how the winners conquered the challenge.

It's hard to collect paired preferences. Can we align LLMs without them? Yes, with KTO!

DPO reduces the effort required to align LLMs. Here is how I created the Reviewer #2 Bot from TinyLlama using DPO.

Chatbot Arena updated its LLM ranking method from Elo to Bradley-Terry. What changed? Let's dig into the differences.

Does your React Native app go back to an unexpected screen? Here's how to deal with it.

2023年に読んだ本を振り返ります。