Hippocampus's Garden

Transformer has undergone various application studies, model enhancements, etc. This post aims to provide an overview of these studies.

This post explains how MobileBERT succeeded in reducing both model size and inference time and introduce its implementation in TensorFlow.js that works on web browsers.