1 essay on this topic.
Why ' SolidGoldMagikarp' broke GPT-3: how tokenizers and models are trained apart, under-trained tokens, how labs fixed it, and other tokenizer quirks.
