1 essay on this topic.
How big AI models get small enough for a laptop or phone: quantization, distillation, pruning, what each one costs, and the licence questions.