MIT’s LARS Cuts Memory Needed to Fine-Tune LLMs on Small Devices

Smartwatch and small computer board on a desk linked by a stream of compressed glowing data layers
AI-generated illustration Running an AI model on a phone or a fitness watch sounds simple until you try to teach it something new. Training on the device itself, rather than in the cloud, can eat gigabytes of memory in moments, and the usual result is an out-of-memory error. A team at MIT's Computer Science and Artificial Intelligence Laboratory (CSAIL), working with a Harvard researcher, says it has a way to ease that squeeze. The method is called LARS, and it works by keeping the model...
More

KAIST’s CluSTER Cuts AI Fine-Tuning Time by 70%

Training a specialist AI model is expensive mostly because of repetition. Researchers at KAIST say they have found a way to cut that repetition: a method called CluSTER fine-tuned a model on medical question-and-answer data using about 31 percent of the dataset and cut training time by 69.6 percent, with only a small loss in accuracy, Aju Press reported on November 2, 2026. The problem: fine-tuning wastes GPU time Large language models first learn broad knowledge, then developers fine-tune them...
More