https://awarenesssoftwaregroup.com/research/ Open research on how AI models actually learn. One finding per entry, in plain English first and in full technical detail underneath, including the approaches that turned out not to work. en Sat, 26 Sep 2026 10:15:23 +0000 https://awarenesssoftwaregroup.com/research/a-five-second-check/ https://awarenesssoftwaregroup.com/research/a-five-second-check/ Reusing a finished model to speed up a new one is worse than useless if you pick without looking. Sat, 26 Sep 2026 00:00:00 +0000 https://awarenesssoftwaregroup.com/research/a-fixed-budget-thinks-better/ https://awarenesssoftwaregroup.com/research/a-fixed-budget-thinks-better/ Penalising a model for thinking cut its thinking by 38% at almost no cost. Always letting it think for three steps beat that, and we found out why. Sat, 26 Sep 2026 00:00:00 +0000 https://awarenesssoftwaregroup.com/research/a-free-check-saturates-at-three/ https://awarenesssoftwaregroup.com/research/a-free-check-saturates-at-three/ A one-pass check that tells a helpful trained model from a harmful one gets all of its value from the first three candidates. Sat, 26 Sep 2026 00:00:00 +0000 https://awarenesssoftwaregroup.com/research/a-quarter-is-free/ https://awarenesssoftwaregroup.com/research/a-quarter-is-free/ Copying the wrong finished model into a new one is the worst thing we have measured. Sat, 26 Sep 2026 00:00:00 +0000 https://awarenesssoftwaregroup.com/research/a-rule-from-1990/ https://awarenesssoftwaregroup.com/research/a-rule-from-1990/ We finally asked what a pre-neural predictor scores on the task most of our results were measured on. Sat, 26 Sep 2026 00:00:00 +0000 https://awarenesssoftwaregroup.com/research/a-short-model-is-a-lottery/ https://awarenesssoftwaregroup.com/research/a-short-model-is-a-lottery/ Two of our own experiments reached opposite conclusions from one trained model each. Sat, 26 Sep 2026 00:00:00 +0000 https://awarenesssoftwaregroup.com/research/a-shortcut-only-matters-if-there-is-no-other-one/ https://awarenesssoftwaregroup.com/research/a-shortcut-only-matters-if-there-is-no-other-one/ Three of our results seemed to disagree about one piece of wiring. Sat, 26 Sep 2026 00:00:00 +0000 https://awarenesssoftwaregroup.com/research/a-small-dose-does-little/ https://awarenesssoftwaregroup.com/research/a-small-dose-does-little/ Mixing only part of a borrowed model into a new one does little, good or bad. Sat, 26 Sep 2026 00:00:00 +0000 https://awarenesssoftwaregroup.com/research/a-task-battery-with-designed-headroom/ https://awarenesssoftwaregroup.com/research/a-task-battery-with-designed-headroom/ Our quality checks all passed because the benchmark scored 99% and nothing could fail. Sat, 26 Sep 2026 00:00:00 +0000 https://awarenesssoftwaregroup.com/research/a-window-that-parks/ https://awarenesssoftwaregroup.com/research/a-window-that-parks/ We wrote down the practice plan an adaptive teacher discovered, as a two-setting rule. Sat, 26 Sep 2026 00:00:00 +0000 https://awarenesssoftwaregroup.com/research/being-choosy-about-data-costs-more-than-it-saves/ https://awarenesssoftwaregroup.com/research/being-choosy-about-data-costs-more-than-it-saves/ Inspect four batches, train only on the most informative. It sounds efficient. Sat, 26 Sep 2026 00:00:00 +0000 https://awarenesssoftwaregroup.com/research/calibrate-after-learning/ https://awarenesssoftwaregroup.com/research/calibrate-after-learning/ Training a thinking model's early answers blocked learning when done from the start. Done after it learned, it helped every run. Sat, 26 Sep 2026 00:00:00 +0000 https://awarenesssoftwaregroup.com/research/depth-costs-most-of-the-budget/ https://awarenesssoftwaregroup.com/research/depth-costs-most-of-the-budget/ A skill built on two layers of other skills took most of the training budget to learn, though alone it was the easiest of five. Sat, 26 Sep 2026 00:00:00 +0000 https://awarenesssoftwaregroup.com/research/depth-sets-the-order/ https://awarenesssoftwaregroup.com/research/depth-sets-the-order/ Given enough time, a small model learned five planted skills in the order of what depends on what on every run, even though the dependent skills were the Sat, 26 Sep 2026 00:00:00 +0000 https://awarenesssoftwaregroup.com/research/does-the-early-signal-generalise/ https://awarenesssoftwaregroup.com/research/does-the-early-signal-generalise/ Two findings that looked independent turn out to have identical boundaries. The early-warning gap appears exactly where the internal reorganisation does. Sat, 26 Sep 2026 00:00:00 +0000 https://awarenesssoftwaregroup.com/research/eight-runs-is-not-enough/ https://awarenesssoftwaregroup.com/research/eight-runs-is-not-enough/ A free experiment produced two statistically significant results pointing in opposite directions. Our first analysis reported one of them as a discovery. Sat, 26 Sep 2026 00:00:00 +0000 https://awarenesssoftwaregroup.com/research/how-fast-it-learned/ https://awarenesssoftwaregroup.com/research/how-fast-it-learned/ Choosing which existing model to build on: how fast each candidate learned its own task ranks the useful ones better than a quick check. Sat, 26 Sep 2026 00:00:00 +0000 https://awarenesssoftwaregroup.com/research/how-you-cut-a-model-matters/ https://awarenesssoftwaregroup.com/research/how-you-cut-a-model-matters/ Delete three quarters of a model's internal connections two different ways, keeping exactly the same number, and one way costs twice as much as the other. Sat, 26 Sep 2026 00:00:00 +0000 https://awarenesssoftwaregroup.com/research/is-transition-timing-controllable/ https://awarenesssoftwaregroup.com/research/is-transition-timing-controllable/ A nudge of one part in a hundred million delays learning by 21 steps. A nudge ten million times larger delays it by 24. Sat, 26 Sep 2026 00:00:00 +0000 https://awarenesssoftwaregroup.com/research/it-already-knew-the-order/ https://awarenesssoftwaregroup.com/research/it-already-knew-the-order/ We found the order in which a model learns three related skills, then tried teaching them in that order. Sat, 26 Sep 2026 00:00:00 +0000 https://awarenesssoftwaregroup.com/research/it-is-not-how-much-you-remove/ https://awarenesssoftwaregroup.com/research/it-is-not-how-much-you-remove/ Removing one direction from a model's training signal at the right moment causes most of the damage that stopping the whole component does. Sat, 26 Sep 2026 00:00:00 +0000 https://awarenesssoftwaregroup.com/research/it-sees-the-damage-not-the-repair/ https://awarenesssoftwaregroup.com/research/it-sees-the-damage-not-the-repair/ Rounding a model's weights to fewer bits damages it. Measuring its internal shape spots the damage, but a repaired model works again with a changed shape. Sat, 26 Sep 2026 00:00:00 +0000 https://awarenesssoftwaregroup.com/research/learning-it-again-is-not-like-learning-it/ https://awarenesssoftwaregroup.com/research/learning-it-again-is-not-like-learning-it/ We changed the task underneath a trained model and watched it learn again. Sat, 26 Sep 2026 00:00:00 +0000 https://awarenesssoftwaregroup.com/research/looking-is-not-using/ https://awarenesssoftwaregroup.com/research/looking-is-not-using/ One model finds the right word as fast as the other and answers correctly less than half as often. Finding and using turn out to be separate abilities. Sat, 26 Sep 2026 00:00:00 +0000 https://awarenesssoftwaregroup.com/research/neither-half-works-alone/ https://awarenesssoftwaregroup.com/research/neither-half-works-alone/ A trained model's machinery splits into directions and strengths. Sat, 26 Sep 2026 00:00:00 +0000