Research Notes

The Rise of Prompt Engineering

By Satwik ยท February 2, 2026

As soon as few-shot learning became the primary way to use large models, the wording of the prompt turned into a real variable. Prompt engineering is the practice of designing inputs, instructions, example selection and ordering, and output formats, to coax reliable behavior out of a frozen model. In 2020-2021 it went from folklore shared in threads to a semi-formal craft, and researchers began measuring how much it mattered.

The findings were sobering. Performance could swing widely with superficial changes: the order of few-shot examples, the exact label words, whether a task was phrased as a question or a cloze. Some of this variance reflected the model latching onto spurious cues rather than the intended task. Techniques like calibration and careful template design recovered some stability, but the core lesson was that a single number on a single prompt is a weak measurement.

Reading angle

For a security and evaluation reader, prompt sensitivity is a warning about assurance. If a benign rephrasing can move accuracy by tens of points, then a benchmark result says little about worst-case behavior. It also means red-teaming must search over prompt space, because an attacker will. Prompt engineering is often described as making models more capable, but the flip side is that it exposes how brittle and steerable they are. Read the early prompting literature as evidence that these systems are controllable in both directions, and that robustness, not peak performance, is the property worth reporting.