Few-shot example injection #15

New issue

Open

opened 2026-04-07 20:23:30 +00:00 by austin · 0 comments

austin commented

2026-04-07 20:23:30 +00:00

Owner

Implement automatic few-shot example selection from the project codebase.

Given a generation task, find similar existing code in the project (via embedding similarity + structural matching)
Include 1-3 examples in the prompt as demonstrations of the project's style and patterns
Examples should show the same kind of construct the model is being asked to produce (e.g., if writing an API handler, show existing API handlers)
Trim examples to fit within the few-shot budget allocation

Small models benefit enormously from in-context examples. A 3B model asked to "write a test" with zero examples produces generic code; shown two tests from the same project, it matches the style and conventions.

Implement automatic few-shot example selection from the project codebase. - Given a generation task, find similar existing code in the project (via embedding similarity + structural matching) - Include 1-3 examples in the prompt as demonstrations of the project's style and patterns - Examples should show the same kind of construct the model is being asked to produce (e.g., if writing an API handler, show existing API handlers) - Trim examples to fit within the few-shot budget allocation Small models benefit enormously from in-context examples. A 3B model asked to "write a test" with zero examples produces generic code; shown two tests from the same project, it matches the style and conventions.