GitHub Copilot's New Custom Model: 20% More Retained Code, 3x Faster
GitHub rebuilt Copilot's completions engine with a custom model trained for fill-in-the-middle. The result: 20% more retained code, 12% higher acceptance, 3x throughput, and 35% lower latency. Here's how they trained it and what changes for developers.