Papersby GlyphThe Impact of AI on Developer Productivity: Evidence from GitHub Copilot research paper by GitHub, 2023
GitHub · Foundation models · Feb 13, 2023 · 906 citations
What it shows
In a controlled experiment, developers with GitHub Copilot finished a programming task 55.8% faster than those without it.
By Sida Peng, Eirini Kalliamvakou, Peter Cihon and 1 more · arXiv 2302.06590 · PDF
Summarised by hand from the abstract.
More from GitHub
All 3Sea Change in Software Development: Economic and Productivity Analysis of the AI-Powered Developer LifecycleAcross nearly a million Copilot users, developers accepted about 30% of suggested code, with the highest acceptance among less experienced developers.
GitHub52 citationsRead →Productivity Assessment of Neural Code CompletionFinds that how often developers accept Copilot's suggestions, more than other usage measures, predicts how productive they feel.GitHub349 citationsRead →
Other foundation models papers
TopicBERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingPre-training a Transformer to fill in masked words, then fine-tuning it, beat task-specific models across language understanding tests.
Google125k citations33 upvotesRead →Language Models are Few-Shot LearnersGPT-3, a 175B-parameter model, does new tasks from a few examples in the prompt, with no fine-tuning.
OpenAI66.4k citations21 upvotesRead →GPT-4 Technical ReportA multimodal model that passes a simulated bar exam with a score around the top 10% of test takers.OpenAI28.4k citations7 upvotesRead →LLaMA: Open and Efficient Foundation Language ModelsOpen models from 7B to 65B trained only on public data; the 13B model beats GPT-3 on most benchmarks.
Meta22.6k citations25 upvotesRead →The Llama 3 Herd of ModelsOpen models up to 405B parameters that match leading closed models on many tasks.Meta20.8k citations119 upvotesRead →Qwen3 Technical ReportQwen3, a unified series of large language models, integrates thinking and non-thinking modes, reduces computational resources, and achieves state-of-the-art performance across various tasks and languages.
Alibaba (Qwen)10.1k citations339 upvotesRead →
About this paper
- Venue
- arXiv.org
- Citations
- 906, 121 influential · Semantic Scholar
- Upvotes
- 0 · Hugging Face
- Lab
- GitHub · on Companies · on Paydays · on Releases
Changes
Influential citations fell from 123 to 121.
Citations rose from 885 to 906.
Influential citations rose from 114 to 123.
Citations rose from 827 to 885.
Influential citations rose from 113 to 114.
Citations rose from 817 to 827.
Influential citations rose from 109 to 113.
Citations rose from 812 to 817.
A first count of 109 influential citations.
A first count of 812 citations.
Added to the list.