Papersby GlyphPhi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone research paper by Microsoft, 2024
Microsoft · Foundation models · Apr 22, 2024 · 2,649 citations · 262 upvotes
What it shows
Small models trained on filtered and synthetic data that run on a phone and rival much larger ones.
By Marah Abdin, Sam Ade Jacobs, Ammar Ahmad Awan and 81 more · arXiv 2404.14219 · PDF
Summarised by hand from the abstract.
More from Microsoft
All 57WebHarbor: Docking Real Websites for Evolving GUI Agent EnvironmentsWebHarbor provides realistic, containerized website environments for training and testing computer-using web agents across complex online tasks.
Microsoft28 upvotesRead →Agent World Model in the Wild: Computer-Use Agent Environment SynthesisThis pipeline creates controllable, open-source environments to safely train and test AI agents on complex, long-horizon computer-use tasks.Microsoft69 upvotesRead →Self-Evolving Coding Agents via Harness-Policy OptimizationThis framework improves coding agents by recursively alternating between optimizing the agent's policy and the environment harness it uses to interact with code.Microsoft48 upvotesRead →AesCode: Aesthetic Code Generation with Decoupled Cross-Modal RewardsThis paper introduces a method to improve code-based visual generation by using image-based aesthetic guidance and decoupled rewards to ensure quality and correctness.Microsoft137 upvotesRead →APT: Feedback-Driven Agentic Post-Training for Text-to-Image GenerationThis paper introduces an automated post-training framework that uses a feedback loop of evaluation and diagnosis to improve text-to-image models.Microsoft23 upvotesRead →LensErase: A Foundation Model for Erase AnythingThis paper introduces a foundation model designed for versatile image editing and object removal using mask-based inputs and efficient positional encoding.Microsoft52 upvotesRead →Simplifying and Improving On-Policy Distillation for Few-Step DiffusionThis paper introduces a simplified regression-based method for distilling diffusion models that improves generation speed without requiring complex training techniques.Microsoft27 upvotesRead →MiniCorp: The Last Mile of the AI Agent FirmMiniCorp is an office simulator that allows researchers to study how agents run companies and generate enterprise data for training.Microsoft39 upvotesRead →
Other foundation models papers
TopicBERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingPre-training a Transformer to fill in masked words, then fine-tuning it, beat task-specific models across language understanding tests.
Google125k citations33 upvotesRead →Language Models are Few-Shot LearnersGPT-3, a 175B-parameter model, does new tasks from a few examples in the prompt, with no fine-tuning.
OpenAI66.4k citations21 upvotesRead →GPT-4 Technical ReportA multimodal model that passes a simulated bar exam with a score around the top 10% of test takers.OpenAI28.4k citations7 upvotesRead →LLaMA: Open and Efficient Foundation Language ModelsOpen models from 7B to 65B trained only on public data; the 13B model beats GPT-3 on most benchmarks.
Meta22.6k citations25 upvotesRead →The Llama 3 Herd of ModelsOpen models up to 405B parameters that match leading closed models on many tasks.Meta20.8k citations119 upvotesRead →Qwen3 Technical ReportQwen3, a unified series of large language models, integrates thinking and non-thinking modes, reduces computational resources, and achieves state-of-the-art performance across various tasks and languages.
Alibaba (Qwen)10.1k citations339 upvotesRead →
About this paper
- Venue
- arXiv.org
- Citations
- 2,649, 379 influential · Semantic Scholar
- Upvotes
- 262 · Hugging Face
- Lab
- Microsoft · on Companies · on Acquisitions · on Quarterly · on Paydays · on Releases · on TechConf
Changes
Influential citations rose from 375 to 379.
Citations rose from 2,628 to 2,649.
Influential citations rose from 364 to 375.
Citations rose from 2,553 to 2,628.
Influential citations fell from 365 to 364.
Citations rose from 2,533 to 2,553.
Citations rose from 2,508 to 2,533.
Influential citations rose from 364 to 365.
Citations rose from 2,497 to 2,508.
Added to the list.