Phi-2

Basic Information

Organization
Microsoft
Parameters
2.7B
License
MIT
Last Update
2023-12-15
Links

Benchmark Scores

modelDetail.detailedInfo

Description

Small but highly efficient language model with impressive capabilities

Features

  • Exceptional efficiency
  • Small parameter count
  • Strong reasoning
  • Code generation
  • Research-oriented design

Use Cases

  • Resource-constrained environments
  • Research projects
  • Educational applications
  • Lightweight deployment
  • Model experimentation

Architecture Details

Type
Optimized Transformer
Context Window
4,000 tokens tokens
Training Data Size
1.4 trillion tokens