MPT 30B

Basic Information

Organization
MosaicML
Parameters
30B
License
Apache 2.0
Last Update
2023-05-05
Links

Benchmark Scores

modelDetail.detailedInfo

Description

Large open-source model with strong performance and commercial usage rights

Features

  • Commercial-friendly license
  • Efficient architecture
  • Strong text generation
  • Flexible deployment
  • Community support

Use Cases

  • Commercial applications
  • Text generation
  • Content creation
  • Research projects
  • Model fine-tuning

Architecture Details

Type
Modified Transformer
Context Window
8,000 tokens tokens
Training Data Size
1.8 trillion tokens