Falcon 180B

Basic Information

Organization
TII
Parameters
180B
License
Apache 2.0
Last Update
2023-09-20
Links

Benchmark Scores

modelDetail.detailedInfo

Description

Large-scale open-source model from Technology Innovation Institute

Features

  • Large parameter count
  • Research-focused design
  • Strong reasoning abilities
  • Diverse knowledge base
  • Open source availability

Use Cases

  • Scientific research
  • Academic projects
  • Model development
  • Knowledge extraction
  • Complex reasoning tasks

Architecture Details

Type
Advanced Transformer
Context Window
4,000 tokens tokens
Training Data Size
3.5 trillion tokens