5DaWwWmR-7971731779safetensorsbf16Public
blatomini/teutonic-5hynfa64-5dawwwmr-7971731779
sha256:de31dab8252494dc511597a594f2ebe2564f73d695aa3e61a00fe5cc8ebfb993·Indexed 25d ago
Parameters
8.6B
Total size
16.0 GB
Files
7
Quantization
BF16
No README on this version
Push a README.md with the model files to see it rendered here.
Model architecture
config.json- Architecture
- QuasarForCausalLM
- Model type
- quasar_text
- Hidden size
- 4,096
- Layers
- 32
- Attention heads
- 16 (4 kv)
- FFN size
- 12,288
- Vocab size
- 248,320
- Context window
- 2048K
Files
7 itemsmodel-00003-of-00004.safetensors
8c79d6157077
4.7 GB
safetensors
model-00002-of-00004.safetensors
bba1ac330e53
4.7 GB
safetensors
model-00001-of-00004.safetensors
fc5b0a704a1f
4.6 GB
safetensors
model-00004-of-00004.safetensors
dbff689ae80e
2.1 GB
safetensors
model.safetensors.index.json
62d1e320ad1a
37.2 KB
config.json
63b9b7e15f7f
2.1 KB
generation_config.json
4c25e4a6e8e5
214 B