mainsafetensorsbf16Public
miracleknowsall/teutonic-5eqywb3t-v1
sha256:864e6b1ab3f4069f8621d81850ee94989fec8eebb21d207b7707a3b72bdb8c2d·Indexed 9d ago
Parameters
8.6B
Total size
16.0 GB
Files
7
Quantization
BF16
No README on this version
Push a README.md with the model files to see it rendered here.
Model architecture
config.json- Architecture
- QuasarForCausalLM
- Model type
- quasar_text
- Hidden size
- 4,096
- Layers
- 32
- Attention heads
- 16 (4 kv)
- FFN size
- 12,288
- Vocab size
- 248,320
- Context window
- 2048K
Files
7 itemsmodel-00003-of-00004.safetensors
003016277b08
4.7 GB
safetensors
model-00002-of-00004.safetensors
dda70d067f2d
4.7 GB
safetensors
model-00001-of-00004.safetensors
2ee34e21c45e
4.6 GB
safetensors
model-00004-of-00004.safetensors
5dbe71119a7e
2.1 GB
safetensors
model.safetensors.index.json
62d1e320ad1a
37.2 KB
config.json
63b9b7e15f7f
2.1 KB
generation_config.json
4c25e4a6e8e5
214 B