auto07safetensorsbf16Public
trainingbot/teutonic-5fuv4m16-auto07
sha256:7ad1ed9328046e873278c123ac14850a490ae9a235b8df1a4ab8ed0b4e3585dd·Indexed 20d ago
Parameters
8.6B
Total size
16.0 GB
Files
9
Quantization
BF16
No README on this version
Push a README.md with the model files to see it rendered here.
Model architecture
config.json- Architecture
- QuasarForCausalLM
- Model type
- quasar_text
- Hidden size
- 4,096
- Layers
- 32
- Attention heads
- 16 (4 kv)
- FFN size
- 12,288
- Vocab size
- 248,320
- Context window
- 2048K
Files
9 itemsmodel-00003-of-00004.safetensors
296d532b7002
4.7 GB
safetensors
model-00002-of-00004.safetensors
700db380bbb0
4.7 GB
safetensors
model-00001-of-00004.safetensors
e8e5c76d5d5e
4.6 GB
safetensors
model-00004-of-00004.safetensors
e5f6be40a419
2.1 GB
safetensors
tokenizer.json
87a7830d63fc
19.1 MB
model.safetensors.index.json
7c9b09b421e1
37.2 KB
config.json
df508f82075a
2.0 KB
tokenizer_config.json
5b49da270cb9
1.1 KB
generation_config.json
c15bf8fb34cf
178 B