dendrite/quasar10b-chkpt-2000
Parameters
8.6B
Total size
78.1 GB
Files
17
Quantization
FP32
No README on this version
Push a README.md with the model files to see it rendered here.
Model architecture
config.json- Architecture
- QuasarForCausalLM
- Model type
- quasar_text
- Hidden size
- 4,096
- Layers
- 32
- Attention heads
- 16 (4 kv)
- FFN size
- 12,288
- Vocab size
- 248,320
- Context window
- 2048K
Files
17 itemspytorch_model_fsdp.bin
a92243544302
32.0 GB
pytorch
model.safetensors
c338696eb03f
32.0 GB
safetensors
optimizer.bin
000c0393caaa
14.0 GB
pytorch
tokenizer.json
87a7830d63fc
19.1 MB
modeling_qwen3_5.py
a9e25ab03df1
104.7 KB
rng_state_1.pth
8e0fc296e6f8
16.0 KB
pytorch
rng_state_2.pth
c6399da60ecd
16.0 KB
pytorch
rng_state_3.pth
7e1f1975564e
16.0 KB
pytorch
rng_state_4.pth
f85c9d057fba
16.0 KB
pytorch
rng_state_5.pth
fae7634eccbd
16.0 KB
pytorch
rng_state_6.pth
fc671e9ecff8
16.0 KB
pytorch
rng_state_7.pth
89ae733cbfe3
16.0 KB
pytorch
chat_template.jinja
a4aee8afcf2e
7.6 KB
training_args.bin
afc7bb4cbb19
5.6 KB
pytorch
config.json
212e00869dfe
2.1 KB
tokenizer_config.json
bc5c8eeefac2
1.1 KB
generation_config.json
75521f2ad5f9
214 B