tora/albedo-qwen3.6-35b-miner-1dcd45b1
Parameters
35.1B
Total size
65.4 GB
Files
29
Quantization
BF16
No README on this version
Push a README.md with the model files to see it rendered here.
Model architecture
config.json- Architecture
- Qwen3_5MoeForConditionalGeneration
- Model type
- qwen3_5_moe
- Hidden size
- 2,048
- Layers
- 40
- Attention heads
- 16 (2 kv)
- Vocab size
- 248,320
- Context window
- 256K
- Dtype
- bfloat16
Files
29 itemsmodel-00002-of-00021.safetensors
ac6168868c7e
3.6 GB
safetensors
model-00001-of-00021.safetensors
30932303c480
3.5 GB
safetensors
model-00007-of-00021.safetensors
32f1df62e845
3.2 GB
safetensors
model-00009-of-00021.safetensors
808dbb4a3324
3.2 GB
safetensors
model-00011-of-00021.safetensors
3f281836ac4b
3.2 GB
safetensors
model-00013-of-00021.safetensors
9adb349552dd
3.2 GB
safetensors
model-00015-of-00021.safetensors
9bdbe22f8c9d
3.2 GB
safetensors
model-00017-of-00021.safetensors
77ae24df0643
3.2 GB
safetensors
model-00019-of-00021.safetensors
2e9870ac5855
3.2 GB
safetensors
model-00003-of-00021.safetensors
4b338834bf3f
3.2 GB
safetensors
model-00005-of-00021.safetensors
56bc3fd5452a
3.2 GB
safetensors
model-00008-of-00021.safetensors
74dc91c092e4
3.1 GB
safetensors
model-00010-of-00021.safetensors
18e4bc6bc010
3.1 GB
safetensors
model-00012-of-00021.safetensors
326a9c72863e
3.1 GB
safetensors
model-00014-of-00021.safetensors
c7b6742c1c1b
3.1 GB
safetensors
model-00016-of-00021.safetensors
fe4402765760
3.1 GB
safetensors
model-00018-of-00021.safetensors
6b8f58595064
3.1 GB
safetensors
model-00020-of-00021.safetensors
ada118fb0403
3.1 GB
safetensors
model-00004-of-00021.safetensors
bf2283da546d
3.1 GB
safetensors
model-00006-of-00021.safetensors
99525e6eaf84
3.1 GB
safetensors
model-00021-of-00021.safetensors
9fe23cb88580
1.9 GB
safetensors
tokenizer.json
06b9509352d2
19.1 MB
model.safetensors.index.json
9137f56d133e
94.6 KB
config.json
137a4918d43f
3.5 KB
tokenizer_config.json
792fa3f0cb88
1.1 KB
preprocessor_config.json
dc9c8630fb98
337 B
video_preprocessor_config.json
55b3c577a270
332 B
chat_template.jinja
2f0ff3f0dc69
325 B
generation_config.json
2a9c067fc2d6
178 B