tora/albedo-qwen3.6-35b-miner-4d211874
Parameters
35.1B
Total size
65.4 GB
Files
24
Quantization
BF16
No README on this version
Push a README.md with the model files to see it rendered here.
Model architecture
config.json- Architecture
- Qwen3_5MoeForConditionalGeneration
- Model type
- qwen3_5_moe
- Hidden size
- 2,048
- Layers
- 40
- Attention heads
- 16 (2 kv)
- Vocab size
- 248,320
- Context window
- 256K
- Dtype
- bfloat16
Files
24 itemsmodel-00006-of-00016.safetensors
5b11a908c66d
4.6 GB
safetensors
model-00009-of-00016.safetensors
4bfa9b383a97
4.6 GB
safetensors
model-00012-of-00016.safetensors
1a38762bbedc
4.6 GB
safetensors
model-00015-of-00016.safetensors
6571b1f23ea7
4.6 GB
safetensors
model-00003-of-00016.safetensors
d4e59f27b0c1
4.6 GB
safetensors
model-00008-of-00016.safetensors
e89ac17185f8
4.2 GB
safetensors
model-00011-of-00016.safetensors
47e6e1d0216b
4.2 GB
safetensors
model-00014-of-00016.safetensors
b404e38db395
4.2 GB
safetensors
model-00002-of-00016.safetensors
2d0e28e3dce4
4.2 GB
safetensors
model-00005-of-00016.safetensors
6ab3cb58d99e
4.2 GB
safetensors
model-00001-of-00016.safetensors
ff55a58a49fb
4.0 GB
safetensors
model-00007-of-00016.safetensors
e309bf72c6e4
3.7 GB
safetensors
model-00010-of-00016.safetensors
cc7f5dbebb42
3.7 GB
safetensors
model-00013-of-00016.safetensors
80300b6516b3
3.7 GB
safetensors
model-00004-of-00016.safetensors
ac6060df0d69
3.7 GB
safetensors
model-00016-of-00016.safetensors
7efd9bf65829
2.4 GB
safetensors
tokenizer.json
06b9509352d2
19.1 MB
model.safetensors.index.json
f8448aa8b2fb
94.6 KB
chat_template.jinja
e84f32a23fdd
7.6 KB
config.json
ef067a28f69d
3.8 KB
tokenizer_config.json
792fa3f0cb88
1.1 KB
preprocessor_config.json
27225450ac9c
390 B
video_preprocessor_config.json
7768af27c1fa
385 B
generation_config.json
2a9c067fc2d6
178 B