tora/albedo-qwen3.6-35b-miner-5d803310
Parameters
35.1B
Total size
65.4 GB
Files
29
Quantization
BF16
No README on this version
Push a README.md with the model files to see it rendered here.
Model architecture
config.json- Architecture
- Qwen3_5MoeForConditionalGeneration
- Model type
- qwen3_5_moe
- Hidden size
- 2,048
- Layers
- 40
- Attention heads
- 16 (2 kv)
- Vocab size
- 248,320
- Context window
- 256K
- Dtype
- bfloat16
Files
29 itemsmodel-00002-of-00021.safetensors
c0de689e80e1
3.6 GB
safetensors
model-00001-of-00021.safetensors
a4ab70526255
3.5 GB
safetensors
model-00007-of-00021.safetensors
3a64cd55ca2f
3.2 GB
safetensors
model-00009-of-00021.safetensors
76795e89dd73
3.2 GB
safetensors
model-00011-of-00021.safetensors
96cb0afb06ea
3.2 GB
safetensors
model-00013-of-00021.safetensors
f4d1c05cecc4
3.2 GB
safetensors
model-00015-of-00021.safetensors
e6192acd15ed
3.2 GB
safetensors
model-00017-of-00021.safetensors
2ecc1773b710
3.2 GB
safetensors
model-00019-of-00021.safetensors
ef3b17f105e4
3.2 GB
safetensors
model-00003-of-00021.safetensors
bb8d496b6376
3.2 GB
safetensors
model-00005-of-00021.safetensors
568733c3019b
3.2 GB
safetensors
model-00008-of-00021.safetensors
85c806a2d23b
3.1 GB
safetensors
model-00010-of-00021.safetensors
0ef058cc4c9e
3.1 GB
safetensors
model-00012-of-00021.safetensors
bec0449a0a5c
3.1 GB
safetensors
model-00014-of-00021.safetensors
761cbaeec057
3.1 GB
safetensors
model-00016-of-00021.safetensors
9f3a0ba1e7ca
3.1 GB
safetensors
model-00018-of-00021.safetensors
c61895216613
3.1 GB
safetensors
model-00020-of-00021.safetensors
483365507069
3.1 GB
safetensors
model-00004-of-00021.safetensors
0aec5884e7ed
3.1 GB
safetensors
model-00006-of-00021.safetensors
8e9a5710e1f4
3.1 GB
safetensors
model-00021-of-00021.safetensors
c1a43421694c
1.9 GB
safetensors
tokenizer.json
06b9509352d2
19.1 MB
model.safetensors.index.json
9137f56d133e
94.6 KB
chat_template.jinja
e84f32a23fdd
7.6 KB
config.json
ef067a28f69d
3.8 KB
tokenizer_config.json
792fa3f0cb88
1.1 KB
preprocessor_config.json
27225450ac9c
390 B
video_preprocessor_config.json
7768af27c1fa
385 B
generation_config.json
2a9c067fc2d6
178 B