tora/albedo-qwen3.6-35b-n4v7k8qa-power
Parameters
35.1B
Total size
65.4 GB
Files
29
Quantization
BF16
No README on this version
Push a README.md with the model files to see it rendered here.
Model architecture
config.json- Architecture
- Qwen3_5MoeForConditionalGeneration
- Model type
- qwen3_5_moe
- Hidden size
- 2,048
- Layers
- 40
- Attention heads
- 16 (2 kv)
- Vocab size
- 248,320
- Context window
- 256K
- Dtype
- bfloat16
Files
29 itemsmodel-00002-of-00021.safetensors
a5bf42791228
3.6 GB
safetensors
model-00001-of-00021.safetensors
b157f5ae1b3d
3.5 GB
safetensors
model-00007-of-00021.safetensors
1b757e7759d8
3.2 GB
safetensors
model-00009-of-00021.safetensors
44e4e4117b98
3.2 GB
safetensors
model-00011-of-00021.safetensors
84ddf51f2a0a
3.2 GB
safetensors
model-00013-of-00021.safetensors
1cafd02a7bc5
3.2 GB
safetensors
model-00015-of-00021.safetensors
0bf4ec97dac2
3.2 GB
safetensors
model-00017-of-00021.safetensors
14e1fd5a55eb
3.2 GB
safetensors
model-00019-of-00021.safetensors
fe5484a80648
3.2 GB
safetensors
model-00003-of-00021.safetensors
13bc7d60fe0d
3.2 GB
safetensors
model-00005-of-00021.safetensors
a5181da4c02f
3.2 GB
safetensors
model-00008-of-00021.safetensors
698f9b0a59a0
3.1 GB
safetensors
model-00010-of-00021.safetensors
1de0fe6f01f5
3.1 GB
safetensors
model-00012-of-00021.safetensors
fcb34bb2b45a
3.1 GB
safetensors
model-00014-of-00021.safetensors
1b48ea2b033f
3.1 GB
safetensors
model-00016-of-00021.safetensors
2c314f4c2559
3.1 GB
safetensors
model-00018-of-00021.safetensors
a8fb10537b5a
3.1 GB
safetensors
model-00020-of-00021.safetensors
798e3ecef0c1
3.1 GB
safetensors
model-00004-of-00021.safetensors
f6e63c4cea9c
3.1 GB
safetensors
model-00006-of-00021.safetensors
41012ac0a9ef
3.1 GB
safetensors
model-00021-of-00021.safetensors
f72572b7995b
1.9 GB
safetensors
tokenizer.json
06b9509352d2
19.1 MB
model.safetensors.index.json
9137f56d133e
94.6 KB
chat_template.jinja
e84f32a23fdd
7.6 KB
config.json
ddf9fc5c8aa0
3.5 KB
tokenizer_config.json
0faa3f04ba29
1.1 KB
preprocessor_config.json
27225450ac9c
390 B
video_preprocessor_config.json
7768af27c1fa
385 B
generation_config.json
a4cef85934ea
214 B