happyconst/albedo-qwen3.6-35b-trainer-a1212
Parameters
34.7B
Total size
64.6 GB
Files
29
Quantization
BF16
No README on this version
Push a README.md with the model files to see it rendered here.
Model architecture
config.json- Architecture
- Qwen3_5MoeForConditionalGeneration
- Model type
- qwen3_5_moe
- Hidden size
- 2,048
- Layers
- 40
- Attention heads
- 16 (2 kv)
- Vocab size
- 248,320
- Context window
- 256K
- Dtype
- bfloat16
Files
29 itemsmodel-00002-of-00021.safetensors
374ac9259675
3.6 GB
safetensors
model-00001-of-00021.safetensors
2871b02c6139
3.5 GB
safetensors
model-00003-of-00021.safetensors
1ab145cfc43a
3.2 GB
safetensors
model-00005-of-00021.safetensors
ec540d81e399
3.2 GB
safetensors
model-00014-of-00021.safetensors
e663395171e8
3.2 GB
safetensors
model-00016-of-00021.safetensors
fee81903b4aa
3.2 GB
safetensors
model-00007-of-00021.safetensors
6658cac43cde
3.2 GB
safetensors
model-00018-of-00021.safetensors
6c2cf33d76df
3.2 GB
safetensors
model-00020-of-00021.safetensors
280e2d24b1fb
3.2 GB
safetensors
model-00008-of-00021.safetensors
35ae22b5dfb2
3.1 GB
safetensors
model-00010-of-00021.safetensors
859d5225046a
3.1 GB
safetensors
model-00009-of-00021.safetensors
e6bf125e6d01
3.1 GB
safetensors
model-00011-of-00021.safetensors
ff2be3292d09
3.1 GB
safetensors
model-00013-of-00021.safetensors
e92c1a8ef20f
3.1 GB
safetensors
model-00004-of-00021.safetensors
3ddfcab4da83
3.1 GB
safetensors
model-00006-of-00021.safetensors
87e465befbf3
3.1 GB
safetensors
model-00015-of-00021.safetensors
f2f94d7877f8
3.1 GB
safetensors
model-00017-of-00021.safetensors
eae3cafde6f4
3.1 GB
safetensors
model-00012-of-00021.safetensors
6c464df150c3
3.1 GB
safetensors
model-00019-of-00021.safetensors
6dd3f1997d8b
3.1 GB
safetensors
model-00021-of-00021.safetensors
8ad3c39f2bdd
1.0 GB
safetensors
tokenizer.json
06b9509352d2
19.1 MB
model.safetensors.index.json
0f1a8c9d74cc
68.1 KB
config.json
c9cce336866e
3.5 KB
tokenizer_config.json
792fa3f0cb88
1.1 KB
preprocessor_config.json
dc9c8630fb98
337 B
video_preprocessor_config.json
55b3c577a270
332 B
chat_template.jinja
5301c9aa584c
313 B
generation_config.json
2a9c067fc2d6
178 B