happyconst/albedo-qwen3.6-35b-trainer-a1818
Parameters
35.1B
Total size
65.4 GB
Files
29
Quantization
BF16
No README on this version
Push a README.md with the model files to see it rendered here.
Model architecture
config.json- Architecture
- Qwen3_5MoeForConditionalGeneration
- Model type
- qwen3_5_moe
- Hidden size
- 2,048
- Layers
- 40
- Attention heads
- 16 (2 kv)
- Vocab size
- 248,320
- Context window
- 256K
- Dtype
- bfloat16
Files
29 itemsmodel-00002-of-00021.safetensors
71e901d09cb0
3.6 GB
safetensors
model-00001-of-00021.safetensors
00bb62970a79
3.5 GB
safetensors
model-00007-of-00021.safetensors
61bd07842176
3.2 GB
safetensors
model-00009-of-00021.safetensors
f6760480160c
3.2 GB
safetensors
model-00011-of-00021.safetensors
6e90e1523330
3.2 GB
safetensors
model-00013-of-00021.safetensors
e271014e330c
3.2 GB
safetensors
model-00015-of-00021.safetensors
51c2d0772076
3.2 GB
safetensors
model-00017-of-00021.safetensors
611b77638fd1
3.2 GB
safetensors
model-00019-of-00021.safetensors
dcb236b1ff6c
3.2 GB
safetensors
model-00003-of-00021.safetensors
cf95bbeb0202
3.2 GB
safetensors
model-00005-of-00021.safetensors
1b1943aa8a68
3.2 GB
safetensors
model-00008-of-00021.safetensors
a73fbb25d0e0
3.1 GB
safetensors
model-00010-of-00021.safetensors
3cd34a0386a5
3.1 GB
safetensors
model-00012-of-00021.safetensors
ab5d91db53b7
3.1 GB
safetensors
model-00014-of-00021.safetensors
535e4a3d605d
3.1 GB
safetensors
model-00016-of-00021.safetensors
1d32f1e749ef
3.1 GB
safetensors
model-00018-of-00021.safetensors
e37336a28f31
3.1 GB
safetensors
model-00020-of-00021.safetensors
4d421757ea3b
3.1 GB
safetensors
model-00004-of-00021.safetensors
34820ecc2c8d
3.1 GB
safetensors
model-00006-of-00021.safetensors
793cc1a8c812
3.1 GB
safetensors
model-00021-of-00021.safetensors
115f4ecce800
1.9 GB
safetensors
tokenizer.json
06b9509352d2
19.1 MB
model.safetensors.index.json
9137f56d133e
94.6 KB
tokenizer_config.json
41b104f7054f
8.9 KB
chat_template.jinja
e84f32a23fdd
7.6 KB
config.json
c9cce336866e
3.5 KB
preprocessor_config.json
dc9c8630fb98
337 B
video_preprocessor_config.json
55b3c577a270
332 B
generation_config.json
2a9c067fc2d6
178 B