tora/albedo-qwen3.6-35b-miner-68047c44
Parameters
35.1B
Total size
65.4 GB
Files
30
Quantization
BF16
No README on this version
Push a README.md with the model files to see it rendered here.
Model architecture
config.json- Architecture
- Qwen3_5MoeForConditionalGeneration
- Model type
- qwen3_5_moe
- Hidden size
- 2,048
- Layers
- 40
- Attention heads
- 16 (2 kv)
- Vocab size
- 248,320
- Context window
- 256K
- Dtype
- bfloat16
Files
30 itemsmodel-00002-of-00021.safetensors
98e3021b2127
3.6 GB
safetensors
model-00001-of-00021.safetensors
c42c50a945f3
3.5 GB
safetensors
model-00007-of-00021.safetensors
7f9605737c8b
3.2 GB
safetensors
model-00009-of-00021.safetensors
0f25bada7bb5
3.2 GB
safetensors
model-00011-of-00021.safetensors
5040530b51f7
3.2 GB
safetensors
model-00013-of-00021.safetensors
4d2923e0504c
3.2 GB
safetensors
model-00015-of-00021.safetensors
2920c59fb42b
3.2 GB
safetensors
model-00017-of-00021.safetensors
0b113fecf27d
3.2 GB
safetensors
model-00019-of-00021.safetensors
c40769f6f074
3.2 GB
safetensors
model-00003-of-00021.safetensors
99c36f0940b1
3.2 GB
safetensors
model-00005-of-00021.safetensors
4f3726a6f719
3.2 GB
safetensors
model-00008-of-00021.safetensors
2f03e238711c
3.1 GB
safetensors
model-00010-of-00021.safetensors
18a6b828933a
3.1 GB
safetensors
model-00012-of-00021.safetensors
e37365d41809
3.1 GB
safetensors
model-00014-of-00021.safetensors
8bee0ebe4ed4
3.1 GB
safetensors
model-00016-of-00021.safetensors
ae90f0d3ff5d
3.1 GB
safetensors
model-00018-of-00021.safetensors
b9b457b72cc3
3.1 GB
safetensors
model-00020-of-00021.safetensors
4fef292225a5
3.1 GB
safetensors
model-00004-of-00021.safetensors
b3cec3642703
3.1 GB
safetensors
model-00006-of-00021.safetensors
70bba4e47382
3.1 GB
safetensors
model-00021-of-00021.safetensors
2010a1609cb8
1.9 GB
safetensors
tokenizer.json
06b9509352d2
19.1 MB
model.safetensors.index.json
9137f56d133e
94.6 KB
chat_template.jinja
e84f32a23fdd
7.6 KB
config.json
c9cce336866e
3.5 KB
.gitattributes
34448b82c17d
1.5 KB
tokenizer_config.json
792fa3f0cb88
1.1 KB
preprocessor_config.json
27225450ac9c
390 B
video_preprocessor_config.json
7768af27c1fa
385 B
generation_config.json
2a9c067fc2d6
178 B