mainsafetensorsbf16Public
divinequest/albedo-qwen3-4b-6a375b
sha256:a62d5140ceb1f0a2e39ef0d4ad4b63dc45722b301f49da6305da990f4cf00387·Indexed Jun 5, 2026
Parameters
4.0B
Total size
7.5 GB
Files
14
Quantization
BF16
No README on this version
Push a README.md with the model files to see it rendered here.
Model architecture
config.json- Architecture
- Qwen3ForCausalLM
- Model type
- qwen3
- Hidden size
- 2,560
- Layers
- 36
- Attention heads
- 32 (8 kv)
- FFN size
- 9,728
- Vocab size
- 151,936
- Context window
- 40K
- Dtype
- bfloat16
Files
14 itemsmodel-00002-of-00003.safetensors
d816cee944b0
3.7 GB
safetensors
model-00001-of-00003.safetensors
1d6615082aff
3.7 GB
safetensors
model-00003-of-00003.safetensors
601b3b8daa32
95.0 MB
safetensors
tokenizer.json
9aa803b36bea
10.9 MB
vocab.json
ca10d7e9fb3e
2.6 MB
merges.txt
8831e4f1a044
1.6 MB
shard_soup_manifest.json
f446e3ad5598
44.7 KB
model.safetensors.index.json
5b36dbd79cdd
32.1 KB
tokenizer_config.json
bdadb55c4f2a
5.3 KB
chat_template.jinja
87a2728cb8dc
4.0 KB
config.json
018398443a85
727 B
added_tokens.json
c0284b582e14
707 B
special_tokens_map.json
c9b84b84227d
610 B
generation_config.json
64d86df21739
214 B