Hippius
mainsafetensorsbf16Publictransformersbase: []

gether/albedo-qwen3.6-35b-octopus_56

sha256:07420f44b6cd6315503679c0bfcac49b6ed33c04173c99466175baf19283ebd6·Indexed 2d ago

Parameters

35.1B

Total size

65.4 GB

Files

25

Quantization

BF16

README.md

1.2 KB

my-merged-model

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the SLERP merge method.

Models Merged

The following models were included in the merge:

  • /root/workspace_albedo/models/foremost/models--foremost--albedo-qwen3.6-35b-test-4/snapshots/sha256:e0b237cc5bccba7e159fb4a5fe041feef10d9cd5aee96d5e233ad3d38b4aedd3
  • /root/workspace_albedo/models/uid151__everking--albedo-qwen3.6-35b-mini-end__s

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: /root/workspace_albedo/models/foremost/models--foremost--albedo-qwen3.6-35b-test-4/snapshots/sha256:e0b237cc5bccba7e159fb4a5fe041feef10d9cd5aee96d5e233ad3d38b4aedd3
  - model: /root/workspace_albedo/models/uid151__everking--albedo-qwen3.6-35b-mini-end__s

merge_method: slerp
base_model: /root/workspace_albedo/models/foremost/models--foremost--albedo-qwen3.6-35b-test-4/snapshots/sha256:e0b237cc5bccba7e159fb4a5fe041feef10d9cd5aee96d5e233ad3d38b4aedd3

parameters:
  t: 0.15

dtype: bfloat16

Model architecture

config.json
Architecture
Qwen3_5MoeForConditionalGeneration
Model type
qwen3_5_moe
Hidden size
2,048
Layers
40
Attention heads
16 (2 kv)
Vocab size
248,320
Context window
256K

Files

25 items
  • model-00010-of-00016.safetensors

    a86c2fd630c3

    4.7 GB

    safetensors

  • model-00006-of-00016.safetensors

    b3c1d3a35bc8

    4.6 GB

    safetensors

  • model-00003-of-00016.safetensors

    67f24037ca84

    4.6 GB

    safetensors

  • model-00008-of-00016.safetensors

    88d8512320f3

    4.6 GB

    safetensors

  • model-00013-of-00016.safetensors

    ee4a856e0a05

    4.6 GB

    safetensors

  • model-00009-of-00016.safetensors

    30f97b059090

    4.2 GB

    safetensors

  • model-00012-of-00016.safetensors

    15181ac34f0d

    4.2 GB

    safetensors

  • model-00002-of-00016.safetensors

    a2d1a97e564a

    4.2 GB

    safetensors

  • model-00005-of-00016.safetensors

    5c77f0bf6b51

    4.2 GB

    safetensors

  • model-00015-of-00016.safetensors

    4463194d8a55

    4.2 GB

    safetensors

  • model-00001-of-00016.safetensors

    d2a35e9a89d1

    4.0 GB

    safetensors

  • model-00011-of-00016.safetensors

    606a5000f60d

    3.7 GB

    safetensors

  • model-00014-of-00016.safetensors

    bbab18894fd5

    3.7 GB

    safetensors

  • model-00004-of-00016.safetensors

    b57f6c34c88f

    3.7 GB

    safetensors

  • model-00007-of-00016.safetensors

    cadf02c3278b

    3.7 GB

    safetensors

  • model-00016-of-00016.safetensors

    f936e241e72e

    2.3 GB

    safetensors

  • tokenizer.json

    06b9509352d2

    19.1 MB

  • model.safetensors.index.json

    33d5000dc35f

    94.6 KB

  • tokenizer_config.json

    5186f0defcd7

    16.3 KB

  • chat_template.jinja

    e84f32a23fdd

    7.6 KB

  • config.json

    80b819a28ef9

    3.5 KB

  • README.md

    ca621bf0235e

    1.2 KB

  • video_preprocessor_config.json

    7768af27c1fa

    385 B

  • preprocessor_config.json

    dc9c8630fb98

    337 B

  • generation_config.json

    d0dbf670c6a3

    214 B

gether/albedo-qwen3.6-35b-octopus_56 · main · Hippius Hub