Skip to content

Bug: Scaling coefficient is None if not passed in config. #23

Description

@bergr7

🐛 Bug report

Summary

The scaling coefficient is None if not passed in the config file.

Actual Behavior

The scaling coefficient takes None if it's not passed in the config file, resulting in a merge error.

Expected behavior

The scaling coefficient should use the default value if it's not passed in the config file.

To Reproduce

Merge configuration file (if relevant):

method: dare-ties-merging
method_global_parameters:
  p: 0.3
base_model: mistralai/Mistral-7B-v0.1
models:
  - model: mistralai/Mistral-7B-v0.1
  - model: mistralai/Mistral-7B-Instruct-v0.1
    weight: 0.5
  - model: BioMistral/BioMistral-Safetensors
    weight: 0.5
directory_settings:
  output_dir: ./biomistral/biomistral_dare_ties_7b/
hf_token:
  token: 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
  trust_remote_code: True
device: cuda

Environment

  • OS: Ubuntu 22.04.4 LTS
  • Python version:Python 3.10.13
  • Library version: 0.1.0
  • Other relevant dependencies: NA

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    Status
    Ready

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions