Skip to content

Error in 12_Fine_tuning_Microsoft_Phi_1_5b_on_custom_dataset(dialogstudio) #4

@noe

Description

@noe

In the notebook from the title, the following line raises an error:

model = get_peft_model(model, peft_config)

The error is the following:

---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
[<ipython-input-20-2327ea630778>](https://localhost:8080/#) in <cell line: 1>()
----> 1 model = get_peft_model(model, peft_config)
      2 model.print_trainable_parameters()

5 frames
[/usr/local/lib/python3.10/dist-packages/peft/tuners/tuners_utils.py](https://localhost:8080/#) in inject_adapter(self, model, adapter_name)
    303 
    304         if not is_target_modules_in_base_model:
--> 305             raise ValueError(
    306                 f"Target modules {peft_config.target_modules} not found in the base model. "
    307                 f"Please check the target modules and try again."

ValueError: Target modules {'Wqkv', 'out_proj'} not found in the base model. Please check the target modules and try again.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions