How do I easily inherit and register the new method? about peft HOT 2 CLOSED

There is no guide on that.

My recommendation to your specific question about adding a new LoRA layer type: Search through the code base for existing layers, like lora.Embedding, and follow the same steps. In particular, add your class to tuners/lora/layer.py, inherit from LoraLayer, and implement the __init__, update_layer and forward methods. If you want merging support, add merge and unmerge. Finally, edit the dispatch_default function so that the correct layer type is replaced by your new layer.

You can check out #1324, which adds a new LoRA layer type, for inspiration. If your addition is useful for the wider community, you can also create a draft PR here and we can help you along the way.

from peft.

Thank you for your reply, I will try it.

from peft.