admin/lerobot
1
0
Fork 0
mirror of https://github.com/huggingface/lerobot.git synced 2026-07-05 09:07:03 +00:00
Code Issues Packages Projects Releases Wiki Activity

Don't unload & merge the PEFT model

Browse Source 
This can make things hard when using quantized layers (user expects quantized base layers with
unquantized adapters for example, merging defaults to upcast the layers leading to higher
memory).
This commit is contained in:
nemo
2025-10-16 16:06:23 +02:00
parent e263a1de13
commit 6fb8539159
1 changed files with 0 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files
src/lerobot/scripts/lerobot_record.py
-4
View File
@@ -446,10 +446,6 @@ def record(cfg: RecordConfig) -> LeRobotDataset:
policy = make_policy(cfg.policy, ds_meta=dataset.meta)
policy = PeftModel.from_pretrained(policy, peft_path)
# it is not necessary to merge and unload but for methods that support merging,
# it brings inference performance benefits.
policy = policy.merge_and_unload()
else:
policy = None if cfg.policy is None else make_policy(cfg.policy, ds_meta=dataset.meta)