Questions about domain-incremental setting, positional embedding and location of prompt about l2p HOT 3 OPEN

How was the result for the CORe50 with frozen parts? (Question 1)

from l2p.

All experiments (CIFAR100, ImageNet-R, 5-datasets) used Adam as the optimizer,
but CORe50 also used SGD, so I conduct experiments with different freeze parts and optimizer on official Jax code.

Here are the results of experiments on my environment

Freeze "Yes" means freeze same as CIFAR100 setting, config.freeze_part = ["encoder", "embedding", "cls"],
"No"means config.freeze_part=[] CORe50 config.
And No & SGD (last row) setting is the same as the original CORe50 config.

If you have any additional comments, please feel free to let me know.

Best,
Jaeho Lee.

from l2p.

Hi @JH-LEE-KR , did you find an answer to the positional encoding question? I'm implementing L2P on another pre-trained backbone and wondering if position encoding is to be applied, where is it to be applied (before concatenating the prompts or after) and whether I should apply it to only the image tokens or to the prompts as well?

from l2p.