Personalization
1 articles
Can Your Model Preferences Be 'Inherited'? The RL Transferability Problem
As new models drop faster than ever, Hugging Face's Thomas Wolf asks a painful question: what happens to your carefully tuned preferences when you switch to a new base model? Turns out, almost nobody is working on this.