Pluralistic alignment
Steerable Preference Optimization of Reward Models
Pluralistic Alignment @ ICML · 2026
SCPO trains reward models for diverse cultural preferences by filtering and weighting country-specific feedback, improving data efficiency while moderating excessive preference bias.