All publications

Pluralistic Alignment @ ICML 2026

Steerable Preference Optimization of Reward Models

Minsik Oh, Advit Deepak, Sophie Wu, Douwe Kiela, Ekaterina Shutova
SCPO pipeline: a global reward model guides filtering and weighting of cultural preference pairs before reward-model training.
Figure from the paper.