Abstract: Preferential Bayesian optimization (PBO) is a framework for human-in-the-loop optimization to maximize black-box human preference functions such as seeking perceptually good visual designs.