According to the authors, removing the middleman makes DPO between three and six times more efficient than RLHF, and capable of better performance at tasks such as text summarisation.

据作者称， 消除中间人使得 DPO 的效率比 RLHF 提高三到六倍，并且能够在文本摘要等任务上表现得更好。