Mechanistic Exploration of the Architectural Impact of DPO Fine-Tuning on Ethical Alignment in LLMs.

Fabian Maag, Betiel Woldai, Sigurd Schacht

Browse the full HCI paper archive.