feat(mlx): add KTO preference tuning - #912

Open

BardiaKoopah wants to merge 19 commits into

unslothai:mainfrom

BardiaKoopah:feat/mlx-kto

Commits on Jul 18, 2026

feat(mlx): add KTO (Kahneman-Tversky Optimization) preference tuning
BardiaKoopah
committed

Commits on Jul 22, 2026

Commits on Jul 23, 2026

mlx: fix KTO LR-before-decay order, honor num_train_epochs, reject LoRA+
BardiaKoopah
committed
mlx: reject unsupported KTO options loudly instead of ignoring them
BardiaKoopah
committed
mlx: enter train mode and reset run state at the start of KTO training
BardiaKoopah
committed

Commits on Jul 29, 2026