APIs for SFT and RFTΒΆ API: LoRA and Model Configs RFLoraConfig RFModelConfig RFModelConfig API: Trainer Configs RFSFTConfig RFDPOConfig RFGRPOConfig API: User-Provided Functions for Run Fit Create Model Function create_model_fn() Compute Metrics Function fit.compute_metrics_fn() Formatting Function sample_formatting_fn() Reward Functions reward_function()