7B-DPO-alpha — LLM for Research | GenAiHub