Illustration: the project’s public image, pixelated by RepoMasters. Credits
BetaRare

ContextualAI/HALOs

A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).

Owner
ContextualAI (organization)
Stars
Stars: 911
Forks
Forks: 50
Language
Python
License
Apache-2.0
Created
2023
Topics
alignmentdpohalosktopporlhf
Tier
Beta (700 to 1,999 ★) What this tier means
View on GitHub

More repos by ContextualAI

All 3 repos by ContextualAI

Nearby in Python

All Python repos