Entropy collapse improvements - #8

Open

sunildkumar wants to merge 17 commits into

support_multistep_envfrom

entropy_collapse_improvements

Commits on Apr 17, 2025

add clipping - separate low and high values as suggested in DAPO.
sunildkumar
committed
180a0cb

Commits on Apr 18, 2025

Commits on Apr 19, 2025

make buffer ttl longer and decrease min buffer to get results faster
sunildkumar
committed
482bec3

Commits on Apr 20, 2025

when using example from the buffer, add the current example to the buffer to avoid throwing it away
sunildkumar
committed
6e33e43

Commits on Apr 22, 2025

Commits on Apr 23, 2025

allow weights > 1 and <0
sunildkumar
committed
07cc194
reduce max buffer usage prob
sunildkumar
committed
d344fb9
reduce it a bit more to 65
sunildkumar
committed
d396084

Commits on Apr 26, 2025

support guided decoding, but its too slow for our work
sunildkumar
committed
483c9a7
log observed advantages
sunildkumar
committed
0cba676

Commits on Apr 27, 2025

new metric
sunildkumar
committed
388865f