points by orbital-decay 1 day ago | 0 comments
The classifier is separate from the model and it's not capable of any of that nuance, it's just tuned to reject anything looking like a CoT jailbreak and not care about false positives. (which is funny because there still are easy ways to leak the raw CoT and train on it to your heart's content)
[–] Barbing 1 day ago
> easy ways to leak the raw CoT
At scale?
[–] orbital-decay 1 day ago
It's reliable and has low noise if that's what you're asking. At scale you have to worry about the other factors like sourcing it without A\ noticing and either patching it, blocking you, or poisoning your samples.
[–] belluxx 1 day ago