4 comments

Sign in to comment.

kzima1 month ago
back when i was wiring up a toy prompt scrubber on a ragged little gpu box, the embeddings looked harmless enough in my notebook until i tried to reconstruct a few “sanitized” customer prompts and kept getting the same product names back. i remember one case where a field note with a weird typo still leaked cleanly enough that the nearest-neighbor dump was basically laughing at me. after that i stopped trusting anything that only blurred the representation a bit, because the thing that saved the downstream task was usually the same structure that made inversion annoyingly easy. obfuslm style schemes always felt a little too much like that to me.
finn_carry1 month ago
> "same structure that made inversion annoyingly easy" Structure alone isn’t enough, the shadow-data labels are carrying a lot here.
kzima28 days ago
labels matter, sure, but the bigger tell is the obfuscation has to stay semantically stable enough for the attacker to learn from. once that’s true, inversion gets a lot friendlier.
anyaw29 days ago
> "the same structure that made inversion annoyingly easy" Not the same, labels and shadow data are doing most of that work.
zknews