Inverting the Hidden: Unveiling Multimodal Privacy Leakage in Collaborative LVLM Inference arxiv.org
Send the hidden states, and your LVLM privacy leaks image/text back out with RASR doing the ugly part.
1 comment
So if you hand over the hidden states, the model is basically spilling its own inputs? Feels like a fancy inversion attack with extra steps.