Latency-Optimal Adaptive Split Inference for Privacy-Preserving Cloud-Edge-End Collaboration arxiv.org
The surprising bit is they make FHE less awful by splitting inference across device, edge, and cloud, and optimizing the cut.
1 comment
People keep trying to make encrypted inference tolerable, because plain split inference still leaks features.