ExplorerData ScienceMachine Learning
Research PaperResearchia:202604.16073

Token Encoding for Semantic Recovery

Jingzhi Hu

Abstract

Token-based semantic communication is promising for future wireless networks, as it can compact semantic tokens under very limited channel capacity. However, harsh wireless channels often cause missing tokens, leading to severe distortion that prevents reliable semantic recovery at the receiver. In this article, we propose a token encoding framework for robust semantic recovery (TokCode), which incurs no additional transmission overhead and supports plug-and-play deployment. For efficient token ...

Submitted: April 16, 2026Subjects: Machine Learning; Data Science

Description / Details

Token-based semantic communication is promising for future wireless networks, as it can compact semantic tokens under very limited channel capacity. However, harsh wireless channels often cause missing tokens, leading to severe distortion that prevents reliable semantic recovery at the receiver. In this article, we propose a token encoding framework for robust semantic recovery (TokCode), which incurs no additional transmission overhead and supports plug-and-play deployment. For efficient token encoder optimization, we develop a sentence-semantic-guided foundation model adaptation algorithm (SFMA) that avoids costly end-to-end training. Based on simulation results on prompt-based generative image transmission, TokCode mitigates semantic distortion and can approach the performance upper-bound, even under harsh channels where 40% to 60% of tokens are randomly lost.


Source: arXiv:2604.12931v1 - http://arxiv.org/abs/2604.12931v1 PDF: https://arxiv.org/pdf/2604.12931v1 Original Link: http://arxiv.org/abs/2604.12931v1

Please sign in to join the discussion.

No comments yet. Be the first to share your thoughts!

Access Paper
View Source PDF
Submission Info
Date:
Apr 16, 2026
Topic:
Data Science
Area:
Machine Learning
Comments:
0
Bookmark