Compressed LLM Reprogramming for Vision-Aided Beam Prediction in Vehicular Networks

Large Language Model (LLM) reprogramming-based beam prediction demonstrates strong data efficiency by adapting pretrained language models for vehicle-to-infrastructure (V2I) beam prediction, yet the resulting model complexity makes such approaches impractical for latency-sensitive deployment. We propose LLMBP-Lite, a compact LLM-reprogrammed framework for beam prediction. It leverages structural redundancy through pruning along three complementary dimensions: Transformer depth, source-prototype vocabulary size, and prompt length. Additionally, knowledge distillation can be optionally employed to maintain the pretrained representational capacity after compression. Experiments on the real-world dataset demonstrate that LLMBP-Lite achieves a $65\times$ inference speedup over the uncompressed LLM-based baseline while maintaining prediction accuracy and consistently outperforming recurrent baselines under limited training data. These results demonstrate that the tradeoff between data efficiency and deployment efficiency can be substantially mitigated in vehicular networks.

Source: arXiv:2609.35459v1 - http://arxiv.org/abs/2609.35459v1 PDF: https://arxiv.org/pdf/2609.35459v1 Original Link: http://arxiv.org/abs/2609.35459v1