Tag: Multimodality
All the articles with the tag "Multimodality".
-
EfficientLLM: Efficiency in Large Language Models
Published: at 11:12 AM
85.05 🤔EfficientLLM通过大规模实证基准测试，系统评估了大型语言模型在架构预训练、微调和推理阶段的效率优化技术，揭示了资源权衡和任务依赖性，为从业者提供了基于数据的模型和技术选择指导。
-
Reinforced MLLM: A Survey on RL-Based Reasoning in Multimodal Large Language Models
Published: at 08:42 AM 78.41 🤔本文系统综述了基于强化学习的推理方法在多模态大语言模型（MLLMs）中的进展，分析了算法设计、奖励机制及应用，揭示了跨模态推理和奖励稀疏性等挑战，并提出了分层奖励和交互式RL等未来方向。
-
Cache-Efficient Posterior Sampling for Reinforcement Learning with LLM-Derived Priors Across Discrete and Continuous Domains
Published: at 11:16 AM 73.39 🤔本文提出了一种缓存高效的后验采样框架，通过元学习优化的缓存机制重用LLM先验，显著降低强化学习中的计算成本（查询减少3.8-4.7倍，延迟降低4.0-12.0倍），同时在文本和连续控制任务中保持96-98%的性能。
-
CCSK:Cognitive Convection of Self-Knowledge Based Retrieval Augmentation for Large Language Models
Published: at 08:43 AM 70.69 🤔本文提出CCSK框架，通过Siamese Network和Response Quality Model动态融合查询相似性和响应质量，优化大型语言模型的信息检索决策，在多个问答数据集上显著提升了F1分数和准确率。
-
MegaScale-Infer: Serving Mixture-of-Experts at Scale with Disaggregated Expert Parallelism
Published: at 04:30 PM 70.65 🤔本文提出MegaScale-Infer系统，通过分离注意力模块和FFN模块的并行策略以及高效M2N通信库，优化大规模MoE模型的推理效率，实现高达1.90倍的吞吐量提升。