Tag: Lightweight Models

All the articles with the tag "Lightweight Models".

• W-PCA Based Gradient-Free Proxy for Efficient Search of Lightweight Language Models

  Published: 4 May, 2025 |  at  04:30 PM

  

  53.85 🤔

  本文提出 W-PCA 方法，通过结合参数数量和主成分分析，提供一种高效的零-shot NAS 代理，用于轻量级语言模型的搜索，显著提高了搜索效率和模型性能。