2024年LLM时代小模型的应用潜力与挑战研究报告

TSINGHUA PBCSF清华五道口Research ReportDecember 18.2024Application Potential and Challenges of SmallLanguage Model in the LLM EraResearch Center for Wealth Management,PBC School of Finance,Tsinghua UniversityZhang Xiaoyan Zhang Yiwei Zhang YuanyuanAbstract:Large language models have made remarkableachievements in the field of natural language processing.However,due to their high cost and resource consumption,their commercialapplication is still in its early stages.In contrast,small languagemodels have shown great potential due to their advantages such as lowtraining cost and small computing resource requirements.This studyexplores the application potential and challenges of small models byanalyzing the development status and specific cases of small models