Insights from Tencent AI Lab: Overcoming Underthinking in AI with Token Efficiency

カートのアイテムが多すぎます

ご購入は五十タイトルがカートに入っている場合のみです。

カートに追加できませんでした。

しばらく経ってから再度お試しください。

ウィッシュリストに追加できませんでした。

しばらく経ってから再度お試しください。

ほしい物リストの削除に失敗しました。

しばらく経ってから再度お試しください。

ポッドキャストのフォローに失敗しました

ポッドキャストのフォロー解除に失敗しました

Insights from Tencent AI Lab: Overcoming Underthinking in AI with Token Efficiency

無料で聴く

ポッドキャストの詳細を見る

このコンテンツについて

This episode analyzes the research paper "Thoughts Are All Over the Place: On the Underthinking of o1-Like LLMs," authored by Yue Wang and colleagues from Tencent AI Lab, Soochow University, and Shanghai Jiao Tong University. The study investigates the phenomenon of "underthinking" in large language models similar to OpenAI's o1, highlighting their tendency to frequently switch between lines of thought without thoroughly exploring promising reasoning paths. Through experiments conducted on challenging test sets such as MATH500, GPQA Diamond, and AIME, the researchers evaluated models QwQ-32B-Preview and DeepSeek-R1-671B, revealing that increased problem difficulty leads to longer responses and more frequent thought switches, often resulting in incorrect answers due to inefficient token usage.

To address this issue, the researchers introduced a novel metric called "token efficiency" and proposed a new decoding strategy named Thought Switching Penalty (TIP). TIP discourages premature transitions between thoughts by applying penalties to tokens that signal a switch in reasoning, thereby encouraging deeper exploration of each reasoning path. The implementation of TIP resulted in significant improvements in model accuracy across all test sets without the need for additional fine-tuning, demonstrating a practical method to enhance the problem-solving capabilities and efficiency of large language models.

This podcast is created with the assistance of AI, the producers and editors take every effort to ensure each episode is of the highest quality and accuracy.

For more information on content and research relating to this episode please see: https://arxiv.org/pdf/2501.18585