4510 位用户此时在线
- 本站自动实时分享网络热点
- 24小时实时更新
- 所有言论不代表本站态度
- 欢迎对信息踊跃评论评分
- 评分越高，信息越新，排列越靠前
I'm more and more confident that tokenization will be gone.
Humans don't think in "tokens".
Tokens are hardcoded abstractions in LLMs that lead to weird behavior: LLMs can solve PhD-level math questions but cannot answer "Is 9.9 > 9.11?"
Meta is shifting LLMs to LCMs (Large
时政
(
twitter.com
)
I'm more and more confident that tokenization will be gone.
Humans don't think in "tokens".
Tokens are hardcoded abstractions in LLMs that lead to weird behavior: LLMs can solve PhD-level math questions but cannot answer "Is 9.9 > 9.11?"
Meta is shifting LLMs to LCMs (Large Concept Models), changing "next-token prediction" to "next-concept prediction". A "concept" is treated as a sentence, representing an abstract idea or action.
Two weeks ago, Meta also published the "Byte Latent Transformer", a new architecture that processes raw bytes grouped into patches instead of relying on tokenization.
My intuition says LCM is probably better at reasoning and modalities.
点击图片查看原图
This week, 6 more participants joined the Peace Summit Communiqué. And our team is working to get more signatures. It is important to us that every part of the world, every country and every leader who respects international law can show their worth in bringing peace closer and
时政
(
twitter.com)
I visited more of our brigades.
3rd, 15th National Guard; 47th, 65th mechanized; 46th airmobile; 10th Army Corps; 116th, 117th, 118th.
Such communication allows us to see how the experience of one brigade may be applied by other units and scaled up to our entire defense forces.
时政
(
twitter.com)