1966 位用户此时在线
- 本站自动实时分享网络热点
- 24小时实时更新
- 所有言论不代表本站态度
- 欢迎对信息踊跃评论评分
- 评分越高，信息越新，排列越靠前
I'm more and more confident that tokenization will be gone.
Humans don't think in "tokens".
Tokens are hardcoded abstractions in LLMs that lead to weird behavior: LLMs can solve PhD-level math questions but cannot answer "Is 9.9 > 9.11?"
Meta is shifting LLMs to LCMs (Large
时政
(
twitter.com
)
I'm more and more confident that tokenization will be gone.
Humans don't think in "tokens".
Tokens are hardcoded abstractions in LLMs that lead to weird behavior: LLMs can solve PhD-level math questions but cannot answer "Is 9.9 > 9.11?"
Meta is shifting LLMs to LCMs (Large Concept Models), changing "next-token prediction" to "next-concept prediction". A "concept" is treated as a sentence, representing an abstract idea or action.
Two weeks ago, Meta also published the "Byte Latent Transformer", a new architecture that processes raw bytes grouped into patches instead of relying on tokenization.
My intuition says LCM is probably better at reasoning and modalities.
点击图片查看原图
I met with leaders of US defense companies and expressed my gratitude to every American worker who manufactures weapons that help us safeguard our people and defend our land.
I appreciated all American companies that attended last week's US-Ukraine defense industry conference.…
时政
(
twitter.com)
- Oh, the Chinese gave this to me?
- Yes, and they also bring you power bank.
- Oh, My God. God bless Chinese and you! Thank you for helping me. I don’t know how I would live, my ceiling fell. God, they handed over the meat, so I’ll get up early and cook something for myself.
时政
(
twitter.com)
As the war continues, I visited a Jewish school in Chicago.
We had an honest and open discussion with my brothers and sisters.
After the conversation, an eight year old kid came up to me and said;
“Mr. Freedom, you are one of the only Muslim people I have ever met, thank you for…
时政
(
twitter.com)