I'm more and more confident that tokenization will be gone. Humans don't think in "tokens". Tokens are hardcoded abstractions in LLMs that lead to weird behavior: LLMs can solve PhD-level math questions but cannot answer "Is 9.9 > 9.11?" Meta is shifting LLMs to LCMs (Large , page 62

I'm more and more confident that tokenization will be gone.

Humans don't think in "tokens".

Tokens are hardcoded abstractions in LLMs that lead to weird behavior: LLMs can solve PhD-level math questions but cannot answer "Is 9.9 > 9.11?"

Meta is shifting LLMs to LCMs (Large Concept Models), changing "next-token prediction" to "next-concept prediction". A "concept" is treated as a sentence, representing an abstract idea or action.

Two weeks ago, Meta also published the "Byte Latent Transformer", a new architecture that processes raw bytes grouped into patches instead of relying on tokenization.

My intuition says LCM is probably better at reasoning and modalities.

点击图片查看原图

1周内 1个月内 1年内全部时间

🚨Breaking: Today, Hamas militias killed the Palestinian activist Ziad Abu Hayya. Returning to his tent with some food for his kids, Hamas militias shot him in the head in front of his children.
Ziad was known for his criticism of Hamas and their reckless actions that led the
时政
( twitter.com)

2个月前 • Ihab Hassan • -- 点击 0 评论

Man kicks woman down the stairs at a subway station.
This happened in Berlin in 2016. He was arrested and sentenced to 35 months in prison. He was beaten up by other inmates so they had to move him to a different prison where he was, again, beaten up
有趣
( twitter.com)

2个月前 • non aesthetic things • -- 点击 • 下载视频 0 评论

00:00:18

NEW: Florida pizza delivery worker stabs a pregnant customer 14 times because she was upset about a $2 tip
Brianna Alvelo, 22, was upset over a $2 tip after delivering a pizza to the Riviera Motel in Kissimmee and returned with an accomplice
The victim was celebrating a
时政
( twitter.com)

1个月前 • Unlimited L's • -- 点击 • 下载视频 0 评论

00:00:22

One of the most reliable ways to improve our mental health is to help others.
After being randomly assigned to do just 3 acts of kindness a week, people felt significantly less depressed, anxious, and lonely.
Lifting others up elevates us too. Giving shows us that we matter.
时政
( twitter.com)

1个月前 • Adam Grant • -- 点击 0 评论

"It's on my todo to build my own stack of apple minis and run Llama on my own little cluster on my desk." -
Quick AI homelab tutorial:
- Install on each mini (open source, steps in README)
- Make sure all the minis are on the same WiFi network or for
时政
( twitter.com)

1个月前 • Alex Cheema - e/acc • -- 点击 • 下载视频 0 评论

00:00:12

On January 15th, an American netizen posted on Xiaohongshu: "I'm also interested in Marxism, but I've always been confused. Once we revolt, what do we do next? How do we proceed? How do we establish a stable government so that greedy people won't climb to the top and exploit
时政
( twitter.com)

27天前 • The Great Translation Movement 大翻译运动 • -- 点击 0 评论

Great news! An additional 5% of our token supply is now available to purchase on our website. We appreciate the overwhelming support and look forward to welcoming so many new people to our community! 🦅🇺🇸🦅
Please only purchase using the link in our bio to avoid scams.
btc
( twitter.com)

23天前 • WLFI • -- 点击 0 评论

Imagine waking up in Britain and reading this, which is the equivalent of what Trump is doing on Day 1:
-a national border emergency is declared
-the military is sent to the Channel to stop the boats
-a national priority is established to eliminate organised gangs on British
btc
( twitter.com)

23天前 • Matt Goodwin • -- 点击 0 评论

Another Uyghur in deportation center in Turkey. His name is Muhemmet Abdulla. He has been living in Turkey with his family. He and his wife have humanitarian residency. A few weeks ago he received a notes from Kocaeli immigration to leave Turkey in 10 days, then he got arrested
时政
( twitter.com)

1个月前 • Abduweli Ayup • -- 点击 0 评论

Ripe for deportation.
Che Xingyuan (车星原), believed to be from Yanbian Korean Autonomous Prefecture on the North Korean border and studied in Britain before flying to the U.S., is a key Pro-Chinese Communist Party operative with close ties to the Chinese Consulate in New York.
时政
( twitter.com)

1个月前 • Dr. Lawrence Sellin • -- 点击 0 评论

Don't assume even for a moment that Pro-Chinese Communist Party Chinese-Americans are loyal to the United States.
They are devoted to the global dominance of Communist China from which they hope to benefit.
They use the U.S. flag as a prop and cover for their Pro-CCP activities.
时政
( twitter.com)

2个月前 • Dr. Lawrence Sellin • -- 点击 • 下载视频 0 评论

00:00:38

Jeffrey Sachs on how Joe Biden has been the most destructive president in American history, and how Donald Trump can repair the damage.
(0:00) The Regime Change in Syria
(8:48) What Is Greater Israel?
(21:45) Were Americans Involved in the Overthrowing of Assad?
(34:26) War With
时政
( twitter.com)

1个月前 • Tucker Carlson • -- 点击 • 下载视频 0 评论

01:56:22

This is Dr Amanda Hess. She was getting ready to give birth when she overheard that another expectant mother needed immediate attention because the baby was in distress. Knowing the on-call doctor was still on his way, she stepped in and delivered the baby. She then went back to
有趣
( twitter.com)

2个月前 • non aesthetic things • -- 点击 0 评论

During the Beijing Olympics, a 9-year-old girl who sang a patriotic song at the opening ceremony, was revealed to be lip-syncing. The real singer was a 7-year-old girl who was kept backstage, because she was considered not good looking enough and that might've damaged China's
有趣
( twitter.com)

1个月前 • non aesthetic things • -- 点击 0 评论

My X family, please see an awareness.
Elon Musk is fighting the world alone for the future and safety of children!
We must protect him!
Those who criticize him are already enemies of children!
Elon Musk is a diamond for the future of children!
We must stand very strong next to
有趣
( twitter.com)

1个月前 • The Figen • -- 点击 0 评论

He Said, She Said—Who and What to Trust in China
The Wall Street Journal wrapped up its article with this closing note from Michael Hart, president of the American Chamber of Commerce in China: “Sudden disengagement from China would be a mistake. It would do great damage to the
时政
( twitter.com)

1个月前 • Desmond Shum • -- 点击 0 评论

其实我是一个很懒的人
我真的对不起大家
本科考到了全系第一，我就放弃读书了，所以phd读得很不好
硅谷公司做到M，我就放弃内卷了，不想去开会，更不想manage up，直接躺平被动辞职
时政
( twitter.com)

1个月前 • 勃勃OC • -- 点击 0 评论

All TikTok coverage misses one fundamental point. The reason why this matters so much is because many in Washington and Beijing are preparing for a Sino-US war. It may never happen, it may just be a proxy or limited war, or it may be World War 3. But regardless, both sides are
时政
( twitter.com)

24天前 • Isaac Stone Fish • -- 点击 0 评论

Cursor 如何使用 Agent 一开始我也不知道，但是发现怎么用后倒是相当简单，CMD+i 弹出 Composer 后，下面有个选择链接，默认是 Normal ，就是只写代码不操作，点击“agent”就可以切换为agent操作模式
IT技术
( twitter.com)

2个月前 • 宝玉 • -- 点击 0 评论

#JFSalon #季風人文講壇
#JimmyLai #黎智英活動報名已開啟🌿🙌🏻
On December 6th at JF Books, join us for a compelling conversation with Mark L. Clifford , president of the Committee for Freedom in Hong Kong, former executive director of the Asia Business Council, and
时政
( twitter.com)

2个月前 • JF Books 季風書園 • -- 点击 0 评论

My cartoon for & today
‘I’m sorry’: In order to drive a wedge between Australia and the United States ，Chinese ambassador expresses trade ban regret to Australia.
近日为离间澳美关系，中共大使对澳洲实施贸易报复表示抱歉 😂
时政
( twitter.com)

2个月前 • 巴丢草 Bad ї ucao • -- 点击 0 评论

NEW: Woman sleeping on a New York City subway burned alive by a man who lit a match and threw it on her, according to the New York Post.
“Animal” is too nice of a word to describe someone who would do this.
Police have since released a photo of the suspect.
Investigators say
时政
( twitter.com)

1个月前 • Collin Rugg • -- 点击 • 下载视频 0 评论

00:00:19

屋漏偏逢连夜雨
早上起来发现推特被盗了，找回推特后，发现钱包被盗了，损失 1 M Usd0++ ，钱应该是找不回了
事件逻辑是昨晚黑客伪装了一个推特，一眼看过去没问题，通过我的推特互动信息，伪装我是 XX
时政
( twitter.com)

1个月前 • Lsp • -- 点击 0 评论

你叫你m
之前朝鲜大军去俄罗斯的时候你们韩国什么军事大国定要让俄罗斯付出代价
结果弄了半天屁没放一个
军事大国和着都用来占领国会是吧
先把自家总统管好再搞什么正当性吧😂😅
时政
( twitter.com)

1个月前 • 川和 koi iok ！🇺🇦境外爱❤️习❤️🇨🇳势力 • -- 点击 0 评论

前 Twitter 董事会成员李飞飞最近出版了自传《the Worlds I See(我眼中的世界)》。在书中，她谈到了父母，但略过了祖父。她的祖父是前中共四川省委书记李井泉。1959 年至 1961 年间，在她祖父的领导下，四川农村有 1000
时政
( twitter.com)

1个月前 • 秦鹏 • -- 点击 0 评论

I'm more and more confident that tokenization will be gone. Humans don't think in "tokens". Tokens are hardcoded abstractions in LLMs that lead to weird behavior: LLMs can solve PhD-level math questions but cannot answer "Is 9.9 > 9.11?" Meta is shifting LLMs to LCMs (Large 时政 ( twitter.com )

时政

时政

Man kicks woman down the stairs at a subway station. This happened in Berlin in 2016. He was arrested and sentenced to 35 months in prison. He was beaten up by other inmates so they had to move him to a different prison where he was, again, beaten up 有趣 ( twitter.com)

有趣

NEW: Florida pizza delivery worker stabs a pregnant customer 14 times because she was upset about a $2 tip Brianna Alvelo, 22, was upset over a $2 tip after delivering a pizza to the Riviera Motel in Kissimmee and returned with an accomplice The victim was celebrating a 时政 ( twitter.com)

时政

One of the most reliable ways to improve our mental health is to help others. After being randomly assigned to do just 3 acts of kindness a week, people felt significantly less depressed, anxious, and lonely. Lifting others up elevates us too. Giving shows us that we matter. 时政 ( twitter.com)

时政

"It's on my todo to build my own stack of apple minis and run Llama on my own little cluster on my desk." - Quick AI homelab tutorial: - Install on each mini (open source, steps in README) - Make sure all the minis are on the same WiFi network or for 时政 ( twitter.com)

时政

On January 15th, an American netizen posted on Xiaohongshu: "I'm also interested in Marxism, but I've always been confused. Once we revolt, what do we do next? How do we proceed? How do we establish a stable government so that greedy people won't climb to the top and exploit 时政 ( twitter.com)

时政

Great news! An additional 5% of our token supply is now available to purchase on our website. We appreciate the overwhelming support and look forward to welcoming so many new people to our community! 🦅🇺🇸🦅 Please only purchase using the link in our bio to avoid scams. btc ( twitter.com)

btc

Imagine waking up in Britain and reading this, which is the equivalent of what Trump is doing on Day 1: -a national border emergency is declared -the military is sent to the Channel to stop the boats -a national priority is established to eliminate organised gangs on British btc ( twitter.com)

btc

时政

时政

时政

时政

有趣

During the Beijing Olympics, a 9-year-old girl who sang a patriotic song at the opening ceremony, was revealed to be lip-syncing. The real singer was a 7-year-old girl who was kept backstage, because she was considered not good looking enough and that might've damaged China's 有趣 ( twitter.com)

有趣

My X family, please see an awareness. Elon Musk is fighting the world alone for the future and safety of children! We must protect him! Those who criticize him are already enemies of children! Elon Musk is a diamond for the future of children! We must stand very strong next to 有趣 ( twitter.com)

有趣

时政

其实我是一个很懒的人 我真的对不起大家 本科考到了全系第一，我就放弃读书了，所以phd读得很不好 硅谷公司做到M，我就放弃内卷了，不想去开会，更不想manage up，直接躺平被动辞职 时政 ( twitter.com)

时政

All TikTok coverage misses one fundamental point. The reason why this matters so much is because many in Washington and Beijing are preparing for a Sino-US war. It may never happen, it may just be a proxy or limited war, or it may be World War 3. But regardless, both sides are 时政 ( twitter.com)

时政

Cursor 如何使用 Agent 一开始我也不知道，但是发现怎么用后倒是相当简单，CMD+i 弹出 Composer 后，下面有个选择链接，默认是 Normal ，就是只写代码不操作，点击“agent”就可以切换为agent操作模式 IT技术 ( twitter.com)

IT技术

时政

My cartoon for & today ‘I’m sorry’: In order to drive a wedge between Australia and the United States ，Chinese ambassador expresses trade ban regret to Australia. 近日为离间澳美关系，中共大使对澳洲实施贸易报复表示抱歉 😂 时政 ( twitter.com)

时政

时政

屋漏偏逢连夜雨 早上起来发现推特被盗了，找回推特后，发现钱包被盗了，损失 1 M Usd0++ ，钱应该是找不回了 事件逻辑是昨晚黑客伪装了一个推特，一眼看过去没问题，通过我的推特互动信息，伪装我是 XX 时政 ( twitter.com)

时政

你叫你m 之前朝鲜大军去俄罗斯的时候你们韩国什么军事大国定要让俄罗斯付出代价 结果弄了半天屁没放一个 军事大国和着都用来占领国会是吧 先把自家总统管好再搞什么正当性吧😂😅 时政 ( twitter.com)

时政

时政

创建一个新帐户

登录

I'm more and more confident that tokenization will be gone.
Humans don't think in "tokens".
Tokens are hardcoded abstractions in LLMs that lead to weird behavior: LLMs can solve PhD-level math questions but cannot answer "Is 9.9 > 9.11?"
Meta is shifting LLMs to LCMs (Large
时政
( twitter.com )