I'm more and more confident that tokenization will be gone. Humans don't think in "tokens". Tokens are hardcoded abstractions in LLMs that lead to weird behavior: LLMs can solve PhD-level math questions but cannot answer "Is 9.9 > 9.11?" Meta is shifting LLMs to LCMs (Large , page 30

I'm more and more confident that tokenization will be gone.

Humans don't think in "tokens".

Tokens are hardcoded abstractions in LLMs that lead to weird behavior: LLMs can solve PhD-level math questions but cannot answer "Is 9.9 > 9.11?"

Meta is shifting LLMs to LCMs (Large Concept Models), changing "next-token prediction" to "next-concept prediction". A "concept" is treated as a sentence, representing an abstract idea or action.

Two weeks ago, Meta also published the "Byte Latent Transformer", a new architecture that processes raw bytes grouped into patches instead of relying on tokenization.

My intuition says LCM is probably better at reasoning and modalities.

点击图片查看原图

1周内 1个月内 1年内全部时间

Every time I think this time is different and hold my shitcoin overnight, I wake up realizing every time is the same.
This is solana, adapt or die.
btc
( twitter.com)

1个月前 • 冷静冷静再冷静 • -- 点击 0 评论

On this grim second anniversary of Putin’s invasion I am honoured to be here in Ukraine. With their indomitable courage I have no doubt that the Ukrainians will win and expel Putin’s forces - provided we give them the military, political and economic help that they need.
时政
( twitter.com)

1年前 • Boris Johnson • -- 点击 0 评论

Doctors often claim that measles is making a comeback because of "antivaxers".
So I plotted measles cases as a ten-year rolling average using CDC data.
And I found that measles is actually not making a comeback.
These "doctors" and "experts" are simply lying to everyone.
btc
( twitter.com)

26天前 • Kevin Bass PhD MS • -- 点击 0 评论

ANDREJ KARPATHY: ELON LOVES SMALL, HIGHLY TECHNICAL TEAMS.
“Elon likes very small, strong, highly technical teams.
At companies, by default, the teams grow and they get large.
Elon was always a force against growth.
I would have to work and expend efforts to hire people.
I
btc
( twitter.com)

2个月前 • Mario Nawfal • -- 点击 • 下载视频 0 评论

00:00:33

🔥HOLY SMOKES: Tulsi just took apart The Russia Hoax, the Dirty 51 laptop letter, Clapper, Brennan, weaponized FBI in her opening statement — and then it got personal:
"Just 24 hours after I criticized Kamala Harris and her nomination, I was placed on a secret domestic terror
btc
( twitter.com)

1个月前 • Western Lensman • -- 点击 • 下载视频 0 评论

00:01:32

I know you’re lashing out because DOGE is uncovering your family’s obscene grifting via USAID, but I won’t let you lie and distort facts. The FAA administrator announced he resigned over a month before Trump took office, and the air traffic controllers were always exempt from
btc
( twitter.com)

1个月前 • Secretary Sean Duffy • -- 点击 0 评论

I ran against Maxine Waters in the 2016, 2018, 2020, and 2022 elections. In August 2018, Maxine Waters wrote an open letter to the Department of Justice and Capitol Police, urging them to investigate me. Nearly six years later, I was indicted over baseless allegations.
The FBI
时政
( twitter.com)

1个月前 • Omar Navarro • -- 点击 0 评论

"I’m personally a Holocaust survivor as an infant, I barely survived. My grandparents were killed in Aushwitz and most of my extended family were killed. I became a Zionist; this dream of the Jewish people resurrected in their historical homeland and the barbed wire of Aushwitz…
时政
( twitter.com)

1年前 • Naila • -- 点击 0 评论

"Today, I am holding up an image that shows many current political prisoners in China. My heart aches terribly every time I see this picture. But I put it on my desk at home and I look at it every day...I know I must let the world know about the human rights abuses in China.”
时政
( twitter.com)

1年前 • China Commission • -- 点击 • 下载视频 0 评论

00:00:33

This is what Ukraine is fighting for.
May there be 2024 times more reunions, miracles, hugs, and tears of joy in the coming year.
xxchris.officielxx/TikTok
时政
( twitter.com)

1年前 • Anton Gerashchenko • -- 点击 • 下载视频 0 评论

00:01:22

Tokyo is the largest and the most populated city on earth: the latest estimates indicate that more than 37 million people live there.
📷: Yuto Yamada
有趣
( twitter.com)

1年前 • Curiosity • -- 点击 0 评论

We're not going to stand by and allow foreign nations to continue flooding our country with fentanyl. Too many American kids have already died. No more.
btc
( twitter.com)

1个月前 • Donald Trump Jr. • -- 点击 • 下载视频 0 评论

00:00:51

“A simple and comfortable life”--
Love you more than3000.

行疆万里皆坦途，一路生花。
生日快乐

#TaeDarvid
#HappyDarvidDay2022
图片
( twitter.com)

2年前 • 子平子栋🇨🇳 • -- 点击 0 评论

Anodizing titanium generates an array of different colors which are dependent on the thickness of the oxide and determined by the anodising voltage

[read more: ]
[📹 ]

有趣
( twitter.com)

1年前 • Massimo • -- 点击 • 下载视频 0 评论

00:00:21

This lenticular post card simulates the prop from “Back to the Future" and it was created for the 35th anniversary of the movie

[source, read more: ]

有趣
( buff.ly)

1年前 • Massimo • -- 点击 • 下载视频 0 评论

00:00:15

JUST IN: 🇺🇸 US Federal Reserve Chair Jerome Powell says inflation is still too high and that there could be more interest rate hikes to come
时政
( twitter.com)

1年前 • The Spectator Index • -- 点击 0 评论

Just finished an interview with an entrepreneur pioneered in AI and LLM, my former Microsoft colleague. The video will be shared next week. More talks coming !
时政
( twitter.com)

1年前 • Robert Mao • -- 点击 0 评论

IRS modernization is 30 years behind schedule, $15 billion over budget, and is relying on outdated technology.
We are working hard to make it more efficient.
btc
( twitter.com)

4天前 • Secretary of Treasury Scott Bessent • -- 点击 • 下载视频 0 评论

00:11:47

Remove the CK Hutchison operated ports (in blue), and wonder no more why strong man Xi Jinping is not happy: 1/2
(The Economist, March 20)
时政
( twitter.com)

16小时前 • Sari Arho Havrén • -- 点击 0 评论

韩国人气模特孙允珠高清套图 039 [25P]
写真

3年前 • 老司机 • -- 点击 0 评论

Known and reported main hacking offenses against the U.S. by the PRC:
—Office of Personnel Management (OPM) Breach (2015)
Chinese hackers accessed personal information of more than 21 million current and former federal employees, including sensitive data such as fingerprint…
时政
( twitter.com)

1年前 • MilesYu 余茂春 • -- 点击 0 评论

BREAKING: The Washington Post reports that Iran's attack could be 'more sudden, larger in scale and longer — possibly lasting several days instead of several hours' and could involve a 'coordinated barrage from multiple directions' involving Tehran's proxies in Lebanon, Yemen,
时政
( twitter.com)

7个月前 • The Spectator Index • -- 点击 0 评论

Speaking Chinese and having lived in China—they often go together—does not make people soft on China
"Chinese-speaking experts expressed warmer feelings toward China but favored tougher and more uncompromising policy responses than non-Chinese-language speakers."
1/3
时政
( twitter.com)

7个月前 • Neil Thomas 牛犇 • -- 点击 0 评论

We found nearly $2 billion in contracts that we’ll be canceling so we can redirect the funds back to Veterans health care and benefits.
No more paying consultants to do things like make Power Point slides and write meeting minutes!
btc
( twitter.com)

27天前 • VA Secretary Doug Collins • -- 点击 • 下载视频 0 评论

00:01:54

Huge step forward for advanced chip manufacturing in the U.S. We have seen great results as a lead customer in Arizona and we look forward to building even more of our highest performance compute and AI chips here in America.
btc
( twitter.com)

21天前 • Lisa Su • -- 点击 0 评论

I'm more and more confident that tokenization will be gone. Humans don't think in "tokens". Tokens are hardcoded abstractions in LLMs that lead to weird behavior: LLMs can solve PhD-level math questions but cannot answer "Is 9.9 > 9.11?" Meta is shifting LLMs to LCMs (Large 时政 ( twitter.com )

时政

Every time I think this time is different and hold my shitcoin overnight, I wake up realizing every time is the same. This is solana, adapt or die. btc ( twitter.com)

btc

On this grim second anniversary of Putin’s invasion I am honoured to be here in Ukraine. With their indomitable courage I have no doubt that the Ukrainians will win and expel Putin’s forces - provided we give them the military, political and economic help that they need. 时政 ( twitter.com)

时政

Doctors often claim that measles is making a comeback because of "antivaxers". So I plotted measles cases as a ten-year rolling average using CDC data. And I found that measles is actually not making a comeback. These "doctors" and "experts" are simply lying to everyone. btc ( twitter.com)

btc

ANDREJ KARPATHY: ELON LOVES SMALL, HIGHLY TECHNICAL TEAMS. “Elon likes very small, strong, highly technical teams. At companies, by default, the teams grow and they get large. Elon was always a force against growth. I would have to work and expend efforts to hire people. I btc ( twitter.com)

btc

🔥HOLY SMOKES: Tulsi just took apart The Russia Hoax, the Dirty 51 laptop letter, Clapper, Brennan, weaponized FBI in her opening statement — and then it got personal: "Just 24 hours after I criticized Kamala Harris and her nomination, I was placed on a secret domestic terror btc ( twitter.com)

btc

btc

I ran against Maxine Waters in the 2016, 2018, 2020, and 2022 elections. In August 2018, Maxine Waters wrote an open letter to the Department of Justice and Capitol Police, urging them to investigate me. Nearly six years later, I was indicted over baseless allegations. The FBI 时政 ( twitter.com)

时政

时政

时政

This is what Ukraine is fighting for. May there be 2024 times more reunions, miracles, hugs, and tears of joy in the coming year. xxchris.officielxx/TikTok 时政 ( twitter.com)

时政

Tokyo is the largest and the most populated city on earth: the latest estimates indicate that more than 37 million people live there. 📷: Yuto Yamada 有趣 ( twitter.com)

有趣

We're not going to stand by and allow foreign nations to continue flooding our country with fentanyl. Too many American kids have already died. No more. btc ( twitter.com)

btc

“A simple and comfortable life”-- Love you more than3000. 行疆万里皆坦途，一路生花。 生日快乐 #TaeDarvid #HappyDarvidDay2022 图片 ( twitter.com)

图片

Anodizing titanium generates an array of different colors which are dependent on the thickness of the oxide and determined by the anodising voltage [read more: ] [📹 ] 有趣 ( twitter.com)

有趣

This lenticular post card simulates the prop from “Back to the Future" and it was created for the 35th anniversary of the movie [source, read more: ] 有趣 ( buff.ly)

有趣

JUST IN: 🇺🇸 US Federal Reserve Chair Jerome Powell says inflation is still too high and that there could be more interest rate hikes to come 时政 ( twitter.com)

时政

Just finished an interview with an entrepreneur pioneered in AI and LLM, my former Microsoft colleague. The video will be shared next week. More talks coming ! 时政 ( twitter.com)

时政

IRS modernization is 30 years behind schedule, $15 billion over budget, and is relying on outdated technology. We are working hard to make it more efficient. btc ( twitter.com)

btc

Remove the CK Hutchison operated ports (in blue), and wonder no more why strong man Xi Jinping is not happy: 1/2 (The Economist, March 20) 时政 ( twitter.com)

时政

韩国人气模特 孙允珠 高清套图 039 [25P] 写真

写真

时政

时政

Speaking Chinese and having lived in China—they often go together—does not make people soft on China "Chinese-speaking experts expressed warmer feelings toward China but favored tougher and more uncompromising policy responses than non-Chinese-language speakers." 1/3 时政 ( twitter.com)

时政

We found nearly $2 billion in contracts that we’ll be canceling so we can redirect the funds back to Veterans health care and benefits. No more paying consultants to do things like make Power Point slides and write meeting minutes! btc ( twitter.com)

btc

Huge step forward for advanced chip manufacturing in the U.S. We have seen great results as a lead customer in Arizona and we look forward to building even more of our highest performance compute and AI chips here in America. btc ( twitter.com)

btc

创建一个新帐户

登录

I'm more and more confident that tokenization will be gone.
Humans don't think in "tokens".
Tokens are hardcoded abstractions in LLMs that lead to weird behavior: LLMs can solve PhD-level math questions but cannot answer "Is 9.9 > 9.11?"
Meta is shifting LLMs to LCMs (Large
时政
( twitter.com )