I'm more and more confident that tokenization will be gone. Humans don't think in "tokens". Tokens are hardcoded abstractions in LLMs that lead to weird behavior: LLMs can solve PhD-level math questions but cannot answer "Is 9.9 > 9.11?" Meta is shifting LLMs to LCMs (Large , page 7

I'm more and more confident that tokenization will be gone.

Humans don't think in "tokens".

Tokens are hardcoded abstractions in LLMs that lead to weird behavior: LLMs can solve PhD-level math questions but cannot answer "Is 9.9 > 9.11?"

Meta is shifting LLMs to LCMs (Large Concept Models), changing "next-token prediction" to "next-concept prediction". A "concept" is treated as a sentence, representing an abstract idea or action.

Two weeks ago, Meta also published the "Byte Latent Transformer", a new architecture that processes raw bytes grouped into patches instead of relying on tokenization.

My intuition says LCM is probably better at reasoning and modalities.

点击图片查看原图

1周内 1个月内 1年内全部时间

A family member told me that I "should raise the Palestinian flag if I care about the innocent children and civilians who are bombed in Gaza."

I will NOT raise the Palestinian flag specifically because I care about the innocent children and civilians who are bombed in Gaza.

I…
时政
( twitter.com)

1年前 • Luai Ahmed • -- 点击 • 下载视频 0 评论

00:01:06

"If I died knowing that I did my best to do what was right and even if in the history books they said I did wrong, I would still feel okay about that.
I care about the reality of goodness and not the perception of it." 👌
-Elon Musk
有趣
( twitter.com)

4个月前 • Figen • -- 点击 • 下载视频 0 评论

00:01:08

Today, I started a new job at , leading the org’s research on the CCP’s repression domestically and globally. But my commitment stays the same, that is to the freedom of my home country. While we are in a grim time, I’m more hopeful than ever👇🏻
时政
( twitter.com)

1年前 • Yaqiu Wang 王亚秋 • -- 点击 0 评论

Regardless of the result, I urge all Americans to respect the verdict and the legal process. At this dangerously divided moment in our history, all leaders—regardless of party—must not pour fuel on the fire with more toxic partisanship. We must reaffirm what has made this nation
时政
( twitter.com)

8个月前 • Governor Larry Hogan • -- 点击 0 评论

I’ve been looking forward to this week. I invested time, money, and reputation convincing powerful friends of the dangers and corruption of the American left and the damage being done to our citizens, culture, and institutions. I encouraged them to speak up and call for reform.
btc
( twitter.com)

20天前 • Joe Lonsdale • -- 点击 0 评论

We don’t need four more years of arrogance and bumbling and bluster and division under Donald Trump.
America is ready for a better story – we’re ready for a President
时政
( twitter.com)

3个月前 • Barack Obama • -- 点击 • 下载视频 0 评论

00:02:58

🇦🇷🇺🇸MILEI: WE'VE CUT 900+ REGULATIONS AND OFFERED TO HELP TRUMP AND ELON DO THE SAME
"Today we have already eliminated more than 900 regulations, due to more than three per day.
In this line, we have made ourselves available to Trump and my friend Elon to share what we have
btc
( twitter.com)

19天前 • Mario Nawfal • -- 点击 • 下载视频 0 评论

00:00:18

Here are losses I could identify for september 28th and 29th and October 1st.
时政
( twitter.com)

4个月前 • Andrew Perpetua • -- 点击 0 评论

Our warriors, our heroes. The front line.

I am proud of each and every one of them.

And I am grateful to each brigade for its strength!
时政
( twitter.com)

1年前 • Volodymyr Zelenskyy / Володимир Зеленський • -- 点击 • 下载视频 0 评论

00:00:48

Today, President Lula and I are proud to announce the Partnership for Workers' Rights.

Both the President and I share a common vision where workers and their families are protected, empowered, and elevated in our economic policymaking.

That's what our Partnership is about.
时政
( twitter.com)

1年前 • President Biden • -- 点击 0 评论

If I go to a funeral and I see this trust me I'm leaving 😭
有趣
( twitter.com)

19天前 • Wild Clips • -- 点击 • 下载视频 0 评论

00:00:30

I still don't get it, Global Times. Maybe just one more cartoon with some other mixing implement?
时政
( twitter.com)

1年前 • Joel Atkinson • -- 点击 0 评论

I will never be bullied or silenced by any death threat from Beijing. I will keep making art to criticize CCP human rights abuse and the danger of China's dictatorship. And I am calling all Aussie cartoonists and journalists in solidarity to support our rights of free speech!
时政
( twitter.com)

10个月前 • 巴丢草 Bad ї ucao • -- 点击 0 评论

Reason for this censorship from is “you sent something that attacks a person，or a group of people，based on who they are.”
Hell yes i am attacking Trump for he is pro fascism and praised Hiter！
And I am a political cartoonist and thats what I do！
时政
( twitter.com)

3个月前 • 巴丢草 Bad ї ucao • -- 点击 0 评论

I'm more and more confident that tokenization will be gone. Humans don't think in "tokens". Tokens are hardcoded abstractions in LLMs that lead to weird behavior: LLMs can solve PhD-level math questions but cannot answer "Is 9.9 > 9.11?" Meta is shifting LLMs to LCMs (Large 时政 ( twitter.com )

时政

时政

"If I died knowing that I did my best to do what was right and even if in the history books they said I did wrong, I would still feel okay about that. I care about the reality of goodness and not the perception of it." 👌 -Elon Musk 有趣 ( twitter.com)

有趣

Today, I started a new job at , leading the org’s research on the CCP’s repression domestically and globally. But my commitment stays the same, that is to the freedom of my home country. While we are in a grim time, I’m more hopeful than ever👇🏻 时政 ( twitter.com)

时政

时政

I’ve been looking forward to this week. I invested time, money, and reputation convincing powerful friends of the dangers and corruption of the American left and the damage being done to our citizens, culture, and institutions. I encouraged them to speak up and call for reform. btc ( twitter.com)

btc

We don’t need four more years of arrogance and bumbling and bluster and division under Donald Trump. America is ready for a better story – we’re ready for a President 时政 ( twitter.com)

时政

South Korea will provide Ukraine with more mine detectors and demining equipment, Yonhap reports. 时政 ( en.yna.co.kr)

时政

Bolivian Titi monkeys sleep with their tails entwined for balance and socialization [read more: ] 有趣 ( bit.ly)

有趣

This is how the bones grow and form in your hand [source, read more: ] 有趣 ( buff.ly)

有趣

btc

Here are losses I could identify for september 28th and 29th and October 1st. 时政 ( twitter.com)

时政

Our warriors, our heroes. The front line. I am proud of each and every one of them. And I am grateful to each brigade for its strength! 时政 ( twitter.com)

时政

Today, President Lula and I are proud to announce the Partnership for Workers' Rights. Both the President and I share a common vision where workers and their families are protected, empowered, and elevated in our economic policymaking. That's what our Partnership is about. 时政 ( twitter.com)

时政

If I go to a funeral and I see this trust me I'm leaving 😭 有趣 ( twitter.com)

有趣

I still don't get it, Global Times. Maybe just one more cartoon with some other mixing implement? 时政 ( twitter.com)

时政

I will never be bullied or silenced by any death threat from Beijing. I will keep making art to criticize CCP human rights abuse and the danger of China's dictatorship. And I am calling all Aussie cartoonists and journalists in solidarity to support our rights of free speech! 时政 ( twitter.com)

时政

Reason for this censorship from is “you sent something that attacks a person，or a group of people，based on who they are.” Hell yes i am attacking Trump for he is pro fascism and praised Hiter！ And I am a political cartoonist and thats what I do！ 时政 ( twitter.com)

时政

“And that’s how I met your mother” 有趣 ( twitter.com)

有趣

Back when I wasn't miserable and sad 时政 ( twitter.com)

时政

"And that's how I met your mother" 有趣 ( twitter.com)

有趣

And that's how I met your mother... 有趣 ( twitter.com)

有趣

"And that's how I met your mother" 有趣 ( twitter.com)

有趣

"And that's how I met your mother" 有趣 ( twitter.com)

有趣

"And that's how I met your mother" 有趣 ( twitter.com)

有趣

"And that's how I met your mother" 有趣 ( twitter.com)

有趣

创建一个新帐户

登录

I'm more and more confident that tokenization will be gone.
Humans don't think in "tokens".
Tokens are hardcoded abstractions in LLMs that lead to weird behavior: LLMs can solve PhD-level math questions but cannot answer "Is 9.9 > 9.11?"
Meta is shifting LLMs to LCMs (Large
时政
( twitter.com )

"If I died knowing that I did my best to do what was right and even if in the history books they said I did wrong, I would still feel okay about that.
I care about the reality of goodness and not the perception of it." 👌
-Elon Musk
有趣
( twitter.com)

Today, I started a new job at , leading the org’s research on the CCP’s repression domestically and globally. But my commitment stays the same, that is to the freedom of my home country. While we are in a grim time, I’m more hopeful than ever👇🏻
时政
( twitter.com)

I’ve been looking forward to this week. I invested time, money, and reputation convincing powerful friends of the dangers and corruption of the American left and the damage being done to our citizens, culture, and institutions. I encouraged them to speak up and call for reform.
btc
( twitter.com)

We don’t need four more years of arrogance and bumbling and bluster and division under Donald Trump.
America is ready for a better story – we’re ready for a President
时政
( twitter.com)

South Korea will provide Ukraine with more mine detectors and demining equipment, Yonhap reports.
时政
( en.yna.co.kr)

Bolivian Titi monkeys sleep with their tails entwined for balance and socialization

[read more: ]
有趣
( bit.ly)

This is how the bones grow and form in your hand

[source, read more: ]

有趣
( buff.ly)

Here are losses I could identify for september 28th and 29th and October 1st.
时政
( twitter.com)

Our warriors, our heroes. The front line.

I am proud of each and every one of them.

And I am grateful to each brigade for its strength!
时政
( twitter.com)

Today, President Lula and I are proud to announce the Partnership for Workers' Rights.

Both the President and I share a common vision where workers and their families are protected, empowered, and elevated in our economic policymaking.

That's what our Partnership is about.
时政
( twitter.com)

If I go to a funeral and I see this trust me I'm leaving 😭
有趣
( twitter.com)

I still don't get it, Global Times. Maybe just one more cartoon with some other mixing implement?
时政
( twitter.com)

I will never be bullied or silenced by any death threat from Beijing. I will keep making art to criticize CCP human rights abuse and the danger of China's dictatorship. And I am calling all Aussie cartoonists and journalists in solidarity to support our rights of free speech!
时政
( twitter.com)

Reason for this censorship from is “you sent something that attacks a person，or a group of people，based on who they are.”
Hell yes i am attacking Trump for he is pro fascism and praised Hiter！
And I am a political cartoonist and thats what I do！
时政
( twitter.com)

“And that’s how I met your mother”
有趣
( twitter.com)

Back when I wasn't miserable and sad
时政
( twitter.com)

"And that's how I met your mother"
有趣
( twitter.com)

And that's how I met your mother...
有趣
( twitter.com)

"And that's how I met your mother"
有趣
( twitter.com)

"And that's how I met your mother"
有趣
( twitter.com)

"And that's how I met your mother"
有趣
( twitter.com)

"And that's how I met your mother"
有趣
( twitter.com)