I'm more and more confident that tokenization will be gone. Humans don't think in "tokens". Tokens are hardcoded abstractions in LLMs that lead to weird behavior: LLMs can solve PhD-level math questions but cannot answer "Is 9.9 > 9.11?" Meta is shifting LLMs to LCMs (Large , page 14

I'm more and more confident that tokenization will be gone.

Humans don't think in "tokens".

Tokens are hardcoded abstractions in LLMs that lead to weird behavior: LLMs can solve PhD-level math questions but cannot answer "Is 9.9 > 9.11?"

Meta is shifting LLMs to LCMs (Large Concept Models), changing "next-token prediction" to "next-concept prediction". A "concept" is treated as a sentence, representing an abstract idea or action.

Two weeks ago, Meta also published the "Byte Latent Transformer", a new architecture that processes raw bytes grouped into patches instead of relying on tokenization.

My intuition says LCM is probably better at reasoning and modalities.

点击图片查看原图

1周内 1个月内 1年内全部时间

We cannot—and will not—let terrorists like Hamas and tyrants like Putin win.

I refuse to let that happen.
时政
( twitter.com)

1年前 • Joe Biden • -- 点击 • 下载视频 0 评论

00:00:48

Welcome back to China, My U.S. Mission colleagues and I are looking forward to your visit to Shanghai and Beijing.
时政
( twitter.com)

9个月前 • Ambassador Nicholas Burns • -- 点击 0 评论

President Biden on the death of Wagner Group leader Yevgeny Prigozhin: "I said I would be careful of what I drink and what I rode in. I don't know for a fact what happened, but I'm not surprised."
时政
( twitter.com)

1年前 • CSPAN • -- 点击 • 下载视频 0 评论

00:00:20

If Australian gov continues being soft on China and not showing any real consequence to Beijing，Yang wont survive this torture and more Australian lives will be on the line due to China‘s threat and long reach.
时政
( twitter.com)

1年前 • 巴丢草 Bad ї ucao • -- 点击 0 评论

The planets of the Solar System look big (especially the gas and ice giants), but they could all fit into the distance between the Earth and the Moon (and with about 8,030 km to spare)

[read more: ]
有趣
( buff.ly)

1年前 • Massimo • -- 点击 0 评论

Thank you so much to everyone who's commented, I mean it 😊😊 I can't reply to everyone but I read all the comments and I really appreciate them all.
While I'm here, here's a little well-timed present for you, and the many new subscribers/followers! 🤭🤭 4:30 pm this arvo!
时政
( twitter.com)

1年前 • Building Beautifully • -- 点击 0 评论

Sometimes I have no energy to get up. But then I come across a story like this: a boy who, despite surviving a missile attack, losing his mom, and suffering severe burns, spent a year recovering and now wins dance competitions
I he can do it - I can do it, we all can do it! 1/
时政
( twitter.com)

1年前 • Tymofiy Mylovanov • -- 点击 0 评论

President Biden: “As I said last week, I am the President, but I am also a Dad. Jill and I love our son, and we are so proud of the man he is today. So many families who have had loved ones battle addiction understand the feeling of pride seeing someone you love come out the
时政
( twitter.com)

8个月前 • Kaitlan Collins • -- 点击 0 评论

The catalog for the collection of propaganda posters at CEAS — primarily about medicine and public health. Hope other scholars will find them useful and generative and appreciate their value as a form of primary source, as much as I did when I cataloged 40+ of them!
时政
( twitter.com)

1年前 • Zhaorui Lü • -- 点击 0 评论

Today, I visited our brigades in the Donetsk region to speak directly with our warriors.

3rd and 5th Assault, 80th Airborne, 57th Motorized, 22nd and 24th Mechanized, 26th Artillery, 92nd Mechanized.

I was honored to thank each of them for their bravery and results for Ukraine.
时政
( twitter.com)

1年前 • Володимир Зеленський • -- 点击 • 下载视频 0 评论

00:02:34

Today, I had a candid conversation with President Xi Jinping of the People’s Republic of China on a range of issues, including areas of cooperation and areas of difference.
I emphasized the importance of maintaining peace and stability across the Taiwan Strait and in the South…
时政
( twitter.com)

10个月前 • President Biden • -- 点击 0 评论

Just like Kamala Harris, I have been the underdog and I have been underestimated!! My success always discredited!… Let me tell you something, women have to work ten times harder and perform ten times better and STILL our success comes with excuses… its because shes pretty or
时政
( twitter.com)

3个月前 • Cardi B • -- 点击 0 评论

Richard Dawkins: I have a very favorable impression of Elon Musk and his concern for the welfare of the world.
“I have sat with [Elon] on a transatlantic plane and had a very, very long conversation with him. He's undoubtedly highly intelligent and knowledgeable.
I've had lunch
btc
( twitter.com)

19天前 • ELON CLIPS • -- 点击 • 下载视频 0 评论

00:00:37

A couple in Brazil planted more than 2 million trees over 20 years and successfully restored a devastated forest
时政
( twitter.com)

5个月前 • Crazed • -- 点击 0 评论

I'm more and more confident that tokenization will be gone. Humans don't think in "tokens". Tokens are hardcoded abstractions in LLMs that lead to weird behavior: LLMs can solve PhD-level math questions but cannot answer "Is 9.9 > 9.11?" Meta is shifting LLMs to LCMs (Large 时政 ( twitter.com )

时政

We cannot—and will not—let terrorists like Hamas and tyrants like Putin win. I refuse to let that happen. 时政 ( twitter.com)

时政

Welcome back to China, My U.S. Mission colleagues and I are looking forward to your visit to Shanghai and Beijing. 时政 ( twitter.com)

时政

President Biden on the death of Wagner Group leader Yevgeny Prigozhin: "I said I would be careful of what I drink and what I rode in. I don't know for a fact what happened, but I'm not surprised." 时政 ( twitter.com)

时政

If Australian gov continues being soft on China and not showing any real consequence to Beijing，Yang wont survive this torture and more Australian lives will be on the line due to China‘s threat and long reach. 时政 ( twitter.com)

时政

The planets of the Solar System look big (especially the gas and ice giants), but they could all fit into the distance between the Earth and the Moon (and with about 8,030 km to spare) [read more: ] 有趣 ( buff.ly)

有趣

Try what?! I blinked a few times and it was done 有趣 ( twitter.com)

有趣

I watched this a few times and still can’t believe it 有趣 ( twitter.com)

有趣

Ladies and Gentlemen: I present, Kamala Harris — in her own words. 时政 ( twitter.com)

时政

I love how horses are half majestic and half derp 😂 有趣 ( twitter.com)

有趣

I was gonna defend the cyclist and then the video continued 有趣 ( twitter.com)

有趣

It’s 2024 and i still don’t know how McLovin did this 有趣 ( twitter.com)

有趣

I think he committed a crime and hid! Never appears! 😂 有趣 ( twitter.com)

有趣

Here are losses I could identify today. And a map update: 时政 ( twitter.com)

时政

I love how horses are half majestic and half derp 😂 有趣 ( twitter.com)

有趣

Finally something I can use to protect myself and my printer 时政 ( twitter.com)

时政

First time I saw someone did this right and very efficient 有趣 ( twitter.com)

有趣

时政

Sometimes I have no energy to get up. But then I come across a story like this: a boy who, despite surviving a missile attack, losing his mom, and suffering severe burns, spent a year recovering and now wins dance competitions I he can do it - I can do it, we all can do it! 1/ 时政 ( twitter.com)

时政

President Biden: “As I said last week, I am the President, but I am also a Dad. Jill and I love our son, and we are so proud of the man he is today. So many families who have had loved ones battle addiction understand the feeling of pride seeing someone you love come out the 时政 ( twitter.com)

时政

The catalog for the collection of propaganda posters at CEAS — primarily about medicine and public health. Hope other scholars will find them useful and generative and appreciate their value as a form of primary source, as much as I did when I cataloged 40+ of them! 时政 ( twitter.com)

时政

时政

时政

时政

Richard Dawkins: I have a very favorable impression of Elon Musk and his concern for the welfare of the world. “I have sat with [Elon] on a transatlantic plane and had a very, very long conversation with him. He's undoubtedly highly intelligent and knowledgeable. I've had lunch btc ( twitter.com)

btc

A couple in Brazil planted more than 2 million trees over 20 years and successfully restored a devastated forest 时政 ( twitter.com)

时政

创建一个新帐户

登录

I'm more and more confident that tokenization will be gone.
Humans don't think in "tokens".
Tokens are hardcoded abstractions in LLMs that lead to weird behavior: LLMs can solve PhD-level math questions but cannot answer "Is 9.9 > 9.11?"
Meta is shifting LLMs to LCMs (Large
时政
( twitter.com )

We cannot—and will not—let terrorists like Hamas and tyrants like Putin win.

I refuse to let that happen.
时政
( twitter.com)

Welcome back to China, My U.S. Mission colleagues and I are looking forward to your visit to Shanghai and Beijing.
时政
( twitter.com)

President Biden on the death of Wagner Group leader Yevgeny Prigozhin: "I said I would be careful of what I drink and what I rode in. I don't know for a fact what happened, but I'm not surprised."
时政
( twitter.com)

If Australian gov continues being soft on China and not showing any real consequence to Beijing，Yang wont survive this torture and more Australian lives will be on the line due to China‘s threat and long reach.
时政
( twitter.com)

The planets of the Solar System look big (especially the gas and ice giants), but they could all fit into the distance between the Earth and the Moon (and with about 8,030 km to spare)

[read more: ]
有趣
( buff.ly)

Try what?! I blinked a few times and it was done
有趣
( twitter.com)

I watched this a few times and still can’t believe it
有趣
( twitter.com)

Ladies and Gentlemen:
I present, Kamala Harris — in her own words.
时政
( twitter.com)

I love how horses are half majestic and half derp 😂
有趣
( twitter.com)

I was gonna defend the cyclist and then the video continued
有趣
( twitter.com)

It’s 2024 and i still don’t know how McLovin did this
有趣
( twitter.com)

I think he committed a crime and hid!
Never appears! 😂
有趣
( twitter.com)

Here are losses I could identify today.
And a map update:
时政
( twitter.com)