I'm more and more confident that tokenization will be gone. Humans don't think in "tokens". Tokens are hardcoded abstractions in LLMs that lead to weird behavior: LLMs can solve PhD-level math questions but cannot answer "Is 9.9 > 9.11?" Meta is shifting LLMs to LCMs (Large , page 15

I'm more and more confident that tokenization will be gone.

Humans don't think in "tokens".

Tokens are hardcoded abstractions in LLMs that lead to weird behavior: LLMs can solve PhD-level math questions but cannot answer "Is 9.9 > 9.11?"

Meta is shifting LLMs to LCMs (Large Concept Models), changing "next-token prediction" to "next-concept prediction". A "concept" is treated as a sentence, representing an abstract idea or action.

Two weeks ago, Meta also published the "Byte Latent Transformer", a new architecture that processes raw bytes grouped into patches instead of relying on tokenization.

My intuition says LCM is probably better at reasoning and modalities.

点击图片查看原图

1周内 1个月内 1年内全部时间

Digital artist Miroslav Fek makes 3D art about imaginary critters and they result actually cute and captivating. This is an Omikron caring mother carryig her precious offspring to safety

[more clips: ]

有趣
( buff.ly)

1年前 • Massimo • -- 点击 • 下载视频 0 评论

00:00:06

La Plata is a planned city, urban planning paradigm of the late 19th century, designed in a very strict grid-pattern form, and with many avenues and diagonals

[read more: ]
[video: ]
有趣
( twitter.com)

1年前 • Massimo • -- 点击 0 评论

We tightened monetary policy to get fewer homes built and make construction workers unemployed.

Yet in our political debates we also pretend to want more housing built and even lower unemployment.
时政
( twitter.com)

1年前 • Cameron Murray • -- 点击 0 评论

Stockholm Public Library is one of the city's most notable structures.

It includes more than 2 million volumes and 2.4 million audio tapes, CDs and audio books.

[📹 Jann Lipka]

有趣
( twitter.com)

1年前 • Massimo • -- 点击 • 下载视频 0 评论

00:00:30

Vice President-elect 🇹🇼Xiao Meiqin was invited to visit the European Parliament and met with more than 30 European Parliament leaders and heavyweight members including First Deputy Speaker Othmar Karas.
时政
( twitter.com)

11个月前 • Theresa Fallon • -- 点击 0 评论

The catalog for the collection of propaganda posters at CEAS — primarily about medicine and public health. Hope other scholars will find them useful and generative and appreciate their value as a form of primary source, as much as I did when I cataloged 40+ of them!
时政
( twitter.com)

1年前 • Zhaorui Lü • -- 点击 0 评论

Today, I visited our brigades in the Donetsk region to speak directly with our warriors.

3rd and 5th Assault, 80th Airborne, 57th Motorized, 22nd and 24th Mechanized, 26th Artillery, 92nd Mechanized.

I was honored to thank each of them for their bravery and results for Ukraine.
时政
( twitter.com)

1年前 • Володимир Зеленський • -- 点击 • 下载视频 0 评论

00:02:34

Today, I had a candid conversation with President Xi Jinping of the People’s Republic of China on a range of issues, including areas of cooperation and areas of difference.
I emphasized the importance of maintaining peace and stability across the Taiwan Strait and in the South…
时政
( twitter.com)

10个月前 • President Biden • -- 点击 0 评论

Just like Kamala Harris, I have been the underdog and I have been underestimated!! My success always discredited!… Let me tell you something, women have to work ten times harder and perform ten times better and STILL our success comes with excuses… its because shes pretty or
时政
( twitter.com)

3个月前 • Cardi B • -- 点击 0 评论

Richard Dawkins: I have a very favorable impression of Elon Musk and his concern for the welfare of the world.
“I have sat with [Elon] on a transatlantic plane and had a very, very long conversation with him. He's undoubtedly highly intelligent and knowledgeable.
I've had lunch
btc
( twitter.com)

27天前 • ELON CLIPS • -- 点击 • 下载视频 0 评论

00:00:37

SF-No.039 Megumi Asakura (浅倉惠)[20P]
写真

2年前 • 老司机 • -- 点击 0 评论

Usually, I don't like conspiracy theories. But...I found 7 photos, and will put them all here（other 3 underneath th…
推特中文圈
( twitter.com)

4年前 • twitter机器人 • -- 点击 0 评论

“Massive store, where can I find that one screw I need?”

The accuracy of the navigation and indoor location is insane.
时政
( twitter.com)

1年前 • Andrew Hart • -- 点击 • 下载视频 0 评论

00:00:57

I just realized that the kanji for bone, 「骨」, looks like a little skeleton fella, and I can't get over it...
时政
( twitter.com)

1年前 • Cameron Sewell • -- 点击 0 评论

People need to understand Australia is at its peak of appeasement with China now.
Voices like this is getting smaller and less.
But I will keep doing it here and i want you to join me.
时政
( twitter.com)

7个月前 • 巴丢草 Bad ї ucao • -- 点击 • 下载视频 0 评论

00:00:32

5951624😜😞likely good myself
No matter what kind of relationship you want to be strange, I won't look at you more.…
推特中文圈
( twitter.com)

1年前 • UrsulineKendall🥇Btc • -- 点击 0 评论

Researchers have found that more species of crocodiles can gallop than previously thought. And they are fast

[📹 rodtrejo]

有趣
( twitter.com)

1年前 • Massimo • -- 点击 • 下载视频 0 评论

00:00:09

Lithuania has collected today more than €8.3 million for Ukraine army, and just look at these photos🤌🇱🇹🇺🇦
时政
( twitter.com)

11个月前 • vanya ✙ 🇺🇦 • -- 点击 0 评论

Europe has given about $80B more aid to Ukraine than the US — Trump’s numbers are brazenly fabricated and self-serving.
时政
( twitter.com)

5个月前 • Steven Rattner • -- 点击 0 评论

Trump: When I was president, I demanded that this guy, the governor, accept the water coming from the north, from way up in Canada. And, you know, the north, it flows down through right through Los Angeles. I mean, massive millions and millions of gallons of water a week,
时政
( twitter.com)

1个月前 • Acyn • -- 点击 • 下载视频 0 评论

00:00:56

We cannot—and will not—let terrorists like Hamas and tyrants like Putin win.

I refuse to let that happen.
时政
( twitter.com)

1年前 • Joe Biden • -- 点击 • 下载视频 0 评论

00:00:48

Welcome back to China, My U.S. Mission colleagues and I are looking forward to your visit to Shanghai and Beijing.
时政
( twitter.com)

10个月前 • Ambassador Nicholas Burns • -- 点击 0 评论

This oncidium miniature hybrid of Mulattas x varicosa is called Gomesa Jiaho Queen Orchid. It mimics the colours and figure of a lady dancing in a black and yellow dress

[read more: ]
有趣
( buff.ly)

1年前 • Massimo • -- 点击 0 评论

There are more than 1,300 wild giant pandas living in Sichuan and you can actually work as a panda volunteer caretaker

These are the conditions that should be met and general information:

有趣
( buff.ly)

1年前 • Massimo • -- 点击 • 下载视频 0 评论

00:00:43

This kind of soft robot has been developed using metal particles and external magnets to make a slime-like substance that can move around, change shape and even grip objects.

[read more: ]

有趣
( buff.ly)

1年前 • Massimo • -- 点击 • 下载视频 0 评论

00:01:41

I'm more and more confident that tokenization will be gone. Humans don't think in "tokens". Tokens are hardcoded abstractions in LLMs that lead to weird behavior: LLMs can solve PhD-level math questions but cannot answer "Is 9.9 > 9.11?" Meta is shifting LLMs to LCMs (Large 时政 ( twitter.com )

时政

Digital artist Miroslav Fek makes 3D art about imaginary critters and they result actually cute and captivating. This is an Omikron caring mother carryig her precious offspring to safety [more clips: ] 有趣 ( buff.ly)

有趣

La Plata is a planned city, urban planning paradigm of the late 19th century, designed in a very strict grid-pattern form, and with many avenues and diagonals [read more: ] [video: ] 有趣 ( twitter.com)

有趣

We tightened monetary policy to get fewer homes built and make construction workers unemployed. Yet in our political debates we also pretend to want more housing built and even lower unemployment. 时政 ( twitter.com)

时政

Stockholm Public Library is one of the city's most notable structures. It includes more than 2 million volumes and 2.4 million audio tapes, CDs and audio books. [📹 Jann Lipka] 有趣 ( twitter.com)

有趣

Vice President-elect 🇹🇼Xiao Meiqin was invited to visit the European Parliament and met with more than 30 European Parliament leaders and heavyweight members including First Deputy Speaker Othmar Karas. 时政 ( twitter.com)

时政

The catalog for the collection of propaganda posters at CEAS — primarily about medicine and public health. Hope other scholars will find them useful and generative and appreciate their value as a form of primary source, as much as I did when I cataloged 40+ of them! 时政 ( twitter.com)

时政

时政

时政

时政

Richard Dawkins: I have a very favorable impression of Elon Musk and his concern for the welfare of the world. “I have sat with [Elon] on a transatlantic plane and had a very, very long conversation with him. He's undoubtedly highly intelligent and knowledgeable. I've had lunch btc ( twitter.com)

btc

SF-No.039 Megumi Asakura (浅倉惠)[20P] 写真

写真

Usually, I don't like conspiracy theories. But...I found 7 photos, and will put them all here（other 3 underneath th… 推特中文圈 ( twitter.com)

推特中文圈

“Massive store, where can I find that one screw I need?” The accuracy of the navigation and indoor location is insane. 时政 ( twitter.com)

时政

I just realized that the kanji for bone, 「骨」, looks like a little skeleton fella, and I can't get over it... 时政 ( twitter.com)

时政

People need to understand Australia is at its peak of appeasement with China now. Voices like this is getting smaller and less. But I will keep doing it here and i want you to join me. 时政 ( twitter.com)

时政

5951624😜😞likely good myself No matter what kind of relationship you want to be strange, I won't look at you more.… 推特中文圈 ( twitter.com)

推特中文圈

Researchers have found that more species of crocodiles can gallop than previously thought. And they are fast [📹 rodtrejo] 有趣 ( twitter.com)

有趣

Lithuania has collected today more than €8.3 million for Ukraine army, and just look at these photos🤌🇱🇹🇺🇦 时政 ( twitter.com)

时政

Europe has given about $80B more aid to Ukraine than the US — Trump’s numbers are brazenly fabricated and self-serving. 时政 ( twitter.com)

时政

Trump: When I was president, I demanded that this guy, the governor, accept the water coming from the north, from way up in Canada. And, you know, the north, it flows down through right through Los Angeles. I mean, massive millions and millions of gallons of water a week, 时政 ( twitter.com)

时政

We cannot—and will not—let terrorists like Hamas and tyrants like Putin win. I refuse to let that happen. 时政 ( twitter.com)

时政

Welcome back to China, My U.S. Mission colleagues and I are looking forward to your visit to Shanghai and Beijing. 时政 ( twitter.com)

时政

This oncidium miniature hybrid of Mulattas x varicosa is called Gomesa Jiaho Queen Orchid. It mimics the colours and figure of a lady dancing in a black and yellow dress [read more: ] 有趣 ( buff.ly)

有趣

There are more than 1,300 wild giant pandas living in Sichuan and you can actually work as a panda volunteer caretaker These are the conditions that should be met and general information: 有趣 ( buff.ly)

有趣

This kind of soft robot has been developed using metal particles and external magnets to make a slime-like substance that can move around, change shape and even grip objects. [read more: ] 有趣 ( buff.ly)

有趣

创建一个新帐户

登录

I'm more and more confident that tokenization will be gone.
Humans don't think in "tokens".
Tokens are hardcoded abstractions in LLMs that lead to weird behavior: LLMs can solve PhD-level math questions but cannot answer "Is 9.9 > 9.11?"
Meta is shifting LLMs to LCMs (Large
时政
( twitter.com )

Digital artist Miroslav Fek makes 3D art about imaginary critters and they result actually cute and captivating. This is an Omikron caring mother carryig her precious offspring to safety

[more clips: ]

有趣
( buff.ly)

La Plata is a planned city, urban planning paradigm of the late 19th century, designed in a very strict grid-pattern form, and with many avenues and diagonals

[read more: ]
[video: ]
有趣
( twitter.com)

We tightened monetary policy to get fewer homes built and make construction workers unemployed.

Yet in our political debates we also pretend to want more housing built and even lower unemployment.
时政
( twitter.com)

Stockholm Public Library is one of the city's most notable structures.

It includes more than 2 million volumes and 2.4 million audio tapes, CDs and audio books.

[📹 Jann Lipka]

有趣
( twitter.com)

Vice President-elect 🇹🇼Xiao Meiqin was invited to visit the European Parliament and met with more than 30 European Parliament leaders and heavyweight members including First Deputy Speaker Othmar Karas.
时政
( twitter.com)

The catalog for the collection of propaganda posters at CEAS — primarily about medicine and public health. Hope other scholars will find them useful and generative and appreciate their value as a form of primary source, as much as I did when I cataloged 40+ of them!
时政
( twitter.com)

Richard Dawkins: I have a very favorable impression of Elon Musk and his concern for the welfare of the world.
“I have sat with [Elon] on a transatlantic plane and had a very, very long conversation with him. He's undoubtedly highly intelligent and knowledgeable.
I've had lunch
btc
( twitter.com)

SF-No.039 Megumi Asakura (浅倉惠)[20P]
写真

Usually, I don't like conspiracy theories. But...I found 7 photos, and will put them all here（other 3 underneath th…
推特中文圈
( twitter.com)

“Massive store, where can I find that one screw I need?”

The accuracy of the navigation and indoor location is insane.
时政
( twitter.com)

I just realized that the kanji for bone, 「骨」, looks like a little skeleton fella, and I can't get over it...
时政
( twitter.com)

People need to understand Australia is at its peak of appeasement with China now.
Voices like this is getting smaller and less.
But I will keep doing it here and i want you to join me.
时政
( twitter.com)

5951624😜😞likely good myself
No matter what kind of relationship you want to be strange, I won't look at you more.…
推特中文圈
( twitter.com)

Researchers have found that more species of crocodiles can gallop than previously thought. And they are fast

[📹 rodtrejo]

有趣
( twitter.com)

Lithuania has collected today more than €8.3 million for Ukraine army, and just look at these photos🤌🇱🇹🇺🇦
时政
( twitter.com)

Europe has given about $80B more aid to Ukraine than the US — Trump’s numbers are brazenly fabricated and self-serving.
时政
( twitter.com)

Trump: When I was president, I demanded that this guy, the governor, accept the water coming from the north, from way up in Canada. And, you know, the north, it flows down through right through Los Angeles. I mean, massive millions and millions of gallons of water a week,
时政
( twitter.com)

We cannot—and will not—let terrorists like Hamas and tyrants like Putin win.

I refuse to let that happen.
时政
( twitter.com)

Welcome back to China, My U.S. Mission colleagues and I are looking forward to your visit to Shanghai and Beijing.
时政
( twitter.com)

This oncidium miniature hybrid of Mulattas x varicosa is called Gomesa Jiaho Queen Orchid. It mimics the colours and figure of a lady dancing in a black and yellow dress

[read more: ]
有趣
( buff.ly)

There are more than 1,300 wild giant pandas living in Sichuan and you can actually work as a panda volunteer caretaker

These are the conditions that should be met and general information:

有趣
( buff.ly)

This kind of soft robot has been developed using metal particles and external magnets to make a slime-like substance that can move around, change shape and even grip objects.

[read more: ]

有趣
( buff.ly)