I'm more and more confident that tokenization will be gone. Humans don't think in "tokens". Tokens are hardcoded abstractions in LLMs that lead to weird behavior: LLMs can solve PhD-level math questions but cannot answer "Is 9.9 > 9.11?" Meta is shifting LLMs to LCMs (Large

I'm more and more confident that tokenization will be gone.

Humans don't think in "tokens".

Tokens are hardcoded abstractions in LLMs that lead to weird behavior: LLMs can solve PhD-level math questions but cannot answer "Is 9.9 > 9.11?"

Meta is shifting LLMs to LCMs (Large Concept Models), changing "next-token prediction" to "next-concept prediction". A "concept" is treated as a sentence, representing an abstract idea or action.

Two weeks ago, Meta also published the "Byte Latent Transformer", a new architecture that processes raw bytes grouped into patches instead of relying on tokenization.

My intuition says LCM is probably better at reasoning and modalities.

点击图片查看原图

1周内 1个月内 1年内全部时间

"[G]ain-of-function research of concern..involves manipulating viruses to be..more transmissible..or deadly..[I[t is..intensely controversial..Kevin M. Esvelt..MIT..wrote 'I implore every scientist, funder, and nation working in this field: Please stop.'"

时政
( www.thefp.com)

1年前 • Richard H. Ebright • -- 点击 0 评论

Here are the losses I could identify today.
There is another video of like 10 more russian losses but I am not confident they aren't duplicates and I need to precisely geolocate them before I say anything more about them.
时政
( losses.ukrdailyupdate.com)

10个月前 • Andrew Perpetua • -- 点击 0 评论

I never loved you any more than I do, right this second. And I’ll never love you any less than I do, right this se…
推特中文圈
( twitter.com)

1年前 • Film的巧克力工厂🍫 • -- 点击 0 评论

I met with Prime Minister Netanyahu and the Israeli War Cabinet in Tel Aviv to discuss efforts to get more aid into Gaza and get hostages out.
More aid is getting in, but it’s not enough. I emphasized that Israel must make this a priority.
时政
( twitter.com)

10个月前 • Secretary Antony Blinken • -- 点击 0 评论

1/7
I was finally able to get a copy of book and just finished reading it. I of course expected it to be a very interesting book, but it is even better and more important than I expected.
时政
( twitter.com)

3个月前 • Michael Pettis • -- 点击 0 评论

I thank Germany and Olaf Scholz for the new military assistance package. It is timely and focused on our priorities, particularly air defense.
The advanced Skynex system and additional IRIS-T SLM missiles will strengthen our sky shield and save more lives. I am…
时政
( twitter.com)

1年前 • Volodymyr Zelenskyy / Володимир Зеленський • -- 点击 0 评论

My wife asked me why I did not go to work on LLMs for more money.
“I just want to save lives.”
And the objective function of self-driving is saving lives and nothing else.
btc
( twitter.com)

10天前 • Yun-Ta Tsai • -- 点击 0 评论

More riots in the Uk and after seeing them arrest people for facebook post I stand with the people
时政
( twitter.com)

5个月前 • Jake Shields • -- 点击 • 下载视频 0 评论

00:00:10

That’s a good news.
I hope president Trump and his would work faster, looking forward to hear more good news before…
推特中文圈
( twitter.com)

4年前 • twitter机器人 • -- 点击 0 评论

Urgent call for action!
I am receiving videos and evidence of Israeli sports-tourists in Amsterdam being brutally attacked.
What I see seems to be life-threatening: innocent people being run-over, beaten, driven into a river and more.
I call on the Dutch authorities to act
时政
( twitter.com)

2个月前 • Naftali Bennett נפתלי בנט • -- 点击 0 评论

I went up to Apple Park and spent time with and the Apple Vision Pro design team to learn more about the origin of the Apple Vision Pro, and what the future holds for it, and us.
时政
( vntyfr.com)

1年前 • Nick Bilton • -- 点击 0 评论

The more I know people, the more I like dogs.
有趣
( twitter.com)

29天前 • NO CONTEXT HUMANS • -- 点击 • 下载视频 0 评论

00:00:08

I thought I already took and posted a picture for March, but I actually forgot to upload! 😭😅 A senior problem...😆 M…
推特中文圈
( twitter.com)

1年前 • Grandma Xiami 蝦米娘娘 • -- 点击 0 评论

Merry Christmas everyone, I wish you and your loved ones a safe and happy holidays🎄🎊 And I’ll see you all soon at m…
推特中文圈
( twitter.com)

2年前 • The Leech • -- 点击 0 评论

Thank you to for hosting my exhibit about the #CaesarPhotos and my friend #MazenAlHamada , disappeared by the #Assad regime 1,340 days. More photos, and a video of my “artist talk” coming. I hope to show this exhibit in as many locations as I can.
时政
( twitter.com)

1年前 • Marc Nelson 🌊 🇺🇦 • -- 点击 0 评论

I wrote that when I became Trump’s national security adviser, I assumed the gravity of his role would discipline even him. I was wrong. His erratic approach to governance and his dangerous ideas gravely threaten American security. GOP primary voters should take note. More in the…
时政
( twitter.com)

1年前 • John Bolton • -- 点击 0 评论

Today, Lori and I welcomed to Scranton, where we established a partnership between our Commonwealth and Zaporizhzhia.
More than 160,000 Ukrainians call Pennsylvania home — and even though our capitals are separated by thousands of miles, we share a bond with our
时政
( twitter.com)

4个月前 • Governor Josh Shapiro • -- 点击 0 评论

"I decided because I need to solve all the injustices of the world to start charging more for people who didn't take the time to say hello and connect and realize we're all people behind the counter," Simms said.

The sign reads:

"One small coffee"
$5.00

"One small coffee,…
时政
( twitter.com)

1年前 • Epoch Inspired • -- 点击 0 评论

I will show you an awareness about the 2 posts I posted!
-The first pic is a picture; 227K likes and 4 million impressions.
-The second pic is a video; 154K likes and 20 million impressions.
In this case, the algorithm is reaching the videos to more people.
有趣
( twitter.com)

3个月前 • Figen • -- 点击 0 评论

Honored to meet with His Holiness the a global figure for compassion and nonviolence. I conveyed greetings from wishing a smooth recovery and reaffirming the United States’ unwavering support for the Tibetan community.
Read more here:
时政
( www.state.gov)

5个月前 • Under Secretary Uzra Zeya • -- 点击 0 评论

Boebert: “I’m done wasting time. I have 4 boys at home, I have a grandson at home. I would love to spend more time with them. I have put my life on hold to come here and provide results. I’m not here for the political show, the political theater.”
时政
( twitter.com)

1年前 • Ron Filipkowski • -- 点击 • 下载视频 0 评论

00:00:32

Elon Musk: AI is like a genius child. You want it to grow up with love of the truth and of humanity.
“I do worry about AI. Because we are creating an intelligence that ultimately will be far more intelligent than any human, and ultimately more intelligent than the sum of all
btc
( twitter.com)

8天前 • ELON CLIPS • -- 点击 • 下载视频 0 评论

00:01:20

My colleague and friend Foreign Minister Hayashi in Kyiv.

I appreciate his visit and Japan's ongoing support. We work together in order for more Asian countries to join the Peace Formula.

Japan and Japanese companies will play an active role in Ukraine's recovery.
时政
( twitter.com)

1年前 • Dmytro Kuleba • -- 点击 0 评论

Google Veo 2 art testing. "THE GOAT IS BACK" - Chinese Shui-mo Style. Overall, Veo 2 is strongly capable of prompt following, e.g. "misty jungle", "fog", "wild life" etc., and I strongly recommend its dolly zoom. All PIXEL GENERATED FROM TEXT by Veo2, sound is added manually.
时政
( twitter.com)

1个月前 • Franklin Goodman • -- 点击 • 下载视频 0 评论

00:00:16

I laughed way more than I should have.
有趣
( twitter.com)

15天前 • NO CONTEXT HUMANS • -- 点击 0 评论