I'm more and more confident that tokenization will be gone. Humans don't think in "tokens". Tokens are hardcoded abstractions in LLMs that lead to weird behavior: LLMs can solve PhD-level math questions but cannot answer "Is 9.9 > 9.11?" Meta is shifting LLMs to LCMs (Large , page 18

I'm more and more confident that tokenization will be gone.

Humans don't think in "tokens".

Tokens are hardcoded abstractions in LLMs that lead to weird behavior: LLMs can solve PhD-level math questions but cannot answer "Is 9.9 > 9.11?"

Meta is shifting LLMs to LCMs (Large Concept Models), changing "next-token prediction" to "next-concept prediction". A "concept" is treated as a sentence, representing an abstract idea or action.

Two weeks ago, Meta also published the "Byte Latent Transformer", a new architecture that processes raw bytes grouped into patches instead of relying on tokenization.

My intuition says LCM is probably better at reasoning and modalities.

点击图片查看原图

1周内 1个月内 1年内全部时间

I don't use any other social media.
I've always been here before I made money.
Just because I'm criticizing X doesn't mean I don't love it.
I'm criticizing it so that it can be better.
These two friends have 100K followers and they got paid twice as much as me.
And there's not
有趣
( twitter.com)

4个月前 • Figen • -- 点击 0 评论

Trump is scared.
Elon is scared.
JD Vance is scared.
And I don’t know about you, but I don’t want a couple of coward billionaires calling the shots in America.
I want someone who is going to fight for a $15 minimum wage, take on income inequality, and fight for working people.
时政
( twitter.com)

3个月前 • Alexandria Ocasio-Cortez • -- 点击 • 下载视频 0 评论

00:01:17

Life is not a garden of roses and we are all fighting to survive.
So I always share inspiring things that will soothe your soul and mind.
I do very good search for this.
I'm a very ordinary woman, but my account is effective.
I'm not a rich woman!
I receive many advertising
有趣
( twitter.com)

8个月前 • Figen • -- 点击 0 评论

Dear artists,
We are all agonizing over the loss of Palestinian and Israeli lives. A ceasefire will give Hamas the opportunity to prepare for round eight of war with Israel, and rounds nine, ten and eleven. As long as Hamas is alive, many more Palestinians and Israelis will die.…
时政
( twitter.com)

1年前 • Hussain Abdul-Hussain • -- 点击 0 评论

JUST IN: Chief of the UN Relief and Works Agency says that as of today, the agency is 'denied from providing lifesaving assistance to northern Gaza' and that the decision means 'the clock will tick faster towards famine and many more will die of hunger, dehydration and lack of…
时政
( twitter.com)

10个月前 • The Spectator Index • -- 点击 0 评论

🚨🇺🇸TRUMP UNLEASHES CALIFORNIA’S WATER—BIDEN AND NEWSOM LET WILDFIRES BURN!
For years, California suffered from artificial droughts and raging wildfires, while Biden and Newsom ignored obvious solutions—more WATER. Now, Trump has stepped in, ordering the Army Corps of Engineers
btc
( twitter.com)

9天前 • Mario Nawfal • -- 点击 0 评论

There are more articles and reports coming out of #Myanmar/#Burma which is good

But the situation is appalling and so few people are talking about it.

Why?

#Myanmar is #Asia's #Ukraine.

#SaveMyanmar #WhatsHappeningInMyanmar

时政
( www.bbc.co.uk)

1年前 • Benedict Rogers 羅傑斯 • -- 点击 0 评论

This is a meteorite: the mixture of the iron-nickel alloy and olivine originated from a small protoplanet out of the dawn of the Solar System. And, bonus, it's perfectly polished

[source, read more: ]
有趣
( buff.ly)

1年前 • Massimo • -- 点击 0 评论

The ominous pyrocumulus associated with the wildfires in British Columbia. This is the view looking north and east to Kelowna

[read more: ]

有趣
( buff.ly)

1年前 • Massimo • -- 点击 • 下载视频 0 评论

00:01:18

Optimus just poured a drink and didn’t ask for a 25% tip on an iPad.
Just put $10M more into Tesla stock
时政
( twitter.com)

4个月前 • Chris Bakke • -- 点击 • 下载视频 0 评论

00:01:18

A boy tried to play a prank on his friend and a cow appeared instead.
The cow was more scared than him.
有趣
( twitter.com)

4个月前 • Figen • -- 点击 • 下载视频 0 评论

00:00:06

A new, more clearer video of the collision between a helicopter and a passenger plane in Washington, D.C, has been released.
Via:
时政
( twitter.com)

10天前 • Raylan Givens • -- 点击 • 下载视频 0 评论

00:00:11

Some gay dude that I fired on the spot came and told me about why Drake is trending.
That reminded me of ...
I used to bully a kid in high school, and I’m not proud of it. He was a beta male, a pussy, and talked too much so I’d make fun of him sometimes.
One day he and his…
时政
( twitter.com)

1年前 • Nima Yamini • -- 点击 0 评论

Today, I felt that truly wants strength for his country and honesty in international relations.

I thanked him for supporting Ukraine and invited Argentina to work together with us to restore peace. We also discussed our bilateral cooperation, which can strengthen…
时政
( twitter.com)

1年前 • Volodymyr Zelenskyy / Володимир Зеленський • -- 点击 • 下载视频 0 评论

00:02:41

About three years ago, I became one of those persecuted Chinese journalists. I don’t live in China, and have since become an Australian citizen. The term "transnational repression" describes my experience: state-sponsored surveillance, harassment, smear campaigns, and threats of
时政
( twitter.com)

5个月前 • Vicky Xu / 許微其 • -- 点击 0 评论

This is the PS Hanami, my handmade Playstation 1 portable that I designed and built in one month! It uses a REAL PS1 motherboard that I cut in half, folded like a book, and rewired. NO emulation! Details in🧵
时政
( bitbuilt.net)

10个月前 • YveltalGriffin • -- 点击 0 评论

I'm 56.
Anxiety controlled me for years and I regret wasting my life making poor decisions...
Then I discovered Carl Jung’s Archetypes and 7 Laws of Finding Purpose.
Here's how to use your shadow to find your true self: 🧵
时政
( twitter.com)

3个月前 • Lorwen C Nagle, PhD • -- 点击 0 评论

I want to congratulate Secretary of State Marco Rubio in creating a freer world. I have the privilege of meeting him several times and heard first hand his commitment to Tibetans and HH the great 14th Dalai Lama of Tibet.
时政
( twitter.com)

20天前 • Lobsang Sangay • -- 点击 0 评论

I got very emotional leaving China. I will be returning in March to continue my mission advocating for peace between the USA and China. Thank you all for changing my life and giving me the opportunity to make a difference.
时政
( twitter.com)

10天前 • Evan Kail (PAWN MAN) • -- 点击 • 下载视频 0 评论

00:03:35

Finally received the clothes, the clothes are so cute, I am so happy, I can wear them for the Hong Kong meet and gr…
推特中文圈
( twitter.com)

2年前 • YingYing🍅•ᴗ• 🍅 • -- 点击 0 评论

You smiled and talked to me of nothing.
I felt that for this I had been waiting long.

Happy Birthday to TaeDarvid💙…
推特中文圈
( twitter.com)

2年前 • 禄存星君 • -- 点击 0 评论

I like hurt/comfort, slice of life, and deal with real life trauma stuff. I love works with a streak of light in th…
推特中文圈
( twitter.com)

1年前 • 静緒@⚡🐑 • -- 点击 1 评论

I just realised when I saw a photo of Keanu Reeves and his grandmother that he is part Asian. She was a Chinese-Hawaiian.
时政
( twitter.com)

2个月前 • Peter Dukes • -- 点击 0 评论

HAYMARKET | has released its Draft Haymarket Public Domain Plan, which looks to reallocate road space 4 wider footpaths, improved lighting & public art, and more seating. Check out before & after for Campbell St & Harbour St! Read more here:
时政
( meetings.cityofsydney.nsw.gov.au)

1年前 • TheSydneyBlog • -- 点击 0 评论

According to statistics, there are over 100,000 Chinese adult men working in Africa. Life in Africa can be quite harsh, yet in recent years, there has been a growing phenomenon where more and more people choose to settle down in Africa.

时政
( buff.ly)

1年前 • The China-Global South Project • -- 点击 0 评论

I'm more and more confident that tokenization will be gone. Humans don't think in "tokens". Tokens are hardcoded abstractions in LLMs that lead to weird behavior: LLMs can solve PhD-level math questions but cannot answer "Is 9.9 > 9.11?" Meta is shifting LLMs to LCMs (Large 时政 ( twitter.com )

时政

I don't use any other social media. I've always been here before I made money. Just because I'm criticizing X doesn't mean I don't love it. I'm criticizing it so that it can be better. These two friends have 100K followers and they got paid twice as much as me. And there's not 有趣 ( twitter.com)

有趣

时政

Life is not a garden of roses and we are all fighting to survive. So I always share inspiring things that will soothe your soul and mind. I do very good search for this. I'm a very ordinary woman, but my account is effective. I'm not a rich woman! I receive many advertising 有趣 ( twitter.com)

有趣

时政

时政

btc

There are more articles and reports coming out of #Myanmar/#Burma which is good But the situation is appalling and so few people are talking about it. Why? #Myanmar is #Asia's #Ukraine. #SaveMyanmar #WhatsHappeningInMyanmar 时政 ( www.bbc.co.uk)

时政

This is a meteorite: the mixture of the iron-nickel alloy and olivine originated from a small protoplanet out of the dawn of the Solar System. And, bonus, it's perfectly polished [source, read more: ] 有趣 ( buff.ly)

有趣

The ominous pyrocumulus associated with the wildfires in British Columbia. This is the view looking north and east to Kelowna [read more: ] 有趣 ( buff.ly)

有趣

Optimus just poured a drink and didn’t ask for a 25% tip on an iPad. Just put $10M more into Tesla stock 时政 ( twitter.com)

时政

A boy tried to play a prank on his friend and a cow appeared instead. The cow was more scared than him. 有趣 ( twitter.com)

有趣

A new, more clearer video of the collision between a helicopter and a passenger plane in Washington, D.C, has been released. Via: 时政 ( twitter.com)

时政

时政

Today, I felt that truly wants strength for his country and honesty in international relations. I thanked him for supporting Ukraine and invited Argentina to work together with us to restore peace. We also discussed our bilateral cooperation, which can strengthen… 时政 ( twitter.com)

时政

时政

This is the PS Hanami, my handmade Playstation 1 portable that I designed and built in one month! It uses a REAL PS1 motherboard that I cut in half, folded like a book, and rewired. NO emulation! Details in🧵 时政 ( bitbuilt.net)

时政

I'm 56. Anxiety controlled me for years and I regret wasting my life making poor decisions... Then I discovered Carl Jung’s Archetypes and 7 Laws of Finding Purpose. Here's how to use your shadow to find your true self: 🧵 时政 ( twitter.com)

时政

I want to congratulate Secretary of State Marco Rubio in creating a freer world. I have the privilege of meeting him several times and heard first hand his commitment to Tibetans and HH the great 14th Dalai Lama of Tibet. 时政 ( twitter.com)

时政

I got very emotional leaving China. I will be returning in March to continue my mission advocating for peace between the USA and China. Thank you all for changing my life and giving me the opportunity to make a difference. 时政 ( twitter.com)

时政

Finally received the clothes, the clothes are so cute, I am so happy, I can wear them for the Hong Kong meet and gr… 推特中文圈 ( twitter.com)

推特中文圈

You smiled and talked to me of nothing. I felt that for this I had been waiting long. Happy Birthday to TaeDarvid💙… 推特中文圈 ( twitter.com)

推特中文圈

I like hurt/comfort, slice of life, and deal with real life trauma stuff. I love works with a streak of light in th… 推特中文圈 ( twitter.com)

推特中文圈

I just realised when I saw a photo of Keanu Reeves and his grandmother that he is part Asian. She was a Chinese-Hawaiian. 时政 ( twitter.com)

时政

HAYMARKET | has released its Draft Haymarket Public Domain Plan, which looks to reallocate road space 4 wider footpaths, improved lighting & public art, and more seating. Check out before & after for Campbell St & Harbour St! Read more here: 时政 ( meetings.cityofsydney.nsw.gov.au)

时政

According to statistics, there are over 100,000 Chinese adult men working in Africa. Life in Africa can be quite harsh, yet in recent years, there has been a growing phenomenon where more and more people choose to settle down in Africa. 时政 ( buff.ly)

时政

创建一个新帐户

登录

I'm more and more confident that tokenization will be gone.
Humans don't think in "tokens".
Tokens are hardcoded abstractions in LLMs that lead to weird behavior: LLMs can solve PhD-level math questions but cannot answer "Is 9.9 > 9.11?"
Meta is shifting LLMs to LCMs (Large
时政
( twitter.com )

I don't use any other social media.
I've always been here before I made money.
Just because I'm criticizing X doesn't mean I don't love it.
I'm criticizing it so that it can be better.
These two friends have 100K followers and they got paid twice as much as me.
And there's not
有趣
( twitter.com)

Life is not a garden of roses and we are all fighting to survive.
So I always share inspiring things that will soothe your soul and mind.
I do very good search for this.
I'm a very ordinary woman, but my account is effective.
I'm not a rich woman!
I receive many advertising
有趣
( twitter.com)

There are more articles and reports coming out of #Myanmar/#Burma which is good

But the situation is appalling and so few people are talking about it.

Why?

#Myanmar is #Asia's #Ukraine.

#SaveMyanmar #WhatsHappeningInMyanmar

时政
( www.bbc.co.uk)

This is a meteorite: the mixture of the iron-nickel alloy and olivine originated from a small protoplanet out of the dawn of the Solar System. And, bonus, it's perfectly polished

[source, read more: ]
有趣
( buff.ly)

The ominous pyrocumulus associated with the wildfires in British Columbia. This is the view looking north and east to Kelowna

[read more: ]

有趣
( buff.ly)

Optimus just poured a drink and didn’t ask for a 25% tip on an iPad.
Just put $10M more into Tesla stock
时政
( twitter.com)

A boy tried to play a prank on his friend and a cow appeared instead.
The cow was more scared than him.
有趣
( twitter.com)

A new, more clearer video of the collision between a helicopter and a passenger plane in Washington, D.C, has been released.
Via:
时政
( twitter.com)

Today, I felt that truly wants strength for his country and honesty in international relations.

I thanked him for supporting Ukraine and invited Argentina to work together with us to restore peace. We also discussed our bilateral cooperation, which can strengthen…
时政
( twitter.com)

This is the PS Hanami, my handmade Playstation 1 portable that I designed and built in one month! It uses a REAL PS1 motherboard that I cut in half, folded like a book, and rewired. NO emulation! Details in🧵
时政
( bitbuilt.net)

I'm 56.
Anxiety controlled me for years and I regret wasting my life making poor decisions...
Then I discovered Carl Jung’s Archetypes and 7 Laws of Finding Purpose.
Here's how to use your shadow to find your true self: 🧵
时政
( twitter.com)

I want to congratulate Secretary of State Marco Rubio in creating a freer world. I have the privilege of meeting him several times and heard first hand his commitment to Tibetans and HH the great 14th Dalai Lama of Tibet.
时政
( twitter.com)

I got very emotional leaving China. I will be returning in March to continue my mission advocating for peace between the USA and China. Thank you all for changing my life and giving me the opportunity to make a difference.
时政
( twitter.com)

Finally received the clothes, the clothes are so cute, I am so happy, I can wear them for the Hong Kong meet and gr…
推特中文圈
( twitter.com)

You smiled and talked to me of nothing.
I felt that for this I had been waiting long.

Happy Birthday to TaeDarvid💙…
推特中文圈
( twitter.com)

I like hurt/comfort, slice of life, and deal with real life trauma stuff. I love works with a streak of light in th…
推特中文圈
( twitter.com)

I just realised when I saw a photo of Keanu Reeves and his grandmother that he is part Asian. She was a Chinese-Hawaiian.
时政
( twitter.com)

HAYMARKET | has released its Draft Haymarket Public Domain Plan, which looks to reallocate road space 4 wider footpaths, improved lighting & public art, and more seating. Check out before & after for Campbell St & Harbour St! Read more here:
时政
( meetings.cityofsydney.nsw.gov.au)

According to statistics, there are over 100,000 Chinese adult men working in Africa. Life in Africa can be quite harsh, yet in recent years, there has been a growing phenomenon where more and more people choose to settle down in Africa.

时政
( buff.ly)