FederateLOL
  • Communities
  • Create Post
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
hendrik@palaver.p3x.de to LocalLLaMA@sh.itjust.worksEnglish ·
edit-2
4 months ago

(New) papers by Meta: Large Concept Models and BLT

message-square
message-square
0
fedilink
1
message-square

(New) papers by Meta: Large Concept Models and BLT

hendrik@palaver.p3x.de to LocalLLaMA@sh.itjust.worksEnglish ·
edit-2
4 months ago
message-square
0
fedilink

Seems Meta have been doing some research lately, to replace the current tokenizers with new/different representations:

  • Large Concept Models: Language Modeling in a Sentence Representation Space [Github] (December 11, 2024)
  • Byte Latent Transformer: Patches Scale Better Than Tokens [Github] (December 12, 2024)
alert-triangle
You must log in or register to comment.

LocalLLaMA@sh.itjust.works

localllama@sh.itjust.works

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: [email protected]

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 34 users / day
  • 34 users / week
  • 34 users / month
  • 34 users / 6 months
  • 0 local subscribers
  • 2.5K subscribers
  • 50 Posts
  • 0 Comments
  • Modlog
  • mods:
  • SkySyrup@sh.itjust.works
  • pax@sh.itjust.works
  • noneabove1182@sh.itjust.works
  • BE: 0.19.8
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org