The Progress Report
We may be coming to a state near you. After our presentation in San Diego, we are lining up a few things in the coming weeks and months. I’ll let you know where and when as things are solidified.
Meanwhile work with our beta group is progressing nicely. We’ve got some really neat things happening.
Here are a few links worth your time.
Meta recently released Megabyte, which was tested with 1.2M tokens. Reddit user ShotgunProxy breaks it down in detail here, but he says:
- Instead of using individual tokens, the researchers break a sequence into "patches." Patch size can vary, but a patch can contain the equivalent of many tokens. Think of the traditional approach like assembling a 1000-piece puzzle vs. a 10-piece puzzle. Now the researchers are breaking that 1000-piece puzzle into 10-piece mini-puzzles again.
- The patches are then individually handled by a smaller model, while a larger global model coordinates the overall output across all patches.
Adobe just released their generative filler and this demo video is pretty incredible. You really have to see it to believe it!
It seems from all the news that artificial intelligence is new, but it’s been around for decades in different forms. Here’s a video from more than a decade ago about robotic limbs, using an earlier version of AI to control them. I love this quote from Jan Sherman who suffers from spino-cerebellar degeneration, she can only move her face and a few muscles in her neck:
Share the newsletter…
Here’s a link to today’s newsletter
Sign up for the newsletter…
If you got this from a friend, you can sign up to get the newsletter for free every week morning here.