Google DeepMind just dropped 'Genie', an AI that can generate interactive video games.

This is a huge deal.

Genie is trained on 200,000 hours of unsupervised public internet gaming videos and can generate video games from a single prompt or image.

But here's what's insane:

Despite not being trained on action or text annotations, the foundation model can determine who the main character is and enable a user to control that character in the generated world.

It does this through its Latent Action Model, Video Tokenizer, and Dynamics Model (will go more in-depth on this in tomorrow's newsletter for those interested).

And for those asking, yes, it's research-only and not publicly available (here come the Google memes), and it does come with some limitations, like only currently creating games at 1FPS.

But this is the worst AI will ever be.

#Google #Genie #AI
@Dagmawi_Babi

It's actually kinda blowing my mind thinking about the engineering.

Genie enables users to act in the generated environments on a frame-by-frame basis despite training without any ground-truth action labels or other domain-specific requirements typically found in the world model literature. Further the resulting learned latent action space facilitates training agents to imitate behaviors from unseen videos.

Let me simply explain this:
You can show it a picture and it can separate the world from the character AND define its own world logic frame by frame.

You literally don't have to put collider boxes on game items for them to interact, it just does that without that.

Literally u don't have to define the logics of the game world you're building, u can if u want to, but u don't have to.

This's oddly a super freaking interesting idea.

#Google #Genie #AI
@Dagmawi_Babi

And even more simply put...

You can easily generate an entire video game based on a sketch or a picture u have. The AI will handle literally everything else including expanding the world, character control, game logic open world interactions and so much more! 🤯

#Google #Genie #AI
@Dagmawi_Babi

Here is the research paper
• https://t.me/c/1156511084/813

Let's not even talk about how they trained it without human supervision on unlabelled videos. AND it scaled well as they increased GPUs which most LLMs don't.

#Google #Genie #AI #Papers
@Dagmawi_Babi