VLM (Claude v3 Sonnet) Drives in GTA San Andreas (Exp1) #

AI Video Generation for: Story of Shepherd Boy and the Wolf #

Github Link: https://github.com/yogendra-yatnalkar/VLM-drives-in-GTA

Last Edited: 05/08/2024

Youtube Video #

Description: #

Trying to play with Anthropic Claude V3 (Haiku and Sonnet). My theory is that these VLM’s are quite good in deciding how to drive based on current input frame and the past actions. Need to confirm the hypothesis.