Generative World Renderer: 4 Million AAA Game Frames Dataset for Bidirectional Video Generation

arXiv·medium signal

Researchers release a 4-million-frame dataset (720p/30fps) of synchronized RGB and five G-buffer channels from Cyberpunk 2077 and Black Myth: Wukong, with sequences averaging 8 minutes up to 53 minutes of continuous recording covering diverse urban, outdoor, and indoor scenes with varying weather. The dataset enables bidirectional rendering — decomposing real game frames into geometry/material channels AND generating new video guided by G-buffers with text-prompt style editing — with 86 HuggingFace upvotes signaling strong builder interest in game-to-video-generation bridging.