用 Gemini 做视频推理:Opus 与 Astra 搭配多模态 Gemini 验证 3D 游戏与交互应用
Opus and Astra are my daily drivers. But i love using both with Gemini for video reasoning tasks. ESPECIALLY useful if you’re making videos, 3d games or interactive apps that require actual play through to verify. Just ask your agents to screen record test candidates and have multimodal Gemini be the critic. Have them read GDMs agentic video understanding blog to learn how to prompt gemini for these tasks and turn it into a skill. It’ll catch tons of issues that are hard for agents to catch with screenshots alone eg. flickering, z-fighting, ui label collisions, audio discrepancies etc. Saves me a ton time and i wish I started doing this sooner.
开发者将 Opus 和 Astra 与多模态 Gemini 搭配用于视频推理任务,尤其适合需要实际试玩验证的视频、3D 游戏或交互应用。做法是让智能体录屏测试候选版本,再由 Gemini 担任评审,可发现截图难以捕捉的闪烁、z-fighting、UI 标签碰撞、音频不一致等问题。
粉丝 12万
decompiling reality; reconstructing real world events from public data. experimenting with vfx, sensing & robotics. https://t.co/O19H0QHsGW
- 浏览
- 8742
- 点赞
- 113
- 评论
- 19
- 分享
- 9
- 收藏
- 74
数字来自平台,为最近一次抓取时的数据。
来源:X · Bilawal Sidhu · x.com