Elorian 发布首个模型 Glimpse,面向视觉思考
Elorian’s first model, Glimpse, is built for Visual Thinking. Ask it questions about images and video, and it reasons through what it sees. How many monkeys can you count? The part I’m interested in: being able to dig into footage. What changed? Why did that happen? What is the robot doing at each step? If it can do all that reliably, robotics data labeling changes entirely. Most teleop footage sits unlabelled because segmenting every step by hand is slow and expensive. A model that watches the clip and writes the labels itself turns that backlog into training data. Feels like there’s a lot to build here. cc @ElorianAI @AndrewDai
Elorian 发布首个模型 Glimpse,主打 Visual Thinking,可对图片和视频提问并推理所看到的内容。作者关注的是它对视频片段的追问能力,比如画面里发生了什么变化、为什么发生、机器人在每一步做什么。他认为如果这类能力足够可靠,机器人遥操作数据标注会彻底改变,因为大量遥操作视频因逐步手工切分标注太慢太贵而闲置,模型自己看片段写标签就能把这些积压素材变成训练数据。
粉丝 25万
Everything AI + Robotics, deep dives, hottakes. I help business and individuals overcome in the age of AI. Optimist [email protected] for partnerships 🤝
- 浏览
- 1994
- 点赞
- 11
- 评论
- 7
- 分享
- 0
- 收藏
- 4
数字来自平台,为最近一次抓取时的数据。
来源:X · Linus Ekenstam · x.com