derivadas.dev

Pablo Díaz Viñambres

MSc Informatics @ TUM

Project Hestia

ROS2Isaac SimFranka EmikaRobotics


Franka Emika arms next to the BSH smart kitchen appliances used at the hackathon.

Hestia is a project from the RoboTUM students club with the goal of building a robotized kitchen environment that can perceive ingredients and containers, operate smart appliances, and eventually handle a cooking recipe end to end. The project is still in an early phase. We kicked off in April 2026 and spent the first months scoping the perception, action and physical (hardware) layers of the system in simulation, while building out partnerships. We have so far secured a strong foundation and multiple partnerships: MIRMI (TUM’s robotics institute) is providing compute and access to Franka Emika arms, BSH (Bosch/Siemens home appliances) is sponsoring smart kitchen appliances, and SICK is supplying RGB-D cameras for perception.

In August 2026 we ran our first hackathon, where the team got hands-on for the first time: operating BSH countertop appliances through basic manipulation and teleoperation, and starting early experiments fine-tuning vision-language-action (VLA) models alongside more classical control of a Franka Emika arm. In parallel, our hardware team began prototyping the “smart countertop”. We intend to develop a coil-array-driven, magnetic-levitation surface (inspired by Festo’s SupraMotion and Planar Motor systems) meant to glide containers around the kitchen without any extra mechanical manipulation.