AI systems like Gemini Live can now see objects in a user's physical environment, interpret them, have conversations about them, and complete tasks by providing specific instructions (like 'use the cumin seed' or 'put that garam masala into the pan') based on visual understanding.