Skip to content

Physical AI

Ducks, Sensors, and Agents

with Brian McFadden

Thursday 24 September 11:00 AM – 1:00 PM Stage 14

About This Session

By the end of this workshop, attendees will be able to: 1. Describe the end-to-end edge AI workflow, using agentic AI coding throughout: (a) Collect data and label images with bounding boxes; (b) Design a machine learning model with Edge Impulse; (c) Train and test the model; (d) Create a reusable Edge Impulse skill for the AI agent, capturing the workflow conventions (API usage, project structure, deployment steps) so the agent can reliably assist on future Edge AI projects. 2. Re-train an object detection model on a custom "rubber ducks" dataset: (a) Test the new model on your mobile phone, using the camera and the browser; (b) Deploy on an Arduino UNO Q with the App Lab integration, using the AI agent (with the Edge Impulse skill) to generate and iterate on the application code — camera capture, inference loop, and output handling; (c) Run and test the model on the Arduino UNO Q, prompting the agent to debug errors and add features (e.g., counting ducks, triggering an output on detection, etc.).

Topics

  • AI Coding Assistants
  • Agentic AI
  • Arduino
  • Edge AI
  • Embedded Systems
  • Internet of Things (IoT)