A System for Continuous Learning of Visual Concepts

Danijel Skočaj, Gregor Berginc, Barry Ridge, Aleš Štimec, Matjaž Jogan, Ondřej Vaněk, Aleš Leonardis, Manuela Hutter, Nick Hawes · 2019

We present an artificial cognitive system for learning visual concepts. It comprises of vision, communication and manipulation subsystems, which provide visual input, enable verbal and non-verbal communication with a tutor and allow interaction with a given scene. The main goal is to learn associations between automatically extracted visual features and words that describe the scene in an open-ended, continuous manner. In particular, we address the problem of cross-modal learning of visual properties and spatial relations. We introduce and analyse several learning modes requiring different levels of tutor supervision.

Read the paper · More papers on PaperTik