计算机视觉的洞察力和灵感

1 . A Primer on Human Vision: Insights and Inspiration for Computer Vision Guest  Lecture:  Marius  Cătălin  Iordan     CS  131  -­‐  Computer  Vision:  Foundations  and  Applications   27  October  2014 

2 .

3 . detection recognition segmentation … ! visual! understanding 

4 . 1. The Mammalian Visual System • anatomy and processing pathways • from processing to perception Roadmap 23 

5 . 1. The Mammalian Visual System • anatomy and processing pathways • from processing to perception 2. Early Computation • first stages of information processing • edges: a basis for representing the visual world Roadmap 23 

6 . 1. The Mammalian Visual System • anatomy and processing pathways • from processing to perception 2. Early Computation • first stages of information processing • edges: a basis for representing the visual world 3. Object Recognition in the Human Visual System • building invariance: pooling and transformation • untangling object representations Roadmap 23 

7 .Mammalian Visual System anatomy and processing pathways 3 4 

8 . The “Camera”: Retinal Projection Mammalian Visual System anatomy and processing pathways 3 4 

9 . The “Camera”: Retinal Projection Mammalian Visual System anatomy and processing pathways 3 4 

10 . Neuron Mammalian Visual System anatomy and processing pathways 3 5 

11 . Neuron spikes / s Mammalian Visual System anatomy and processing pathways 3 5 

12 . figure courtesy of A. Alahi Mammalian Visual System anatomy and processing pathways 3 6 

13 . From Retina to Cortex world retina (compression) LGN visual cortex (expansion) V1 Mammalian Visual System anatomy and processing pathways 7 

14 . From Retina to Cortex size of! representation world retina (compression) LGN visual cortex (expansion) V1 Mammalian Visual System anatomy and processing pathways 7 

15 . Cortex: At Least Two Dozen Visual Areas IT IT Weiner & Grill-Spector (2012) Mammalian Visual System anatomy and processing pathways 8 

16 . Cortex: At Least Two Dozen Visual Areas plus more: motion areas, “functional” regions, etc. IT IT Weiner & Grill-Spector (2012) Mammalian Visual System anatomy and processing pathways 8 

17 . Visual Processing vs. Perception IT IT Weiner & Grill-Spector (2012) Mammalian Visual System from processing to perception 9 

18 . Visual Processing vs. Perception IT IT Weiner & Grill-Spector (2012) Mammalian Visual System from processing to perception 9 

19 . Visual Processing vs. Perception perception involves integration and higher functions IT IT Weiner & Grill-Spector (2012) Mammalian Visual System from processing to perception 9 

20 . Mammalian Visual System DiCarlo & Cox (2007) Mammalian Visual System key points 10 

21 . Mammalian Visual System visual processing is done in stages DiCarlo & Cox (2007) Mammalian Visual System key points 10 

22 . Mammalian Visual System visual processing is done in stages but it is not synonymous with perception DiCarlo & Cox (2007) Mammalian Visual System key points 10 

23 . 2. Early Computation local information processing Early Computation 11 3 

24 . Retinal Projection picture is inverted, but spatial relationships are preserved Early Computation first stages of processing 12 3 

25 . Receptive Fields extract similar features at each position in the visual field receptive fields figure adapted from Ebner & Hameroff (2011) Early Computation first stages of processing 13 3 

26 . Receptive Fields extract similar features at each position in the visual field ganglion cells center-surround receptive fields figure adapted from Ebner & Hameroff (2011) Early Computation first stages of processing 14 3 

27 . Receptive Fields extract similar features at each position in the visual field ON ganglion cells Early Computation first stages of processing 15 3 

28 . Receptive Fields extract similar features at each position in the visual field ON ganglion cells Early Computation first stages of processing 15 3 

29 . figure courtesy of A. Alahi Early Computation first stages of processing 16 3