1. A Primer on Human Vision: Insights and Inspiration for Computer Vision Guest  Lecture:  Marius  Cătălin  Iordan     CS  131  -­‐  Computer  Vision:  Foundations  and  Applications   27  October  2014 

2.

3. detection recognition segmentation … ! visual! understanding 

4. 1. The Mammalian Visual System • anatomy and processing pathways • from processing to perception Roadmap 23 

5. 1. The Mammalian Visual System • anatomy and processing pathways • from processing to perception 2. Early Computation • first stages of information processing • edges: a basis for representing the visual world Roadmap 23 

6. 1. The Mammalian Visual System • anatomy and processing pathways • from processing to perception 2. Early Computation • first stages of information processing • edges: a basis for representing the visual world 3. Object Recognition in the Human Visual System • building invariance: pooling and transformation • untangling object representations Roadmap 23 

7.Mammalian Visual System anatomy and processing pathways 3 4 

8. The “Camera”: Retinal Projection Mammalian Visual System anatomy and processing pathways 3 4 

9. The “Camera”: Retinal Projection Mammalian Visual System anatomy and processing pathways 3 4 

10. Neuron Mammalian Visual System anatomy and processing pathways 3 5 

11. Neuron spikes / s Mammalian Visual System anatomy and processing pathways 3 5 

12. figure courtesy of A. Alahi Mammalian Visual System anatomy and processing pathways 3 6 

13. From Retina to Cortex world retina (compression) LGN visual cortex (expansion) V1 Mammalian Visual System anatomy and processing pathways 7 

14. From Retina to Cortex size of! representation world retina (compression) LGN visual cortex (expansion) V1 Mammalian Visual System anatomy and processing pathways 7 

15. Cortex: At Least Two Dozen Visual Areas IT IT Weiner & Grill-Spector (2012) Mammalian Visual System anatomy and processing pathways 8 

16. Cortex: At Least Two Dozen Visual Areas plus more: motion areas, “functional” regions, etc. IT IT Weiner & Grill-Spector (2012) Mammalian Visual System anatomy and processing pathways 8 

17. Visual Processing vs. Perception IT IT Weiner & Grill-Spector (2012) Mammalian Visual System from processing to perception 9 

18. Visual Processing vs. Perception IT IT Weiner & Grill-Spector (2012) Mammalian Visual System from processing to perception 9 

19. Visual Processing vs. Perception perception involves integration and higher functions IT IT Weiner & Grill-Spector (2012) Mammalian Visual System from processing to perception 9 

20. Mammalian Visual System DiCarlo & Cox (2007) Mammalian Visual System key points 10 

21. Mammalian Visual System visual processing is done in stages DiCarlo & Cox (2007) Mammalian Visual System key points 10 

22. Mammalian Visual System visual processing is done in stages but it is not synonymous with perception DiCarlo & Cox (2007) Mammalian Visual System key points 10 

23. 2. Early Computation local information processing Early Computation 11 3 

24. Retinal Projection picture is inverted, but spatial relationships are preserved Early Computation first stages of processing 12 3 

25. Receptive Fields extract similar features at each position in the visual field receptive fields figure adapted from Ebner & Hameroff (2011) Early Computation first stages of processing 13 3 

26. Receptive Fields extract similar features at each position in the visual field ganglion cells center-surround receptive fields figure adapted from Ebner & Hameroff (2011) Early Computation first stages of processing 14 3 

27. Receptive Fields extract similar features at each position in the visual field ON ganglion cells Early Computation first stages of processing 15 3 

28. Receptive Fields extract similar features at each position in the visual field ON ganglion cells Early Computation first stages of processing 15 3 

29. figure courtesy of A. Alahi Early Computation first stages of processing 16 3