计算机视觉的洞察力和灵感
展开查看详情
1. A Primer on Human Vision: Insights and Inspiration for Computer Vision Guest Lecture: Marius Cătălin Iordan CS 131 -‐ Computer Vision: Foundations and Applications 27 October 2014
2.
3. detection recognition segmentation … ! visual! understanding
4. 1. The Mammalian Visual System • anatomy and processing pathways • from processing to perception Roadmap 23
5. 1. The Mammalian Visual System • anatomy and processing pathways • from processing to perception 2. Early Computation • first stages of information processing • edges: a basis for representing the visual world Roadmap 23
6. 1. The Mammalian Visual System • anatomy and processing pathways • from processing to perception 2. Early Computation • first stages of information processing • edges: a basis for representing the visual world 3. Object Recognition in the Human Visual System • building invariance: pooling and transformation • untangling object representations Roadmap 23
7.Mammalian Visual System anatomy and processing pathways 3 4
8. The “Camera”: Retinal Projection Mammalian Visual System anatomy and processing pathways 3 4
9. The “Camera”: Retinal Projection Mammalian Visual System anatomy and processing pathways 3 4
10. Neuron Mammalian Visual System anatomy and processing pathways 3 5
11. Neuron spikes / s Mammalian Visual System anatomy and processing pathways 3 5
12. figure courtesy of A. Alahi Mammalian Visual System anatomy and processing pathways 3 6
13. From Retina to Cortex world retina (compression) LGN visual cortex (expansion) V1 Mammalian Visual System anatomy and processing pathways 7
14. From Retina to Cortex size of! representation world retina (compression) LGN visual cortex (expansion) V1 Mammalian Visual System anatomy and processing pathways 7
15. Cortex: At Least Two Dozen Visual Areas IT IT Weiner & Grill-Spector (2012) Mammalian Visual System anatomy and processing pathways 8
16. Cortex: At Least Two Dozen Visual Areas plus more: motion areas, “functional” regions, etc. IT IT Weiner & Grill-Spector (2012) Mammalian Visual System anatomy and processing pathways 8
17. Visual Processing vs. Perception IT IT Weiner & Grill-Spector (2012) Mammalian Visual System from processing to perception 9
18. Visual Processing vs. Perception IT IT Weiner & Grill-Spector (2012) Mammalian Visual System from processing to perception 9
19. Visual Processing vs. Perception perception involves integration and higher functions IT IT Weiner & Grill-Spector (2012) Mammalian Visual System from processing to perception 9
20. Mammalian Visual System DiCarlo & Cox (2007) Mammalian Visual System key points 10
21. Mammalian Visual System visual processing is done in stages DiCarlo & Cox (2007) Mammalian Visual System key points 10
22. Mammalian Visual System visual processing is done in stages but it is not synonymous with perception DiCarlo & Cox (2007) Mammalian Visual System key points 10
23. 2. Early Computation local information processing Early Computation 11 3
24. Retinal Projection picture is inverted, but spatial relationships are preserved Early Computation first stages of processing 12 3
25. Receptive Fields extract similar features at each position in the visual field receptive fields figure adapted from Ebner & Hameroff (2011) Early Computation first stages of processing 13 3
26. Receptive Fields extract similar features at each position in the visual field ganglion cells center-surround receptive fields figure adapted from Ebner & Hameroff (2011) Early Computation first stages of processing 14 3
27. Receptive Fields extract similar features at each position in the visual field ON ganglion cells Early Computation first stages of processing 15 3
28. Receptive Fields extract similar features at each position in the visual field ON ganglion cells Early Computation first stages of processing 15 3
29. figure courtesy of A. Alahi Early Computation first stages of processing 16 3