16InteractionTechnique--3D

The course is mainly about Interactions in 3D, Very Large Displays, and Virtual Reality.Generally covered the reason why 3D is harder; 3D control;types of 3D sensors;history of 3D sensors;3D arm controllers;special-purpose input devices for manipulation and so on.
展开查看详情

1.1 © 2014 - Brad Myers Brad Myers 05-899A/05-499A: Interaction Techniques Spring, 2014 Lecture 16: Past to Future: Interactions in 3D, Very Large Displays, and Virtual Reality

2.St. Patrick’s Day Today! © 2014 - Brad Myers 2

3.Mardi Gras Was March 4 © 2014 - Brad Myers 3

4.Homework 3 Everyone did well. Observations: Sometimes iPad Minis performed well, otherwise flick gesture was terrible. 2-finger OSX scroll was in the middle. Generally notched mouse wheel was the best. Keyboard, as expected, was very accurate but slow. PgDown was remarkably good. Homework 4 due today © 2014 - Brad Myers 4

5.MidTerm Test Grades Average: 82.25 © 2014 - Brad Myers 5

6.Midterm Test – answers Q1 & Q2: see lecture 1 , slides 18-20; 21 Q11 – could use same one from lecture 11 , slide 3 Or could omit the “hover” state Q13 – GOMS and Keystroke model were covered in both lecture 11, slides 29-30 and lecture 13, slides 4-15 © 2014 - Brad Myers 6

7.Final Projects Start today! See description on line Need to figure out groups and project ideas by this Wednesday ! Enter information into Piazza under “project” © 2014 - Brad Myers 7

8.Office Hours Brad Myers: Tuesday 3-4, NSH 3517 Project ideas Midterm grading Jeff Rzeszotarski, Friday, 1PM to 3PM, NSH 4605 **special time** Project ideas Homework 3 grading But project ideas are due by Wednesday at 1:30 © 2014 - Brad Myers 8

9.9 © 2014 - Brad Myers Lecture 16: Past to Future: Interactions in 3D, Very Large Displays, and Virtual Reality

10.Why is 3D Harder? Objects have six degrees of freedom ( DoF ) X, Y, Z Roll, pitch, yaw Also camera position Occlusion and resolution issues Difficulty of orienting oneself People are not very good at 3D manipulation or reasoning Mouse is basically 2D Generally, dealing with complex, hierarchical objects © 2014 - Brad Myers 10

11.Why is 3D Harder? Objects have six degrees of freedom ( DoF ) X, Y, Z Roll, pitch, yaw Also camera position Occlusion and resolution issues Difficulty of orienting oneself People are not very good at 3D manipulation or reasoning Mouse is basically 2D Generally, dealing with complex, hierarchical objects © 2014 - Brad Myers 10

12.Where 3D displayed? Desktops – just on a screen in the usual way 3D “Cave” or other large displays ( ACM ref ) Display on 1 or up to all walls and ceiling Virtual Reality (VR) or Augmented Reality (AR) headsets AR – can see through the display, so pictures are superimposed on the view © 2014 - Brad Myers 12

13.3D Control Regular Mouse or touch – 2D Possibly with extra knobs or buttons “Mouse in the air” tracked in 3D = “ bat ”; 6 DoF “bat” translates to fledermaus in German (mouse that flies through the air) Fixed camera tracking object in 3D space Moving the end of an articulated motorized arm 3D physical objects incorporating the above © 2014 - Brad Myers 13

14.Types of 3D sensors © 2014 - Brad Myers 14 Earliest: Boxes with sets of knobs for each dimension Polhemus trackers (“ bat ”) Starting in 1969 Magnetic cube on part to be tracked and nearby receiver 6 DOF Limited sensing area Company still selling similar products Often attached to gloves, head-trackers, etc. DataGlove Starting about 1982 Measured finger bending = pose of hand Incorporated Polhemus tracker on the wrist Nintendo “ PowerGlove ” – 1989 Unsuccessful – only 2 games

15.Types of 3D sensors © 2014 - Brad Myers 14 Earliest: Boxes with sets of knobs for each dimension Polhemus trackers (“ bat ”) Starting in 1969 Magnetic cube on part to be tracked and nearby receiver 6 DOF Limited sensing area Company still selling similar products Often attached to gloves, head-trackers, etc. DataGlove Starting about 1982 Measured finger bending = pose of hand Incorporated Polhemus tracker on the wrist Nintendo “ PowerGlove ” – 1989 Unsuccessful – only 2 games

16.Minority Report , 2002 Using data gloves to interact with large 2-D displays in the air (or on a surface) MIT Media Lab advised on science ( John Underkoffler ) © 2014 - Brad Myers 16

17.History of 3D sensors, cont. Lots of motion capture research and systems Motion capture rooms with cameras Used for movies, etc. (But no interaction techniques) Kinect Introduced 2010 Two cameras Next lecture (w/ game controllers) Leap Motion 2013 Camera based – designed to look upwards © 2014 - Brad Myers 17

18.3D “arm” Controllers Motors to measure 3D movements and provide force feedback Phantom OMNI from Sensable Technologies Medical Applications, etc. 3D editing and drawing Falcon from Novint Marketed for gaming © 2014 - Brad Myers 18

19.3D “arm” Controllers Motors to measure 3D movements and provide force feedback Phantom OMNI from Sensable Technologies Medical Applications, etc. 3D editing and drawing Falcon from Novint Marketed for gaming © 2014 - Brad Myers 18

20.Mouse-Based 3D manipulation Common 4-panel display Mouse works in conventional way in each panel Still tricky to manipulate © 2014 - Brad Myers 20 AutoDesk Maya

21.Mouse-Based 3D manipulation Common 4-panel display Mouse works in conventional way in each panel Still tricky to manipulate © 2014 - Brad Myers 20 AutoDesk Maya

22.Mouse-Based 3D manipulation Common 4-panel display Mouse works in conventional way in each panel Still tricky to manipulate © 2014 - Brad Myers 20 AutoDesk Maya

23.Mouse-Based 3D manipulation Common 4-panel display Mouse works in conventional way in each panel Still tricky to manipulate © 2014 - Brad Myers 20 AutoDesk Maya

24.Mouse-Based 3D manipulation Common 4-panel display Mouse works in conventional way in each panel Still tricky to manipulate © 2014 - Brad Myers 20 AutoDesk Maya

25.Mouse-Based 3D manipulation Common 4-panel display Mouse works in conventional way in each panel Still tricky to manipulate © 2014 - Brad Myers 20 AutoDesk Maya

26.Mouse-Based 3D manipulation Common 4-panel display Mouse works in conventional way in each panel Still tricky to manipulate © 2014 - Brad Myers 20 AutoDesk Maya

27.Mouse-Based 3D manipulation Common 4-panel display Mouse works in conventional way in each panel Still tricky to manipulate © 2014 - Brad Myers 20 AutoDesk Maya

28.Mouse-Based 3D manipulation Common 4-panel display Mouse works in conventional way in each panel Still tricky to manipulate © 2014 - Brad Myers 20 AutoDesk Maya