The idea for CMS arose as a project for a course on tangible interfaces, taught by Amnon Dekel at the Hebrew University. Elliot Jaffe was my project partner and the original idea was his. So I wish, first and foremost, to thank both Elliot and Amnon, for initiating it all, and for providing gentle guidance and emphatic encouragement throughout.
I would also like to thank Prof. Scott Kirkpatrick, who supervised this project, for reviewing and re-reviewing this paper patiently, and for sharing his creative spark, his enthusiasm, his extensive insights and his experience, and for guiding my often digressive research inclinations.
Many people have helped push me through this paper. In this context thanks are owed to: My parents and sister, for reviewing and commenting on grammar mismatches; Marc Friedman, for spending his vacation keeping my procrastination instincts in check; Elazar Goldenberg, for reviewing the Hebrew abstract, and Lil Blume, for patiently and persistently correcting my abstract and bibliography, and for teaching me how to punctuate and use proper grammar – on this paper, and in the most basic way possible. This may or may not be the forum to thank my parents for raising me, for ensuring that I get a proper education and that I stay somewhat on track, but then again, it may very well be. So: Thank you.
It can be humbling to realize that the world beyond tangible interfaces is huge and holds many wonderful things, and that so many people have never heard of what a tangible interface is, or sort of blank out when they do hear about it. But as I approach the completion of this project, I look forward to more fully experiencing this world, with its glorious oblivion to TUI concepts, and embracing it with joy and a sense of a certain accomplishment at having – hopefully, somewhat – contributed a small share towards elucidating those who may nevertheless care.
And in the context of this completion, this anticipation, this gratitude, and humility, I would like most of all, to thank the Lord, God, Master of the universe, who has given us all life and sustained us, and who has brought us forth to this wonderful day.
Sources
1[] E. Jaffe, A. Dayan, A. Dekel, "Physical system monitoring," Patent WO/2008/006000, filed July 3, 2007 and published Jan 10, 2008.
Available online at:
http://www.wipo.int/pctdb/en/wo.jsp?WO=2008006000 [Accessed Nov.8, 2009]
2[] E. Jaffe, A. Dayan, A. Dekel, "Cube management system: a tangible interface for monitoring large scale systems," in Proceedings of the 2007 Symposium on Computer Human Interaction for the Management of Information Technology, March 30-31, 2007, Cambridge, Massachusetts.
Available online at:
http://sites.google.com/a/dsys.cs.huji.ac.il/main/home/publications/a4-jaffe.pdf [Accessed Dec.27, 2009]
3[] "Ganglia monitoring system." [Online], http://ganglia.info/ [Accessed: Nov.8, 2009]
4[ [R. Harlan, "Network management with Nagios," Linux Journal, Issue 111, 2003.
Available online at:
http://www.linuxjournal.com/article/6767 [Accessed Nov. 8, 2009]
5[] "EverGrow. A European integrated project." [Online], http://www.evergrow.org
[Accessed Nov.8, 2009]
6
[] "Ganglia: Evergrow Grid Report."[Online], http://www.everlab.org/ganglia
[Accessed Nov.8, 2009]
7[] R. Berg, "Logochip: Logo language reference (3/03)." [Online],
http://web.media.mit.edu/~orenz/openboard/logochip_lang_ref.pdf
[Accessed Nov 8, 2009]
8[]O. Zuckerman, "The OpenBoard toolkit." [Online], http://www.media.mit.edu/~orenz/openboard [Accessed Nov 8, 2009]
9[] P. Anderson, "Assembled serial LCD #115 with big numbers with 20X4 LCD (variable LED backlight)." [Online],
http://www.phanderson.com/lcd106/lcd115.html
[Accessed Nov 9, 2009]
10[] B. Shneiderman, "Direct manipulation: a step beyond programming languages", Computer, Vol.16 No.8, pp.57-69, August 1983
11[] B. Shneiderman, R. Mayer, "Syntactic/Semantic Interactions in Programmer Behavior: A Model and Experimental Results," International Journal of Computer and Information Sciences, Vol. 8, No. 3, pp. 219-239, 1979.
12[ [G. Polya, How to Solve It, Doubleday, New York, 1957.
13[ [M. Montessori, The Montessori Method, Schocken, New York, 1964.
14] [J. Bruner, Toward a Theory of Instruction, Harvard University Press, Cambridge, Mass., 1966.
15] [J. M. Carroll, J. C. Thomas, A. Malhotra, "Presentation and Representation in Design Problem-Solving," British Journal of Psychology, Vol. 71, pp. 143-153, 1980.
16[] "Cognitive Engineering Laboratory: Ecological interface Design" [Online], http://cel.mie.utoronto.ca/research/frameworks/eid.htm [Accessed Dec 1 2009]
17[ [K. Vicente and J. Rasmussen, "Ecological Interface Design: Theoretical Foundations", IEEE Transactions on Systems, Man and Cybernetics, Vol.22, No.4, 1992. Available online at:
http://www.cs.chalmers.se/idc/ituniv/kurser/09/hcd/literatures/vicenta%201992.pdf
[Accessed Nov. 23, 2009]
18[ ["Ecological interface design"", from Wikipedia, the Free Encyclopedia[Online], http://en.wikipedia.org/wiki/Ecological_interface_design
[Accessed Nov.23, 2009]
19[] W. R. Ashby, An Introduction to Cybernetics. London: Methuen. 1956.
20[] A. Jensen, J. Rasmussen, and P. Timmerman, “Analysis of failure data for electronic equipment at Risø,” Risø Report no. 38, Danish Atomic Energy Commission, Research Establishment Risø, Roskilde, Denmark, 1963.
21] [B. A. Francis and W. M. Wonham, “The internal model principle of control theory.” Automatica, vol. 12. pp. 457-465, 1975
22[ [H. G. Stassen “On the modeling of manual control tasks,” in Applications of Human Performance Models to System Design, G. R. McMillan, D. Beevis, E. Salas, M. H. Strub, R. Sutton, and L. V. Breda, (Eds.) pp. 107-122, New York, Plenum, 1989.
23[] J. Rasmussen, Information Processing and Human-Machine Interaction: An Approach to Cognitive Engineering. New York: North Holland, 1986.
24[ [J. Rasmussen, ”On the structure of knowledge-A morphology of mental models in a man-machine system context,“ Risø-M-2192. Risø National Lab., Electronics Dept., Roskilde, Denmark, 1979.
25[ [J. Rasmussen. “Mental models and the control of action in complex environments,” in D. Ackermann and M. J. Tnuber. (Eds.), Mental Models and Human-Computer Interaction. Vol. I, Amsterdam, North-Holland, pp. 41-69, 1990.
26[ [J. Rasmussen, Information Processing and Human-Machine Interaction: An Approach to Cognitive Engineering. New York, North Holland, 1986. (Cited above)
27[ [J. Rasmussen, “The role of hierarchical knowledge representation in decision making and system management,“ IEEE Transactions on Systems, Man, and Cybernetics, Vol. 15, pp. 234-243, 1985.
28[ [J. Rasmussen, “Skills, rules, knowledge: signals, signs, and symbols and other distinctions in human performance models,” Transactions on Systems, Man, and Cybernetics, Vol. 13, pp. 257-267, 1983.
29[ [E. Brunswik, Perception and the Representative Design of Experiments, 2nd edition, pp. 89-93, Berkeley, CA, University of California Press, 1956.
30[ [K. R. Hammond, R. M. Hamm, J. Grassia, and T. Pearson, “Direct comparison of intuitive and analytical cognition in expert judgement,” IEEE Transactions on Systems, Man, and Cybernetics, Vol. SMC-17, pp. 753-770, 1987.
31[ [J. Rasmussen, “The human data processor as a system component: Bits and pieces of a model,” Risø-M-1722, Roskilde, Denmark, Danish Atomic Energy Commission, 1974.
32[] J. Reason, Human Error. Cambridge, UK, Cambridge University Press, 1990.
33[ [J. Reason, “Modeling the basic error tendencies of human operator,” Reliability Engineering & System Safety, Vol. 22, pp. 137-153, 1988.
34[] W. B. Rouse, “Models of human problem solving: Detection, diagnosis, and compensation for system failures,” Automatic, Vol. 19, pp. 613-625, 1983.
35[] G. A. Klein, “Recognition-primed decisions,” in W. B. Rouse (Ed.), Advances in Man-Machine Systems Research, Vol. 5, pp. 47-92. Greenwich, CT, JAI Press, 1989.
36[] A. C. Kirlik, The Organization of Perception and Action in Complex Control Skills, Ph.D. Dissertation, Ohio State University, Columbus, OH, 1989.
37[ [J. Rasmussen, “The human data processor as a system component: Bits and pieces of a model,” Risø-M-1722, Roskilde, Denmark, Danish Atomic Energy Commission, 1974. (Cited above)
38[] W. B. Rouse, “Models of human problem solving: Detection, diagnosis, and compensation for system failures,” Automatic, Vol. 19, pp. 613-625, 1983. (Cited above)
39[] E. Hollnagel, “Report from the third NKA/KRU-experiment: The performance of control engineers in the surveillance of a complex process,” NKA/KRU-P2(81)36, Electron Dept., Risø Nat. Lab., Roskilde, Denmark, 1981.
40[] J. Rasmussen, ”Cognitive control and human error mechanisms,” in J. Rasmussen, K. Duncan, and J. Leplat.(Eds.), New Technology and Human Error, pp. 53-61, New York, Wiley, 1987.
41[] M. A. Buttigieg, P. M. Sanderson, “Emergent features in visual display design for two types of failure detection tasks,” Human Factors, Vol. 33, pp. 631-651, 1991.
42] [P. M. Sanderson, J. M. Flach, M. A. Buttigieg, E. J. Casey, “Object displays do not always support better integrated task performance,” Human Factors, Vol. 31, pp. 183-198, 1989.
43[ [C. A. Kaplan, H. A. Simon, “In search of insight,” Cognitive Psychology, Vol. 22, pp. 374-419, 1990.
44[] J. Bailey, E. Haber: "Design guidelines for system administration tools developed through ethnographic field studies", Proceedings of the 2007 Symposium on Computer Human Interaction for the Management of Information Technology, March 30-31, 2007, Cambridge, Massachusetts. Available online at:
http://www.plunk.org/eben/PublishedPapers/DesignGuidelines.pdf
[Accessed Nov 11, 2009]
45[] H. Ishii and B. Ullmer, "Tangible bits: towards seamless interfaces between people, bits and atoms." Proceedings of Conference on Human Factors in Computing Systems (CHI '97), ACM Press, 234-241, 1997.
Available online at:
http://web.media.mit.edu/~anjchang/ti01/ishii-chi97-tangbits.pdf
[Accessed Nov 9, 2009]
46[] G. W. Fitzmaurice, H. Ishii, and W. Buxton, (1995). "Bricks: laying the foundations for graspable user interfaces." Proceedings of CHI'95 Conference on Human Factors in Computing Systems, 442-449, New York: ACM.
Available online at: http://tangible.media.mit.edu/content/papers/pdf/bricks-chi95.pdf [Accessed Nov 11, 2009].
47
[] G. Fitzmaurice, Graspable User Interfaces, Ph.D. Dissertation, Supervised by W. Buxton. University of Toronto, Toronto, Ontario, Canada, 1996.
Available online at:
http://www.dgp.toronto.edu/~gf/papers/PhD%20-%20Graspable%20UIs/Thesis.gf.html
[Accessed Nov 9, 2009].
48[ [P. Wellner, W.E. Mackay, and R. Gold, Eds., Special Issue on Computer-Augmented Environments, Communications of the ACM, New York, July 1993.
49[] "Microsoft Windows," from Wikipedia, the Free Encyclopedia [Online]
http://en.wikipedia.org/wiki/Microsoft_Windows#Windows_3.0_and_3.1
[Accessed Nov 9, 2009].
50[] K. Hinckley, R. Pausch, J. C. Goble, and N. F. Kassell, "Passive real-world interface props for neurosurgical visualization," Proceedings of CHI '94 Conference on Human Factors in Computing Systems, 452-458, Boston, Mass., U.S.A., 1994.
51[] E. Sachs, A. Roberts, and D. Stoops, "3-Draw: A tool for designing 3D shapes," IEEE Computer Graphics and Applications, Vol. 11, No. 6, November 1991.
52[] "Palm (PDA)", from Wikipedia, the Free Encyclopedia [online] http://en.wikipedia.org/wiki/Palm_%28PDA%29 [Accessed Nov 9, 2009].
53[] "Tamagotchi", from Wikipedia, the Free Encyclopedia [online] http://en.wikipedia.org/wiki/Tamagotchi [Accessed Nov.9, 2009].
54[] "Details of 'MI/SMG-00GPRS_Q' work item," Work Programme – Work Item Detailed Report, ETSI [online] http://webapp.etsi.org/WorkProgram/Report_WorkItem.asp?WKI_ID=4532&curItemNr=30&totalNrItems=48&optDisplay=10&titleType=all&qSORT=HIGHVERSION&qETSI_ALL=&SearchPage=TRUE&qINCLUDE_SUB_TB=True&qINCLUDE_MOVED_ON=&qSTOP_FLG=Y&qKEYWORD_BOOLEAN=OR&qTITLE=GPRS&qSTOPPING_OUTDATED=&butExpertSearch=Search&includeNonActiveTB=FALSE&includeSubProjectCode=FALSE&qREPORT_TYPE=SUMMARY
[Accessed Nov.9, 2009].
Note: this source may look like gibberish, but it is actually a link to a record of the history of GPRS development, from the website of the ETSI organization.
55[] E. Hornecker, "Tangible interaction" [online]
http://www.interaction-design.org/encyclopedia/tangible_interaction.html
[Accessed Nov 9, 2009].
56[] B. Ullmer and H. Ishii, "Emerging frameworks for tangible user interfaces," in IBM Systems Journal, Vol. 39, No. 3/4, pp. 915-931, 2000.
Available online at:
http://tangible.media.mit.edu/content/papers/pdf/ullmer-isj00-tui-framework-pub.pdf
[Accessed Nov.9, 2009].
57[] L. E. Holmquist, J. Redström and P. Ljungstrand, “Token-Based Access to Digital Information”, Proceedings of the 1st international symposium on Handheld and Ubiquitous Computing, 1999. Available online at: http://redstrom.se/johan/papers/token.pdf [Accessed Dec.27, 2009]
Also available as part of:
L.E. Holmquist, Breaking the Screen Barrier, Ph.D. Dissertation, Supervised by B. Dahlbom. Göteborg University, Sweden, 2000.
Available online at: http://www.sics.se/fal/publications/play/2000/dissertations/leh/index.html
[Accessed Dec.27, 2009].
58
[] D. Kirsh, "Complementary strategies: why we use our hands when we think". In J. D. Moore and J. F. Lehman (Eds.), Proceedings of 7th Annual Conference of the Cognitive Science Society. Hillsdale, NJ: Lawrence Erlbaum. pp. 212-217, 1995. Available online at:
http://adrenaline.ucsd.edu/kirsh/articles/cogsci95/cogsci95.html
[Accessed Nov. 9, 2009]
59
[] D. Kirsh, and P. Maglio, "On distinguishing epistemic from pragmatic action," Cognitive Science, Vol. 18, No. 4, pp. 513-549, 1994.
Available online at:
http://adrenaline.ucsd.edu/kirsh/articles/cogscijournal/DistinguishingEpi_prag.pdf
[Accessed Nov 9, 2009]
60[] D. Kirsh, "The intelligent use of space," Journal of Artificial Intelligence, Vol. 73, No. 1-2, pp. 31-68, 1995.
Available online at:
http://adrenaline.ucsd.edu/kirsh/articles/space/intelligent_useof_space.pdf
61[Accessed Nov.9, 2009]
[] J. J. Gibson, "Observations on active touch," Psychological Review, Vol. 69, pp. 477-491. 1962.
Available online at:
http://wexler.free.fr/library/files/gibson%20%281962%29%20observations%20on%20active%20touch.pdf [Accessed Nov. 9, 2009].
62[] J. J. Gibson, The Perception of the Visual World, Boston, Houghton Mifflin, 1950.
63
[] R.L. Fowler, W.E. Williams, M.G. Fowler, and D. D. Young, "An investigation of the relationship between operator performance and operator panel layout for continuous tasks," Technical. Report 68-170. US. Air Force ARML (AD-692 126), 1968. Cited by M. S. Sanders, and E. J. McCormick, Human Factors in Engineering and Design, pp. 364-365, McGraw-Hill, Sixth edition.
64[] Y. Guiard, "Asymmetric division of labor in human skilled bimanual action: the kinematic chain as a model". Journal of Motor Behavior, Vol.19, No.4, pp. 486-517, 1987.
Available online (in slightly edited form) at:
http://cogprints.org/625/0/jmb_87.html [Accessed Nov 9, 2009]/
65
[] W. Buxton, "Chunking and phrasing and the design of human-computer dialogues," Proceedings of the IFIP World Computer Congress, pp. 475-480, 1986.
Reprinted in R. Baecker, J. Grudin, W. Buxton, and S.Greenberg, (Eds.). Readings in Human-Computer Interaction: Towards the Year 2000, pp. 494-499, San Francisco, Morgan Kaufmann, Inc., 1995.
Available online at:
http://www.billbuxton.com/chunking.html [Accessed Nov.9, 2009]
66[] S. K. Card, T. P. Moran, and A. Newell, The Psychology of Human-Computer Interaction. Hillsdale, NJ: Lawrence Erlbaum. 1983.
67
[] J. Gibson, The Ecological Approach to Visual Perception, Erlbaum Associates, New York, 1979.
68[] D. Norman, Things That Make Us Smart, Addison-Wesley Publishing Co., Reading, MA, 1993.
69[] E. Hutchins, Cognition in the Wild, MIT Press, Cambridge, MA, 1995.
70[] M. Scaife and Y. Rogers, “External cognition: how do graphical representations work?” International Journal of Human-Computer Studies Vol. 45, No. 2, pp.185–213, 1996. Available online at:
http://wwwmath.uni-muenster.de/SoftComputing/lehre/seminar/ws0304/scaife_external_cognition.pdf
[Accessed Nov.19, 2009].
71[] N. Eilan, R. McCarthy, and B. Brewer, Spatial Representation, Blackwell, Oxford, UK, 1993.
72[] D. Kirsh, “The intelligent use of space,” Artificial Intelligence, 1995. (Cited above with URL).
73[] Y. Guiard, “Asymmetric division of labor in human skilled bimanual action: the kinematic chain as a model,” The Journal of Motor Behavior Vol.19, No. 4, pp. 486–517, 1987. (Cited above with URL)
74[] K. Hinckley et al., “Two-handed virtual manipulation,” ACM Transactions on Computer-Human Interaction, pp 260-302, 1998.
Available online at:
http://research.microsoft.com/en-us/um/people/kenh/papers/p260-hinckley.pdf
[Accessed Nov.11, 2009].
75[] M. Krampen, “Objects,” Encyclopedic Dictionary of Semiotics, Vol. 1, T. Sebeok (Ed.), Mouton de Gruyter, New York. pp. 635–639. 1986.
76[] S. Vihma, Ed., Semantic Visions in Design, UIAH, Helsinki (1990).
77[] B. Shneiderman, “Direct manipulation: A Step Beyond Programming Languages,” Computer 16, pp. 57–69 1983. (Cited above with URL).
78[] D. Frohlich, “Direct manipulation and other lessons,” In M. Helander, T. K. Landauer & P. Prabhu (Eds.),Handbook of Human-Computer Interaction, Second ed., pp.463-488. New York, Elsevier.
79[] D. Gentner and J. Nielsen, “The anti-Mac interface,” Communications of the ACM Vol. 39, No. 8, pp. 70–82, August, 1996.
Available online at: http://www.useit.com/papers/anti-mac.html
[Accessed Nov 11, 2009].
80[] R. Baeza-Yates, "Visual programming" [Online] http://www.dcc.uchile.cl/~rbaeza/cursos/vp/todo.html [Accessed Nov. 11, 2009].
81[] J. Larkin, H. Simon: “Why a diagram is (sometimes) worth ten thousand words”, Cognitive Science Vol. 11, pp. 65–99, 1987. Available online at: http://cognitrn.psych.indiana.edu/rgoldsto/cogsci/Larkin.pdf
[Accessed Nov.11, 2009].
82[] M. Petre, “Why looking isn’t always seeing: readership skills and graphical programming,” Communications of the ACM 38, 33–44 (June 1995).
83[] Dourish, P., Where the Action Is: The Foundations of Embodied Interaction, , MIT Press, 2001, pp. 40-41.
84[]Ishii, H., Ullmer, B., “Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms”, Proceedings of the SIGCHI conference on Human factors in computing systems, 1997
Available online at:
http://www.sigchi.org/chi97/proceedings/paper/hi.htm [Accessed Dec.26, 2009]
85[] L. E. Holmquist, J. Redström and P. Ljungstrand, “Token-Based Access to Digital Information”, Proceedings of the 1st international symposium on Handheld and Ubiquitous Computing, 1999. Available online at: http://redstrom.se/johan/papers/token.pdf [Accessed Dec.27, 2009]
Also available as part of:
L.E. Holmquist, Breaking the Screen Barrier, Ph.D. Dissertation, Supervised by B. Dahlbom. Göteborg University, Sweden, 2000.
Available online at: http://www.sics.se/fal/publications/play/2000/dissertations/leh/index.html
[Accessed Dec.27, 2009].
86
[] M.G. Gorbet, M. Orth, H. Ishii, “Triangles: Tangible Interface for Manipulation and Exploration of Digital Information Topography,” Proceedings of the SIGCHI conference on Human factors in computing systems, pp.49-56, ACM.
Available online at: http://eprints.kfupm.edu.sa/73382/1/73382.pdf
[Accessed Dec.20, 2009]
87[]B. Ullmer, H. Ishii, D. Glas, “mediaBlocks: Physical Containers, Transports, and Controls for Online Media,” Proceedings of the 25th annual conference on Computer graphics and interactive techniques, pp. 379-386, ACM, 1998. Available online at:
http://tangible.media.mit.edu/content/papers/pdf/mediaBlocks_SG98.pdf
[Accessed Dec.20, 2009]
88[] Thank you to Prof. Alva Couch of Tufts University suggesting this implementation
89[] http://www.dgp.toronto.edu/~gf/videos/legowall.mpg
90[] G. W. Fitzmaurice, H. Ishii, and W. Buxton, (1995). "Bricks: laying the foundations for graspable user interfaces." Proceedings of CHI'95 Conference on Human Factors in Computing Systems, 442-449, New York: ACM.
Available online at: http://tangible.media.mit.edu/content/papers/pdf/bricks-chi95.pdf [Accessed Nov 11, 2009].
91
[]G. Fitzmaurice,: "Graspable user interfaces", PhD Dissertation, Supervised by W. Buxton. (Cited Above with link)
92[] Fitzmaurice's thesis also mentions a programmable brick introduced by Resnick in 1993, which is a powerful, portable, computational device which can plug into the Lego wall prototype or other Lego-compatible sensors and motors for detecting and modifying the surrounding environment..
See: M. Resnick, "Behavior construction kits". Communications of the ACM, Vol. 36, No.7, pp.64-71, 1993.
93
[] http://www.tei-conf.org/07/program/EliseVanDenHoven_DesignResearchAndTangibleInteraction.pdf
94[] E. Tufte, Envisioning Information. Graphics Press, Cheshire, Conn., 1990.
Share with your friends: |