Table Z2. Individual subjects’ rankings of the five designs in the order from 1 (“most-liked design”) to 5 (“least-liked design”). Underlying reasons for the rankings (indicated by the subjects) are also shown: (A) = Aesthetics; (B) = Perceived effort required; and (C) Fun/stimulating level.
Subjects
|
High formality
|
Medium-high formality
|
Medium-low formality
|
Low formality (on Tablet PC)
|
Low formality (on paper)
|
Factors:
|
(A)
|
(B)
|
(C)
|
1
|
1
|
2
|
3
|
5
|
4
|
1
|
1
|
|
2
|
1
|
3
|
2
|
5
|
4
|
1
|
|
|
3
|
1
|
2
|
3
|
5
|
4
|
1
|
|
|
4
|
2
|
3
|
4
|
5
|
1
|
1
|
1
|
|
5
|
1
|
2
|
3
|
4
|
5
|
1
|
|
|
6
|
5
|
4
|
3
|
1
|
2
|
|
|
1
|
7
|
1
|
3
|
2
|
5
|
4
|
1
|
|
|
8
|
1
|
3
|
4
|
5
|
2
|
1
|
1
|
|
9
|
1
|
2
|
4
|
5
|
3
|
1
|
|
|
10
|
1
|
2
|
4
|
5
|
3
|
1
|
|
|
11
|
1
|
4
|
3
|
5
|
2
|
1
|
1
|
|
12
|
3
|
2
|
1
|
5
|
4
|
|
|
1
|
13
|
4
|
1
|
2
|
3
|
5
|
|
|
1
|
14
|
2
|
3
|
1
|
4
|
5
|
1
|
1
|
1
|
15
|
2
|
1
|
5
|
3
|
4
|
|
1
|
|
16
|
3
|
2
|
5
|
1
|
4
|
|
1
|
|
17
|
3
|
4
|
2
|
1
|
5
|
1
|
|
1
|
18
|
1
|
2
|
3
|
5
|
4
|
1
|
|
|
19
|
2
|
3
|
1
|
4
|
5
|
|
|
1
|
20
|
2
|
4
|
3
|
5
|
1
|
1
|
|
|
21
|
2
|
3
|
4
|
5
|
1
|
1
|
|
|
22
|
1
|
2
|
3
|
5
|
4
|
1
|
|
1
|
23
|
1
|
2
|
3
|
5
|
4
|
1
|
|
|
24
|
2
|
3
|
4
|
5
|
1
|
1
|
|
|
25
|
1
|
2
|
5
|
3
|
4
|
1
|
1
|
|
26
|
1
|
2
|
3
|
5
|
4
|
1
|
|
|
27
|
1
|
4
|
5
|
2
|
3
|
|
1
|
|
28
|
1
|
2
|
3
|
5
|
4
|
1
|
|
|
29
|
2
|
3
|
4
|
5
|
1
|
|
1
|
|
30
|
1
|
1
|
3
|
5
|
4
|
|
1
|
|
Mean
|
1.7
|
2.53
|
3.17
|
4.2
|
3.37
|
N = 21
|
N = 11
|
N = 7
|
Appendix Q. Number of changes made in the five designs across levels of formality by subjects whose “Overall Enjoyment” ranks was dependent on the appearance (aesthetics) of designs.
Table Q1.
Total number of changes made across levels of formality by subjects who ranked according to the apperance of the designs (n = 21).
-
|
Mean
|
Std. Deviation
|
|
Statistic
|
Std. Error
|
Statistic
|
High formality
|
11.33
|
0.81
|
3.71
|
Medium-high formality
|
13.86
|
0.88
|
4.03
|
Medium-low formality
|
14.00
|
0.85
|
3.91
|
Low formality
|
15.57
|
0.98
|
4.48
|
Low formality (paper)
|
19.95
|
1.52
|
6.98
|
Table Q2.
Number of quality changes made across levels of formality by subjects who ranked according to the apperance of the designs (n = 21).
-
|
Mean
|
Std. Deviation
|
|
Statistic
|
Std. Error
|
Statistic
|
High formality
|
9.31
|
0.82
|
3.76
|
Medium-high formality
|
11.48
|
0.91
|
4.17
|
Medium-low formality
|
12.79
|
0.79
|
3.64
|
Low formality
|
13.43
|
0.92
|
4.21
|
Low formality (paper)
|
16.62
|
1.27
|
5.83
|
Table Q3.
Number of expected changes made across levels of formality by subjects who ranked according to the apperance of the designs (n = 21).
-
|
Mean
|
Std. Deviation
|
|
Statistic
|
Std. Error
|
Statistic
|
High formality
|
8.23
|
0.74
|
3.40
|
Medium-high formality
|
9.62
|
0.81
|
3.70
|
Medium-low formality
|
10.07
|
0.73
|
3.34
|
Low formality
|
11.48
|
0.76
|
3.50
|
Low formality (paper)
|
14.07
|
0.96
|
4.38
|
Appendix R. Number of changes made in the five designs across levels of formality by subjects whose “Overall Enjoyment” ranks was dependent on perceived effort required
Table R1.
Total number of changes made across levels of formality by subjects who ranked according to percieved effort required to improve designs (n = 11).
-
|
Mean
|
Std. Deviation
|
|
Statistic
|
Std. Error
|
Statistic
|
High formality
|
11.91
|
0.97
|
3.21
|
Medium-high formality
|
14.64
|
1.07
|
3.56
|
Medium-low formality
|
16.55
|
1.11
|
3.67
|
Low formality
|
16.91
|
1.08
|
3.59
|
Low formality (paper)
|
19.55
|
1.76
|
5.84
|
Table R2.
Number of quality changes made across levels of formality, by subjects who ranked according to percieved effort required to improve designs (n = 11).
-
|
Mean
|
Std. Deviation
|
|
Statistic
|
Std. Error
|
Statistic
|
High formality
|
9.18
|
0.86
|
2.86
|
Medium-high formality
|
12.23
|
1.08
|
3.57
|
Medium-low formality
|
15.36
|
1.15
|
3.82
|
Low formality
|
14.77
|
1.11
|
3.70
|
Low formality (paper)
|
16.96
|
1.54
|
5.11
|
Table R3.
Number of expected changes made across levels of formality, by subjects who ranked according to percieved effort required to improve designs (n = 11).
-
|
Mean
|
Std. Deviation
|
|
Statistic
|
Std. Error
|
Statistic
|
High formality
|
8.46
|
0.90
|
2.98
|
Medium-high formality
|
10.64
|
1.07
|
3.56
|
Medium-low formality
|
12.05
|
0.97
|
3.21
|
Low formality
|
12.55
|
0.85
|
2.82
|
Low formality (paper)
|
14.73
|
1.15
|
3.81
|
Appendix S. Number of changes made in the five designs across levels of formality by subjects whose “Overall Enjoyment” ranks was dependent on the level of fun/stimulation when working on the designs.
Table S1.
Total number of changes made across levels of formality by subjects who ranked according to the level of fun/stimulation when working on the designs (n = 7).
-
|
Mean
|
Std. Deviation
|
|
Statistic
|
Std. Error
|
Statistic
|
High formality
|
11.14
|
1.39
|
3.67
|
Medium-high formality
|
11.86
|
1.39
|
3.67
|
Medium-low formality
|
13.14
|
1.60
|
4.22
|
Low formality
|
12.86
|
1.10
|
2.91
|
Low formality (paper)
|
15.71
|
2.31
|
6.10
|
Table S2.
Number of quality changes made across levels of formality by subjects who ranked according to the level of fun/stimulation when working on the designs (n = 7).
-
|
Mean
|
Std. Deviation
|
|
Statistic
|
Std. Error
|
Statistic
|
High formality
|
8.57
|
1.13
|
2.98
|
Medium-high formality
|
9.21
|
1.20
|
3.17
|
Medium-low formality
|
12.14
|
1.36
|
3.59
|
Low formality
|
10.71
|
0.87
|
2.29
|
Low formality (paper)
|
13.00
|
1.89
|
5.00
|
Table S3.
Number of expected changes made across levels of formality by subjects who ranked according to the level of fun/stimulation when working on the designs (n = 7).
-
|
Mean
|
Std. Deviation
|
|
Statistic
|
Std. Error
|
Statistic
|
High formality
|
7.64
|
1.03
|
2.73
|
Medium-high formality
|
7.79
|
1.04
|
2.75
|
Medium-low formality
|
9.50
|
0.87
|
2.31
|
Low formality
|
9.36
|
0.75
|
1.97
|
Low formality (paper)
|
11.29
|
1.67
|
4.41
|
Appendix T. Subjects reasons for design tool preference during the experiment
Table T1. Reasons by participants who preferred using the tablet (Inkit)
CS/SE major
|
CS/SE design experience
|
Reasons for preference
|
*
|
*
|
can make changes quickly and easily without having to erase things manually: 1) just select and drag; 2) easy to use
|
|
|
because easy to make changes, can move things around, resize, erase etc
|
*
|
*
|
easier to make changes but need more practice on it
|
*
|
|
easy to use, simple interface
|
*
|
*
|
quicker changes and can move things around, resize.
|
|
|
can move things, fun, tidier
|
*
|
|
like computers & faster changes
|
|
|
because its easier to show where you want to move things to, compared to paper – needs arrows & crossing out etc
|
*
|
*
|
fast changes, and move things around and transform things
|
|
|
easier to change
|
*
|
*
|
Liked working on the tablet (but no particular preference if have to choose between 2, I don’t mind)
|
*
|
*
|
easier to make changes but need more practice on it
|
*
|
|
it was fun, and easy to make changes, rather than crossing out
|
*
|
|
faster, easier, click instead of writing
|
*
|
|
was good but with more practice - would prefer a lot more than paper
|
Table T2 Reasons by participants who preferred using the tablet (Inkit)
CS/SE major
|
CS/SE design experience
|
Reasons for preference
|
*
|
*
|
liked paper more coz tablet = cumbersome and annoying to click on select/draw/erase buttons
|
*
|
*
|
Not really like working with tablet (but I suspect it's lack of familiarity) so preferred paper
|
*
|
*
|
easier to make changes, faster, just crossing out stuff, and done.
|
*
|
*
|
Preferred/liked paper more than tablet coz easier to draw and write on paper, right in front of you, no scrolling etc
|
|
|
easier but maybe computer is good to make things look good, and move things around
|
|
|
No preference after getting used to the pen on tablet, but would prefer paper before
|
*
|
|
Liked working on paper better – not used to pen as my handwriting is terrible to follow
|
|
|
nice to change from computer to paper but preferred paper so it's in front of you - easier visualization
|
|
|
easier to make changes using a pen on paper, tablet = hard to do selecting, erase, draw etc
|
*
|
*
|
faster coz can draw faster, and crossing out, mental iteration etc
|
|
*
|
because Tablet's interface was bad, and the changing of modes was annoying (draw, erase, select), doesn't have the freedom like paper
|
|
*
|
because on tablet, had to change modes between draw, select, erase, tiring, and annoying. If short cut, then better
|
*
|
|
easier with pen and paper
|
Table T3 Reasons by participants who had no particular preference in design tool
CS/SE major
|
CS/SE design experience
|
Reasons for preference
|
*
|
*
|
For Dog and Model - wouldn't mind which to design with - good to use tablet so can move things with (reordering) but with designs that required lots of changes[Online Magazine and Loan Application], I would prefer to use pen and paper
|
*
|
*
|
Paper = more accurate, can draw things better compared to the tablet. But with Tablet - it's easier to change, delete and modify.
|
Appendix U. Subjects reasons for design tool preference in real life design situations
Table U1. Reasons by participants who had no preference(s)
CS/SE major
|
CS/SE design Experience
|
Reasons
|
^
|
|
Depends: weather design is complex or simple
|
Table U2. Reasons by participants who preferred using paper and pen
CS/SE major
|
CS/SE design Experience
|
Reasons
|
|
|
Paper: more control, faster at drawing and writing
|
|
|
Probably paper
|
^
|
*
|
Paper - faster, pen and paper infront of you, more freedom
|
Table U3. Reasons by participants who preferred using tablet (Inkit)
CS/SE major
|
CS/SE design Experience
|
Reasons
|
^
|
*
|
Tablet, definitely coz got the parts from both worlds - comp and paper
|
^
|
*
|
tablet everytime - easier to work with + easier to erase mistakes completely cf paper - even when rubbed out, deisgn mistakes are often sill visable and can be distracting
|
^
|
|
tablet, coz easier to edit stuff
|
Table U4. Reasons by participants who preferred using computer (other tools)
CS/SE major
|
CS/SE design Experience
|
Reasons
|
^
|
*
|
PC programs but tablet if it's easier to use - eg not to move too much with hand
|
^
|
*
|
On PC: .Net - just need to drag and drop, tablet is too clumpsy, draw, select, erase, etc)
|
^
|
*
|
PC: other programs such as fireworks, photoshop etc, - easy editing and not tablet coz not user friendly, hands moving too much.
|
^
|
*
|
Computers
|
|
|
Computer - software, but easier than inkit (depend on software). Don't use paper.
|
^
|
*
|
Computer more than paper and tablet
|
|
*
|
Will Computer (something like VB.net, drag and drop) wouldn't use paper first, straight to comp.
|
|
*
|
Compter - can do direct changes on the computer.
|
Table U5. Reasons by participants who preferred using pen and paper, then tablet
CS/SE major
|
CS/SE design Experience
|
Reasons
|
^
|
*
|
If working on designs like dog or antm, then would use tablet. If beginning of a design, then would use pen-paper. Paper if still draft like, tablet if near finished.
|
Table U6. Reasons by participants who preferred using paper and pen, then continue on PC
CS/SE major
|
CS/SE design Experience
|
Reasons
|
|
|
paper - faster and easier with paper and pen, then to PC
|
^
|
*
|
paper over tablet at the moment, coz like using paper and pen/ use PC. Would choose to use mouse and keyboard coz not used to tablet's pen-input
|
|
|
paper - coz technology (inkit) is hard to use, not user friendly, paper, then put it on computer
|
^
|
*
|
Computer but not necessary a tablet - because not used to tablet, and have different modes: select, erase, draw. Would use paper first then computer.
|
^
|
|
Paper first then computer
|
^
|
|
Paper first, then computer. And probably not Tablet, coz hard to draw on…unless user friendly program
|
|
|
Paper first, then computer. Need to get used to tablet if going to use
|
|
|
Porbably paper to do a draft, then put onto computer
|
|
|
Draw on paper first to sketch out idea first then computer
|
^
|
*
|
Would use paper if start on scratch, if got everything there, would use computer - would be good if can just transform into nice looking after you've drawn it
|
^
|
*
|
Draft on paper first (from rough to finalized) then use the final version from paper and transfer to computer and then some more finalizing on computer
|
^
|
|
Paper and pen, then transfer to computer
|
^
|
|
Paper first then computer
|
^
|
|
Paper first for rough copy because so many modifications are made, then computer for drafts
|
Share with your friends: |
