1. How old are you? (Please enter an Integer)
Answer
|
23
|
23
|
21
|
22
|
21
|
21
|
22
|
25
|
23
|
25
|
33
|
22
|
21
|
24
|
22
|
2. Gender:
Answer
|
Count
|
Percent
|
Male
|
10
|
67%
|
Female
|
5
|
33%
|
3. Please enter your email ID:
Answer
|
ruizw
|
alexmart
|
smsk
|
dlud@u.washington.edu
|
amenkens@u.washington.edu
|
byronm@gmail.com
|
grahamna@u.washington.edu
|
shwetagram@gmail.com
|
crappoop@hotmail.com
|
naren1012@yahoo.com
|
esearle@u.washington.edu
|
asherw22@u.washington.edu
|
drewg07@u.washington.edu
|
sarat.addepalli@gmail.com
|
mmy2
|
4. Which of the following do you use? (check all that apply)
Answer
|
Count
|
Percent
|
Cell Phone
|
15
|
100%
|
PDA (Palm)
|
2
|
13%
|
Portable music player (Zune, iPod, etc)
|
11
|
73%
|
Smart Phone (Blackberry, Palm Treo, Windows Mobile Phone)
|
4
|
27%
|
5. Are you familiar with Android - G1 smart phone?
Answer
|
Count
|
Percent
|
Yes
|
2
|
13%
|
I tried it few times
|
2
|
13%
|
No, I never tried it before
|
11
|
73%
|
6. How familiar are you with doing the following operations on your phone?
Answer
|
1
|
2
|
3
|
4
|
5
|
Total
|
Mean
|
Taking pictures
|
13% (2)
|
0% (0)
|
7% (1)
|
13% (2)
|
67% (10)
|
15
|
4.2
|
Browsing Internet
|
33% (5)
|
13% (2)
|
13% (2)
|
13% (2)
|
27% (4)
|
15
|
2.9
|
Sending text messages
|
0% (0)
|
7% (1)
|
0% (0)
|
0% (0)
|
93% (14)
|
15
|
4.8
|
Sending email
|
33% (5)
|
27% (4)
|
13% (2)
|
7% (1)
|
20% (3)
|
15
|
2.5
|
Sending Picture messages
|
7% (1)
|
7% (1)
|
27% (4)
|
20% (3)
|
40% (6)
|
15
|
3.8
|
Finding directions on maps
|
47% (7)
|
20% (3)
|
13% (2)
|
7% (1)
|
13% (2)
|
15
|
2.2
|
7. Did you ever feel the need to search for product information online while shopping in a store?
8. How strongly do you feel about being Environmentally friendly?
1
|
2
|
3
|
4
|
5
|
Total
|
Mean
|
7% (1)
|
0% (0)
|
27% (4)
|
53% (8)
|
13% (2)
|
15
|
3.7
|
Task 1 - Check my greenBean score
Check your greenBean score and your score breakdown.Please note the following:Which week in this month did you score the most "beans?"
Starting URL: http://www.cs.washington.edu/education/courses/cse441/CurrentQtr/project_files/shop/GreenBean7.html
T1: Task Effectiveness
|
Count
|
Percent
|
Success
|
11
|
73%
|
Non Success
|
4
|
27%
|
Total
|
15
|
|
T1: Task Success Efficiency
|
Time
|
Mean
|
0:46
|
StDev
|
0:12
|
Maximum
|
1:00
|
Minimum
|
0:20
|
|
Count
|
Percent
|
Time
|
Abandon
|
1
|
25%
|
0:04
|
Error
|
3
|
75%
|
1:46
|
T1: Validation Questionnaire
1. Which week in this month did you score the most "beans?"
Answer
|
Count
|
Percent
|
Week 1
|
1
|
7%
|
Week 2
|
1
|
7%
|
Week 3
|
1
|
7%
|
Week 4 (Correct answer)
|
11
|
79%
|
T1: Success Questionnaire
1. Please rate the following:
Answer
|
1
|
2
|
3
|
4
|
5
|
Total
|
Mean
|
The task was easy to complete.
|
0% (0)
|
0% (0)
|
14% (2)
|
29% (4)
|
57% (8)
|
14
|
4.4
|
The interface helped me to complete the task.
|
0% (0)
|
7% (1)
|
0% (0)
|
36% (5)
|
57% (8)
|
14
|
4.4
|
It was intuitive to find your weekly, monthy, and yearly scores using the tabbed navigation.
|
7% (1)
|
0% (0)
|
0% (0)
|
14% (2)
|
79% (11)
|
14
|
4.6
|
It is important to see your score visually.
|
0% (0)
|
0% (0)
|
14% (2)
|
29% (4)
|
57% (8)
|
14
|
4.4
|
It is important to know the exact number of "beans" collected.
|
0% (0)
|
7% (1)
|
36% (5)
|
29% (4)
|
29% (4)
|
14
|
3.8
|
2. Comments on this task: [Non-Mandatory]
Answer
|
It was pretty easy to complete. The hardest part was figuring out the testing interface.
|
What exactly do the "beans" mean? That you were environmentally friendly? Also- since there wasn’t a comment section for the last part with the granola- here are my comments. That was pretty confusing navigating around. The directions weren’t clear as to how to determine if Udi’s had peanuts or not. Because it still popped up on the list of possible granola’s after you sorted the list, does that mean it didn’t have peanuts? Very confusing.
|
This was very simple and easy to navigate
|
I was able to perform this task very quickly, though I discovered most of it from the previous task when I was trying to figure it out. Overall this ones interface was well organized.
|
I liked this because it gave me all the statistics that I want in an easy to understand format, both numerically and graphically.
|
Pretty easy to find the breakdown on the beans per week, month, and year because of the tabs on the screen.
|
how is each bean defined? what does it mean to have collected 1 greenbean?
|
I thought it was kind of confusing that there was a "score" button after I had already looked at the graph. It just took me back to the previous page and reloaded the into.
|
T1: Abandon Questionnaire
1. Please answer the following:
Answer
|
1
|
2
|
3
|
Total
|
Mean
|
Could you start the application by clicking on the "greenBean" on the phone’s desktop?
|
100% (1)
|
0% (0)
|
0% (0)
|
1
|
1
|
Did you click on the "Check my Score" button on the greenBean home page?
|
0% (0)
|
100% (1)
|
0% (0)
|
1
|
2
|
Did you click on the "Month" tab?
|
0% (0)
|
0% (0)
|
100% (1)
|
1
|
3
|
Did you view the score breakdown in the "Month" tab?
|
0% (0)
|
0% (0)
|
100% (1)
|
1
|
3
|
2. Did you look for help at any point? [Non-Mandatory]
Answer
|
Count
|
Percent
|
Yes
|
0
|
0%
|
No
|
1
|
100%
|
Where did you look for help?
|
google
|
Task 2 - Identifying products that are safe
First, use the “Preferences” section of greenBean to identify peanuts as an allergen.Then use greenBean search to find a safe Granola bar.Please note the following:Is Udi’s an allergy safe granola product?
Starting URL: http://www.cs.washington.edu/education/courses/cse441/CurrentQtr/project_files/shop/GreenBean7.html
T2: Task Effectiveness
|
Count
|
Percent
|
Success
|
10
|
67%
|
Non Success
|
5
|
33%
|
Total
|
15
|
|
T2: Task Success Efficiency
|
Time
|
Mean
|
3:08
|
StDev
|
0:57
|
Maximum
|
4:46
|
Minimum
|
1:49
|
T2: Task Non Success
|
Count
|
Percent
|
Time
|
Abandon
|
5
|
100%
|
2:32
|
T2: Validation Questionnaire
1. Is Udi’s an allergy safe granola product?
Answer
|
Count
|
Percent
|
Yes (Correct answer)
|
7
|
70%
|
No
|
0
|
0%
|
I don’t know
|
3
|
30%
|
2. How did you set your preferences?
Answer
|
Count
|
Percent
|
I did not set them.
|
0
|
0%
|
I selected the alergy Peanut, by clicking the check box next to its name. (Correct answer)
|
3
|
100%
|
I selected the alergy Peanut from a drop down list.
|
0
|
0%
|
It was preset.
|
0
|
0%
|
T2: Success Questionnaire
1. Please rate the following:
Answer
|
1
|
2
|
3
|
4
|
5
|
Total
|
Mean
|
The task was easy to complete.
|
10% (1)
|
20% (2)
|
20% (2)
|
40% (4)
|
10% (1)
|
10
|
3.2
|
The interface helped me to complete the task.
|
20% (2)
|
10% (1)
|
30% (3)
|
30% (3)
|
10% (1)
|
10
|
3
|
It was intuitive to find the "Preferences" button in the context menu.
|
20% (2)
|
20% (2)
|
20% (2)
|
10% (1)
|
30% (3)
|
10
|
3.1
|
For subsequent searches should the filter be turned ON by default?
|
0% (0)
|
0% (0)
|
30% (3)
|
30% (3)
|
40% (4)
|
10
|
4.1
|
2. Comments on this task: [Non-Mandatory]
Answer
|
The text on the G1 during testing is too small to read.
|
The information on all of the products was the same. The information was from the laundry detergent, so I couldn’t tell if there were peanuts in UDI’s granola bar or not. I dont think I would have known to get to the preferences from the menu button, but once I did everything made sense.
|
My first conflict was figuring out where the setting were set up. This may be due to the fact that I’m not very comfortable with the G1 phone. The other issue was applying the Allergen. If someone had allergies they would never want foods to be indicated if they were allergic to them. Also the check box that says apply filters is very ambiguous.
|
I had problems because I wasn’t sure if the filter was working. I would set "peanuts" as an allergen in preferences, but every time I went back to preferences, peanuts would no longer be set. I think if I were allergic to peanuts, I would always want peanuts set in my preferences.
|
It was extremely difficult to find the preferences section in the interface. Also, on visiting it the second time, I realized that I had interpreted the User review section incorrectly. There are two sets of numbers (one for the amt of rating and the other for no. of comments). I would suggest to use color/graphic coding here. The bars, could be in the shape of stars (since they are ratings) and percentage of the bar could be colored depending on the no. of comments for it.
|
the buttons on the phone are not completely simulated, that is, mouse clicks are not being detected on some areas where buttons are supposed to be present on the phone....
|
T2: Abandon Questionnaire
1. Please answer the following:
Answer
|
1
|
2
|
3
|
Total
|
Mean
|
Could you start the application by clicking on the "greenBean" on the phone’s desktop?
|
80% (4)
|
20% (1)
|
0% (0)
|
5
|
1.2
|
Could you find the "Preferences" page?
|
80% (4)
|
20% (1)
|
0% (0)
|
5
|
1.2
|
Did you select Peanut as an allergy by clicking the check box next to its name?
|
80% (4)
|
20% (1)
|
0% (0)
|
5
|
1.2
|
Did you know how to get options using the phone’s "MENU" button?
|
60% (3)
|
40% (2)
|
0% (0)
|
5
|
1.4
|
2. Did you look for help at any point? [Non-Mandatory]
Answer
|
Count
|
Percent
|
Yes
|
2
|
40%
|
No
|
3
|
60%
|
Where did you look for help?
|
In the screen that is prompted when you push the menu key. Next to the preferences button.
|
Task 3 - Scan a product and compare.
Scan the product barcode to look up more details about Kirkland detergent. Lookup it’s Ratings.Compare it to other detergents to help you decide which kind to buy.Please note the following:How many user reviews were there for the product?Which product has the lowest price/unit?
Starting URL: http://www.cs.washington.edu/education/courses/cse441/CurrentQtr/project_files/shop/GreenBean7.html
T3: Task Effectiveness
|
Count
|
Percent
|
Success
|
9
|
60%
|
Non Success
|
6
|
40%
|
Total
|
15
|
|
T3: Task Success Efficiency
|
Time
|
Mean
|
1:59
|
StDev
|
1:06
|
Maximum
|
3:35
|
Minimum
|
0:10
|
T3: Task Non Success
|
Count
|
Percent
|
Time
|
Abandon
|
4
|
67%
|
2:00
|
Error
|
2
|
33%
|
2:26
|
T3: Validation Questionnaire
1. How many user reviews were there for the product?
Answer
|
Count
|
Percent
|
5
|
4
|
36%
|
13
|
0
|
0%
|
19
|
0
|
0%
|
28 (Correct answer)
|
7
|
64%
|
2. Which product has the lowest price/unit?
Answer
|
Count
|
Percent
|
Kirkland (Correct answer)
|
2
|
50%
|
Wisk
|
0
|
0%
|
Tide
|
2
|
50%
|
Arm & Hammer
|
0
|
0%
|
T3: Success Questionnaire
1. Please rate the following:
Answer
|
1
|
2
|
3
|
4
|
5
|
Total
|
Mean
|
The task was easy to complete.
|
9% (1)
|
9% (1)
|
9% (1)
|
55% (6)
|
18% (2)
|
11
|
3.6
|
The interface helped me to complete the task.
|
9% (1)
|
9% (1)
|
0% (0)
|
55% (6)
|
27% (3)
|
11
|
3.8
|
It was easy to find the center button which allowed me to capture the barcode.
|
0% (0)
|
0% (0)
|
27% (3)
|
27% (3)
|
45% (5)
|
11
|
4.2
|
I liked the way information was presented about the individual product.
|
0% (0)
|
0% (0)
|
9% (1)
|
64% (7)
|
27% (3)
|
11
|
4.2
|
The criteria to sort the products are good.
|
0% (0)
|
0% (0)
|
36% (4)
|
27% (3)
|
36% (4)
|
11
|
4
|
2. Comments on this task: [Non-Mandatory]
Answer
|
This task was easy to complete than the previous task.
|
Fairly easy. Although it took me some time to find the "similar products" button, so I could just look up all the detergents at once.
|
Everything was pretty clear. The only thing I might suggest is that there is an option to sort by price by liter.
|
Personally, I found it straight forward and easy to use. The only problem that I had was with the buttons sorting because it was too small. But considering that this application would be on a cell-phone, I can understand why is would be small.
|
After taking the picture of the barcode, a screen with the Google search box appeared however on typing and clicking Go, nothing showed up. Later, I accessed the list through the main interface on the Home page. On the home page, I feel that the logo is given more importance than the functionality itself. It would have been great if all the buttons were lined up in order of usage (barcode, search, list, etc) one below the other.
|
awesome
|
It was convenient doing shopping using the mobile..
|
Almost didn’t notice the Review button. Perhaps give it a ranking right on the bar, as you do with the other two categories and their beans? Is it a swipe to go back? Wanted to back track a few times, but wasn’t sure how. Could be that I’m not playing with the actual phone.
|
I have the scan saavy application on my phone currently that I use to scan barcodes if I ever want to look up the price. However, I found that the green bean application was much easier to use and more organized than the program I use now.
|
I didn’t know how to look at other products at first. I forgot that I was looking at only the info for the product I scanned, but I easily found the right button after I scanned the interface.
|
T3: Abandon Questionnaire
1. Please answer the following:
Answer
|
1
|
2
|
3
|
Total
|
Mean
|
Could you start the application by clicking on the "greenBean" on the phone’s desktop?
|
75% (3)
|
25% (1)
|
0% (0)
|
4
|
1.2
|
Did you click on the "Scan" button on the greenBean home page?
|
75% (3)
|
25% (1)
|
0% (0)
|
4
|
1.2
|
Could you capture the item’s barcode?
|
50% (2)
|
50% (2)
|
0% (0)
|
4
|
1.5
|
Did you find the user reviews in the Ratings section of the product?
|
25% (1)
|
50% (2)
|
25% (1)
|
4
|
2
|
Did you click on the "Search similar" button on the product page to compare?
|
0% (0)
|
75% (3)
|
25% (1)
|
4
|
2.2
|
2. Did you look for help at any point? [Non-Mandatory]
Answer
|
Count
|
Percent
|
Yes
|
1
|
25%
|
No
|
3
|
75%
|
Where did you look for help?
|
I tried to press the menu button, but because the phone was still scanning it would not pop up the menu and I could not click on any of the options in that list.
|
Final Questionnaire
1. What did you like least about greenBean application? [Non-Mandatory]
Answer
|
Tiny text! I am sure this would be different with the actual phone.
|
1.) Menu button wasn’t labeled so I couldn’t figure out what it was at first. 2.) The back button didn’t always work so I’d have to re-open greenbean 3.) When searching, you had to press go to start the search instead of just pressing enter
|
I couldn’t use it how the test wanted me to because of errors in the application like all the products have the same description and the bar code would not scan.
|
The filter system was the most awkward part.
|
. Though the graphs are really cool, they may be too hard to read for most people. Maybe you should add something so that if you touch one of the slices of the month or year "pie", then it pops up the exact number of beans you earned and what week/month it was in a larger font
|
General navigation through the search, Ingredients should be a list and not a paragraph. Green beans in the product list should be supported with exact numbers (if there were, I may not have noticed) so that consumers can make a calculated decision which is not entirely based on visuals.
|
everything
|
The application is a bit slow in response.
|
I didn’t like the hidden options and preferences. The icons at the top are also really small.
|
2. What did you like best about greenBean? [Non-Mandatory]
Answer
|
The scanning feature that presented product information, seems like it would be hard to implement on the android phone unless it has a laser scanner.
|
The layout looks really professional, and the information obtained from searching was very complete and useful. Also the "check my score" feature is a good one- so people can see the overall effect they have having by choosing greener products.
|
I like the collection of information that is presented for each product, this is very useful and easy to navigate. I like the large buttons and clean interface.
|
The rating system and bar code system was very easy to use, which luckily for me seems like the most used portion of the program.
|
It was a pretty intuitive program. The interface was pretty easy to use and read, though the font was a little small in some places. i also appreciated what it was trying to accomplish. I think a lot of people would find this useful.
|
There is certainly a strong need for this kind of an application. The interface in the score section is laid out well. With precise numbers and an optional tabular view (for people accustomed to tables), it would be even better!
|
nothing
|
The aesthetics of the interface
|
It was easy to use and could be customized based on the user’s needs.
|
price/unit comparison, allergy information, other brands/products comparison
|
For the most, part it was easy to use. I like the buttons on the home screen. They are very clear. I like the instructions below the bar code scan. They helped a lot.
|
3. What information did you find relevant while using greenBean?
Answer
|
None
|
Prices. Prices. Prices. (I’m cheap)
|
The price about the products.
|
Allergy Information
|
It is nice to know how the product is made, but its not very important for me to know while I am shopping. I liked knowing whether it was recyclable and the reviews are very useful.
|
The greenbean rating. The ratings system.
|
I figure greenBean would be a program I’d use in a supermarket, so I appreciated that it quickly gave me comparative information for different products based on a bar code scan, which was quick and easy. Also tying that information with buying environmentally friendly products provides another piece of information I might consider when buying something.
|
In order of importance: User reviews of the product Green value + Ingredients Recyclable/not-recyclable
|
none
|
The preferences section and the ratings section
|
From previous question, I do like the ability to take a picture of the bar code. Very handy. I’m a little biased as far as users go, as I saw the hi-fi prototype last quarter. The ability to compare with other products is good. I like that more than keeping track of my overall purchases.
|
The ratings listed by other users and the price comparisons on items.
|
Allergens are very important when shopping.
|
user ratings, although it is not intuitive to find it...
|
I liked being able to keep track of my beans. Searching for foods with or without certain ingrediants also seems useful.
|
4. What other information do you think greenBean should give you? [Non-Mandatory]
Answer
|
Nothing I can think of right now.
|
Maybe greenbean should give recommendations about which products to buy in many categories. That way, lazy consumers don’t have to search for green products- you can just tell them what to buy. :)
|
I think it would be really nice to look up a green product and then have it give you recipes for green meals or related products that might not have been on my grocery list. It would nice to be able to look up a product I purchase all the time and get suggestions on what green products can replace it.
|
I’m afraid of asking for anything else. I think the strength of programs like this are their relative simplicity, and I wouldn’t want to clutter this program up with extra add-ons.
|
none
|
Is carbon footprint on there? In general, I think it covers the topic well.
|
Maybe prices at other stores. Sales and coupons.
|
5. Do you have any further ideas or suggestions for improvements? [Non-Mandatory]
Answer
|
Nope, I think the app would look great on the phone.
|
Make the searching for non-allergic products more user friendly. Namely be clearer where the menu button is and how to filter products out that have peanuts. Its not obvious.
|
The filter system vocabulary should be more appropriately standardized to make it clear.
|
Mentioned in the last question :)
|
poop
|
The interface also can contain some links pointing to online reviews about the products that are listed.
|
It would be cool if it told me where I can get products with the least amount of driving.
|
Participant system information
1. Operating System
Answer
|
Count
|
Percent
|
Windows Vista
|
7
|
47%
|
Windows XP
|
7
|
47%
|
Macintosh
|
1
|
7%
|
2. Browsers
Answer
|
Count
|
Percent
|
Internet Explorer 7
|
6
|
40%
|
Firefox 3
|
8
|
53%
|
Chrome
|
1
|
7%
|
3. Screen Resolution
Answer
|
Count
|
Percent
|
Higher than 1024x768
|
14
|
93%
|
Others
|
1
|
7%
|
greenBean – Winter09
Share with your friends: |
