Below are the results:
General
9 persons of which 7 male and 2 female.
Ages from 18 to 24.
5 master degrees, 4 bachelor degrees.
7 persons with a computer sciences background.
6 persons have a smartphone, 2 have used one before, 1 has no experience with it.
Questionnaire
The USE questionnaire can be divided into 4 factors:
- Usefulness
- Questions 1 to 6
- Overall score (on a scale from 1 to 7) 5,0555
- Ease of Use
- Questions 7 to 11
- Overall score (on a scale from 1 to 7) 5,1777
- Ease of Learning
- Question 12
- Overall score (on a scale from 1 to 7) 6,1111
- Satisfaction
- Questions 13 to 15
- Overall score (on a scale from 1 to 7) 5,2963
Positive remarks
There were some positive remarks that came up with many of the test persons:
- 7 persons mentioned having your course schedule with you is a very useful utility. Moreover, the ability to show on a map where a class is held and calculating a route to that class. 2 of these persons found it useful especially for new students, but less for the older ones.
- 5 persons found it useful to see which of your friends are around, for group assignments, course lectures, etc...
- 4 persons found the functionalities handy, having most of what a student needs in one single application, in stead of being spread out on several websites. They also found the menu easy to use, since it is limited to the main big functionalities.
Negative remarks
There were also some negative remarks though. These remarks can be associated with one or some factors:
- Design
- Sometimes the way to accomplish something is not the shortest.
- The check-in functionality was somewhat hidden. 7 persons had difficulties trying to check in.
- Users were expecting some kind of feedback when there were no courses or events in the next week.
- Functionalities
- User location is not precies enough.
- Long loading times (NOTE: the evaluations were done mostly with EDGE)
- (Reverse) geocoding an adress from the events doesn't work all the time.
- Automatically select current location as starting location.
- Users expected some search function for events.
- General smartphone remarks
- Users are not eager to tap on map markers.
- Users tend to instantly tap OK when dialogs are shown, without reading the message/instructions first.
Having analyzed the evaluation data, I already have some possible solutions in mind. But whether I will do another iteration will depend on how well and how quickly I record the study material for the exams.
Also note, that since the market release, the application was downloaded and installed 16 times, and 3 of these users have filled in a questionnaire. I will do a deeper analysis of this 'online' data later...
