Integrated Project
Information Society Technologies
Revised version: 14.06.2009 (final)
Start date of project: 1.2.2006 Duration: 60 Months
Product name and version: KPE/Shared Space Tools, M36 stable version
Organisers of the test:
Date of the test:
Date of the report:
Editor:
Metropolia
05-06.06.2009
14.06.2009
Minna Reinikainen
Contact name(s): Merja.bauters@metropolia.fi
and Eini.saarivesi@metropolia.fi
Executive summary
Provide a brief level overview of the test (including purpose of test)
Name the product Google Docs, Integrated Wiki and Help Mode of
KP-Environment
Purpose/objectives of the test
Method
Number and type of participants
Find functions that do not work, make sense or are no clear
Explorative analysis
One fourth year student from Metropolia
1

Tasks (if task are used) No tasks, but list of predefined functionalities
Main results:
 Most of the wiki functionalities did work, but “make .pdf”, “see in Content View” , adding members, adding a wiki type of content item in the Content View of an
 existing wiki page did not work as well as the changing the title from the Content
View “modify content item”. Furthermore, adding Flash videos had some problems and no error message.
The Google Docs testing found out similar problems as in Usability Report UU 01-
2008 M33-M35 Diagnostic Evaluation
Help Mode tested only the Process View were it seemed to work as intended,
 however it kept providing information about Process View when the user moved to
Content View (the links still did not direct to help wiki)
Table of contents
Introduction ........................................................................................................................... 2
Test Objectives ...................................................................................................................... 2
Participants ............................................................................................................................ 3
Test Facility........................................................................................................................... 3
Experimental Design ............................................................................................................. 3
Procedure .......................................................................................................................... 3
Participant General Instructions ........................................................................................ 3
Results ................................................................................................................................... 3
Google Docs:..................................................................................................................... 3
Wiki functionalities: .......................................................................................................... 3
Help mode in KPE: ........................................................................................................... 5
Appendix ...................................................................
Ошибка! Закладка не определена.
The Google Docs functions tested: .......................
Ошибка! Закладка не определена.
The tested functions of Wiki: ................................
Ошибка! Закладка не определена.
Knowledge Practices environment was tested for usability in spring 2009. The tools that were tested, were the functions of Google Docs, integrated Wiki functionalities and help mode in the KPE.
The idea was to get results for the listed functionalities of the Google Docs such as choosing a document, uploading it and then sharing that document. While doing these tests, it was observed how the tools functions and are there any problems encountered while using it.
Also the integrated Wiki was tested the same way as Google Docs. There were different functionalities listed out. While performing the task it was observed how it these work, are there any problems and if so, it was considered of how it could be improved.
The help mode in KPE was tested for usability with no specific tasks and only the process
View was tested. The purpose was to go through the different parts and observe if they were
2

easy to find, easily understood and logically presented. No reason mentioned why the rest were not tested.
One media engineering student from Metropolia University of Applied Sciences was testing the usability of the given parts. The observer has some knowledge of what is good usability and usability testing.
The tests were conducted at the observers home, with a personal computer. There were a few brake downs of the internet connection while doing the usability testing, but it is unknown if they were problems with the servers or with the observers wireless internet connections.
Participant’s Computing Environment
 Computer used: Apple Mac Book, Mac OS X 10.4.11


Browser: Firefox 3.0.10
 The enabled plug-ins: Default Plug-in, Java Embedding Plug-in 0.9.6.4,
QuickTime Plug-in 7.6.2 and Shockwave Flash.
Once the given task (functionality from the list) was performed, it was noted if it worked as should, and then it was decided that it was completed. The observer was allowed to ask questions if there were any problems during the process, but the testing went fine and no questions were needed. Once the login caused problems, but it was solved even before any answers were given. The people involved in the testing were me - Minna Reinikainen.
There were many tasks (functionalities in the list) for each tool of the test. See Appendix for the two tables showing the functionalities to be tested. The help mode was observed and noted if there are some parts that did not function or were unclear to a user.
 Share a document with other users: Sharing a document with other users by using the
Google Docs tool worked fine. No problems were encountered.
 Choose a document. Uploading the document: I was able to choose any document from my computer and upload the file with no problems.
 Search a text in Google Docs documents: When I wanted to search for text in Google
Docs documents, it worked fine. The results were the documents that the user has in the Google Docs, if the user could even edit the text and share it, it would be a useful feature.
 Add New Wiki type of Content item in shared space’s Content View: I added a new
Wiki type of content item in shared space’s Content View successfully. The wiki-
3



 page was created with rights to access and edit it. But it opened the wiki-page in edit mode, not in read mode, as it should after it has been created and re-accessed.
Add a wiki type of Content Item in the Content View of an existing wiki page: I was not able to add a wiki type of content to an existing wiki-page.
In Content View delete the wiki type of content item: I was able to delete the wiki type content from Content View, but the wiki-page did not disappear. I would think it is better to make the wiki-page also disappear, and have a warning that the user is about to delete also the wiki-page. If it is seen necessary to keep the wiki-page although deleting the wiki type content, maybe the user could choose an option to only delete the wiki type content. Comment from UI team: this had been a requirement not to delete the wiki-page, so it will not be changed at least before there are more request to change the functionality.
Modify the content item type wiki page, i.e., its description and other metadata: I was able to modify the content item OK and it showed that changes were made in the info tab. I also changed the title and this caused a little confusion. In the Content View I saw that the title changed, but when viewing the wiki-page, a new one was created, with the new title. The wiki-page with the old title was left there too. I do not think the title should be changeable, or then it would have to work so that it changes the
 title only and not creating a new wiki-page.
A user can add a wiki page to personal list of favourites: There were, no problems found while testing to add a wiki page to favourites.
 From favourites list page user can a) follow link to page or b) remove the page from the list: From the favourites list I was able to follow a link to a page and also I was able to remove a page from favourites. It is not allowed to have duplicate entries in the “favourites” it informed the user that the page already exists in the favourites.
 Search particular pages using the search in the wiki: The search gave me results, but also it gave me results of pages that I do not have a permission to enter. I was able to enter the page through -the link provided by the search result, but I was not able to follow the links to other pages related. So I had accesses to pages I should not have.
The same error happed with the random page link (located at the left side bar).
 Use the “See In Content View” to go pack from the wiki-page to the shared space’s
Content View: This is not working. It goes to a page that says “Loading Content
View For Article...”.
 A user can add semantic tags to Wiki by using a pop-up form in the edit page of the




Wiki: The tagging worked fine with no problems.
In the edit mode add a link type tag: The tagging worked fine. But the text in the form is a little unclear, I did not understand what to fill in to the parts Relation and
Reverse relation. It had no visible effect if the field was empty or filled.
A user can add Flash videos to Wiki by using a pop-up form in the edit page of the
Wiki: This was very clear and easy to use in the edit mode, but for an unknown reason I could not get the video to show. The wiki page shown the place, the buttons, and says “buffering.” but did not show the flash video. I think it is confusing that when on my first attempt it did not work; there was no error message or anything, the pop-up cleared out the text from the fields and stayed open. This confused me as a user, and I had no idea what had happened.
A user can add YouTube videos to Wiki by using a pop-up form in the edit page of the Wiki: The adding of a YouTube video was very easy and clear to use. There were no problems.
Go the shared space listing to see all the wiki-pages you have access, select on and add a user into the list by using edit button: I added a user to the list by typing in
4



“Elisa” but it turned out with a strange result; it added a user but not by the name
Elisa, but now it shows a number (84.248.55.119). I am wondering if there is no such user, and the system just added something. But now it will not let me remove that user. When I press the remove button, I am directed to a blank page. When I return, the user I wanted to remove is still there.
Through the “sharedspaces” link navigate to the wiki main page, below the list of users are the list of wiki-pages belonging to this main page (i.e. shared space), make on of those pages public, did work.
Try out if the “Download as PDF” works: The down loading as PDF did not work. It seemed like it would, since it gave me an option to download the PDF to my computer, but once I had downloaded it, it had two blank page only the first page had a title “Article Sources and Contributors”.


I found no problems while testing the help wiki. It was clear to find help.
The help mode had some problems while using it:
-
The submenu “help mode” under Help did not work, but I was able to activate the help mode with the question mark button that is located at the top left corner.
The pop-up that showed I had activated and turned off the help mode is a good solution to make the user aware of what is happening.
First I entered the Process View, and the help mode worked fine. It showed the right message while mouse was over a certain area. But when I returned to the Content View, and activated the help mode again, it showed the messages of the Process View. See the screen shot (figure 1)
5

Figure 1. As seen in figure1, the message shows “click to find help on GANTT” although it should say “click to find help on Content View” since I was over the content view, not the
GANTT.
 But all in all the help mode was a good tool.
Case
Share a document with other users
Passing Criteria
The user can share a document (Word, spreadsheet, etc), in a Google repository, with other Google users (accounts).
Comment
Adding the users and checking if the users can see the document in Google docs.
Choose a document.
User can choose document from own computer.
Uploading the document User can upload a document (Word, spreadsheet, etc), to a Google repository.
6

Search a text in Google
Docs documents.
User gets result from the search.
The user can look for a text in a document on a Google repository. This is a really weird functionality because it does not allow the user really to do anything, thus should be thought of do we really need this?
Case
Add New Wiki type of Content item in shared space’s Content View
Passing Criteria
A content item appears in the
Content View and a wikipage is created into which the user has rights to access and edit. The wikipage should be in read mode, not in edit mode.
Comment
Add a wiki type of Content Item in the
Content View of an existing wiki page
A Wiki type of content item should appear in the Content
View
This has not yet worked, so I am not sure if it opens the wikipage directly or the user has to double click the new wikitype of content item to get to the page. Thus, if this work, it would be good to consider if the manner how to access the page (it opens directly or user has to double click to got to the page) is appropriate, i.e., useful way for the user
(student)
Describe what happens i.e., does it delete also the wikipage or not and state which way would be better from the student’s point of view
In Content View delete the wiki type of content item
The content item should disappear, unknown if the wikipage should or should not disappear
Modify the content item type wiki page, i.e., its description and other metadata
A user can add a wiki page to personal list of favorites. link to page or b) remove the page from the list.
From favorites list page user can a) follow
Modified data is updated and can be seen selecting the content item and checking the
Info tab for the metadata information
Unknown what happens if the user tries to modify the title since when created the wikipage is named according to the title given to the content item, so this actually should not be changeable or it is but changes only in the content item and not in the wikipage
The page should appear in the favourite list page a) The user is directed to the page b)
The page is removed from the list
Duplicate entries of one page should not be allowed
Search particular pages using the search in the wiki
Search results are correct and only provide results from the wikipages that have been created under the shared space into which the wiki belongs to
Use the “See In Content View” to go pack from the wikipage to the shasred space’s
Content View
The user should directed back to the Content View of the shared space into which the wiki belongs to and see the particular wiki type of content item highlighted
Search is limited only to namespaces the user has access rights to (not sure if this so, but if it is, tell if it is suitable like that)
Most likely is not working. State how useful you see this feature if it would work
A user can add semantic tags to Wiki by using a pop-up form in the edit page of the
Wiki
In the edit mode add a link type tag
When the page is saved the tags should appear in the page as highlights and/or tool tips
Tagging possibilities: In edit mode add a semantic tag using tag button in the menu to one term, to couple of terms and to a paragraph depending on choices the users made in the pop-up form and be seen in the end of the wikipage section as: Metatags: Free
Term:Events
There should appear the icon for Also state do the different text fields in the tag and tooltip of the tag when hovering over the icon the form make sense for the user, are their meaning (why t fill them) clear to
7

A user can add Flash videos to Wiki by using a pop-up form in the edit page of the
Wiki
The video should appear in the wkipage
A user can add YouTube videos to Wiki by using a pop-up form in the edit page of the Wiki
The YouTube should appear in the page
A user can access semantic annotation inside a Wiki page by writing hash and the
User should be directed to the tag id of the semantic annotation tag at the end of the URL leading to the page
(wikipageName#projectProposal)
Go the shared space listing to see all the wikipages you have access, select on and add a user into the list by using edit button
Clicking the link
“sharedspaces” user should be directed to the list of wikipages s/he has access rights. Selecting one, (clicking it) user should be taken to the main page of those wikipages that belong to that apeticular shared space and by edit add members to have access rights to the pages.
The user is directed to the same
Through the “sharedspaces” link navigate to the wiki main page, below the list of page but now its public (can be users are the list of wikipages belonging to this main page (i.e. shared space), make on of those pages public known by the brackets in the
URL of the page)
Try out if the “Download as PDF” works Unknown how it should look the user
State also how clear and easy this was to use
Is there any point with this – at least for average user this too hard a way to go to the tags.
These features are usable since it seems the access rights are not working properly but there is no affordance that one can do this or how it is done – suggestion what hints/affordances could be placed to the wiki to let the user know about this possibility.
Is this indication enough to provide feedback for the user that the page is really public and not under user rights protection – if it is not provide suggestions for feedback manner for the user to know that the page truly is public,
State if this a worthwhile feature to have….
8