[Plone-UI] Usability testing tools

[Ed Manlove]

Nathan, the example tool you noted 
(http://www.optimalworkshop.com/chalkmark-demo) is pretty interesting 
for static homepages asking what would a user click if wanting to 
accomplish X. Having worked alongside usability specialists and 
participating in several usability studies, the chalkmark tool is 
missing two important pieces of usability information for these 
deco/widget samples: eye or mouse tracking and an audio recording of the 
testers out-load thinking.

There is such a toolset within our community in the form of the WebLion 
Video Recording Solution 
(https://weblion.tlt.psu.edu/FogBugz/default.asp?W1060). This setup 
records the screen, audio and video (?possibly two cameras?) and could 
be used to capture a usability session. This is, of course, just the 
hardware setup and it takes some skill to properly setup, run and 
evaluate a usability session but I suspect the WebLion group has some of 
these skills as well as a possible test user pool.  So this might be a 
good place to start...

Sorry for the noise on the usability mailing list; I'll try to keep on 
topic.  Ed


On 10/24/2012 03:32 PM, Nathan Van Gheem wrote:
> No, that's a different purpose. We're doing user testing here to see 
> how well people interact with the prototypes we come up with.
>
> On Wed, Oct 24, 2012 at 2:22 PM, Ed Manlove <devPyPlTw at verizon.net 
> <mailto:devPyPlTw at verizon.net>> wrote:
>
>     Nathan,
>
>     Ok, I understand your goals for this type of user testing a little
>     better now.  Is this something that our new Robot
>     Framework/Selenium testing framework could help with?
>
>     Ed
>
>
>     On 10/24/2012 11:52 AM, Nathan Van Gheem wrote:
>>     Hi Ed,
>>
>>     This is more in reference to things being discussed with the UI team.
>>
>>     We're looking to provide click dummies to be tested of deco and a
>>     new contents browser widget.
>>
>>     See:
>>
>>     http://static.nathanvangheem.com/plone-conf-2012-ui-sprint/clickdummies/contentfinder/index.html
>>
>>     and
>>
>>     http://static.nathanvangheem.com/plone-conf-2012-ui-sprint/clickdummies/future-deco/
>>
>>     On Wed, Oct 24, 2012 at 10:39 AM, Ed Manlove
>>     <devPyPlTw at verizon.net <mailto:devPyPlTw at verizon.net>> wrote:
>>
>>         On 10/24/2012 09:17 AM, Nathan Van Gheem wrote:
>>
>>             Thanks Roche!
>>
>>             http://www.optimalworkshop.com/chalkmark-demo
>>               -- using only mockups instead of click dummies.
>>               -- nice walk through process for taking tests
>>
>>             I would like to either put some of our own software
>>             together to provide user testing or ask the plone
>>             foundation for some money to use a commercial tool.
>>
>>
>>         Nathan,
>>
>>         Testing of what exactly? The default out-of-box sunburst
>>         theme along with "default Plone site" of Home/Events/? ? I
>>         say this because the example above you cite shows static
>>         layouts of a homepage. Maybe you are talking more about the
>>         overlays or site properties pages, etc?
>>
>>         One problem with a single generic Plone user testing tool is
>>         the variety of design within Plone sites. I suspect the best
>>         tool will actually be someone within the community using some
>>         tools, like ClickHeat or others, and sharing their
>>         experiences along with some best practices with the
>>         community. From the experience of others we can build the
>>         community knowledge of best practices for user testing one's
>>         own custom Plone site.
>>
>>         Ed
>>
>>
>
>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.plone.org/pipermail/plone-ui/attachments/20121029/5fffd2f2/attachment.html>