[Plone-UI] Usability testing tools

[Nathan Van Gheem]

Thanks for your thoughts Ed.

It's good to know that you have experience! Would you be interested in
helping lead up the effort in testing?

One thing I'd like to be careful of is to not make this more complicated
than it needs to be. While the setup that weblion has for usability testing
might be very good, if it's difficult to facilitate any tests with it(for
whatever reason), it's useless to us.

Right now we don't have ANY formal testing of new or existing components,
so we really just need to start doing something meaningful and provide
feedback to the right people.


Thanks,
Nathan

On Mon, Oct 29, 2012 at 7:34 AM, Ed Manlove <devPyPlTw at verizon.net> wrote:

> **
> Nathan, the example tool you noted (
> http://www.optimalworkshop.com/chalkmark-demo) is pretty interesting for
> static homepages asking what would a user click if wanting to accomplish X.
> Having worked alongside usability specialists and participating in several
> usability studies, the chalkmark tool is missing two important pieces of
> usability information for these deco/widget samples: eye or mouse tracking
> and an audio recording of the testers out-load thinking.
>
> There is such a toolset within our community in the form of the WebLion
> Video Recording Solution (
> https://weblion.tlt.psu.edu/FogBugz/default.asp?W1060). This setup
> records the screen, audio and video (?possibly two cameras?) and could be
> used to capture a usability session. This is, of course, just the hardware
> setup and it takes some skill to properly setup, run and evaluate a
> usability session but I suspect the WebLion group has some of these skills
> as well as a possible test user pool.  So this might be a good place to
> start...
>
> Sorry for the noise on the usability mailing list; I'll try to keep on
> topic.  Ed
>
>
>
> On 10/24/2012 03:32 PM, Nathan Van Gheem wrote:
>
> No, that's a different purpose. We're doing user testing here to see how
> well people interact with the prototypes we come up with.
>
> On Wed, Oct 24, 2012 at 2:22 PM, Ed Manlove <devPyPlTw at verizon.net> wrote:
>
>>  Nathan,
>>
>> Ok, I understand your goals for this type of user testing a little better
>> now.  Is this something that our new Robot Framework/Selenium testing
>> framework could help with?
>>
>> Ed
>>
>>
>> On 10/24/2012 11:52 AM, Nathan Van Gheem wrote:
>>
>> Hi Ed,
>>
>>  This is more in reference to things being discussed with the UI team.
>>
>>  We're looking to provide click dummies to be tested of deco and a new
>> contents browser widget.
>>
>>  See:
>>
>>
>> http://static.nathanvangheem.com/plone-conf-2012-ui-sprint/clickdummies/contentfinder/index.html
>>
>>  and
>>
>>
>> http://static.nathanvangheem.com/plone-conf-2012-ui-sprint/clickdummies/future-deco/
>>
>> On Wed, Oct 24, 2012 at 10:39 AM, Ed Manlove <devPyPlTw at verizon.net>wrote:
>>
>>> On 10/24/2012 09:17 AM, Nathan Van Gheem wrote:
>>>
>>>> Thanks Roche!
>>>>
>>>> http://www.optimalworkshop.com/chalkmark-demo
>>>>   -- using only mockups instead of click dummies.
>>>>   -- nice walk through process for taking tests
>>>>
>>>> I would like to either put some of our own software together to provide
>>>> user testing or ask the plone foundation for some money to use a commercial
>>>> tool.
>>>>
>>>>
>>>  Nathan,
>>>
>>> Testing of what exactly? The default out-of-box sunburst theme along
>>> with "default Plone site" of Home/Events/? ? I say this because the example
>>> above you cite shows static layouts of a homepage. Maybe you are talking
>>> more about the overlays or site properties pages, etc?
>>>
>>> One problem with a single generic Plone user testing tool is the variety
>>> of design within Plone sites. I suspect the best tool will actually be
>>> someone within the community using some tools, like ClickHeat or others,
>>> and sharing their experiences along with some best practices with the
>>> community. From the experience of others we can build the community
>>> knowledge of best practices for user testing one's own custom Plone site.
>>>
>>> Ed
>>>
>>
>>
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.plone.org/pipermail/plone-ui/attachments/20121031/61409ba8/attachment.html>