[prev in list] [next in list] [prev in thread] [next in thread] 

List:       kde-usability
Subject:    Re: A collaborative UI testing process?
From:       Jim Conner <jconner83 () yahoo ! com>
Date:       2001-07-31 0:38:01
[Download RAW message or body]

Sounds good.  One thing that will need to be standardized is the way that kde 
is setup.  
 - Where the Kicker is located
 - What icons are located on the Kicker
 - What theme, widget set and decoration are used.
 - What icons are on the desktop

This way each user that takes the test will be seeing the same thing.  Those 
administering the test can add a new user and set it up for testing.

Jim

On Monday July 30, 2001 11:26 pm, Charles de Miramon wrote:
> Hello all,
> I've been daydreaming over the week-end of how we could proceed with the
> following constraints :
> - The final product should be similar to the Gnome Usability test
> - We have to do it in a collaborative way over the Net
> - The work should be divided in small morcels
> - We should have a good framework to harmonize the contributions of
> everybody - start small but on good fondations
> - Have a scientific method so developpers will be more easily convinced to
> implement our recommendations.
>
>
> 1) Preliminary Phase
>
> a) A Web specialist (Jono ?) drafts a DTD for writing questions and reports
> b) Somebody well-read in Usability Testing (Jennifer ?) writes a "How to be
> a good tester" (what to observe, what to note, what to discard) so we all
> test the same way, reporting the same kind of information.
> c) If we want to have a (pseudo)-scientific method we should think of what
> kind of sample of users we want to test. We should draft some quantitatives
> rules (not only eighty years old grandmothers, not only Windows Office
> powerusers, not only Americans, etc...)
>
>
> 2) Creating the test suite
>
> -We should then use the DTD to create questions for our first test. We
> could just copy the Gnome one for a starting point. The test should not
> last longer than 3/4 hour to administer.
> - Every question gets a tag on our question database on usability.kde.org
> - Jono puts the the test-suite on usability.kde.org
>
>
> 3) Testing time
>
> - Everybody download the test-suit
> - We find people to test. We start the test by asking preliminary questions
> to know the type of user we are delaing with then we administer the suite
> - We write down our observations following the guidelines in the Howto
> - We load the answers, question by question, on usability.kde.org
>
>
> 4) Reporting time
>
> - When there is enough answers to meet our test sample. The questions go to
> a 'pending' status and you unable to upload anymore answers on the Web
> site. Why that, because testing is the fun part and we don't want to be
> drowned with information making writing reports a burden.
> - Everybody can download a pending question with all the answers. The
> question goes in a 'super-pending' status and you have one week to write a
> report or it goes back to a 'pending' status.
> - You write a report based on the answers giving a résumé of the input of
> the tested and giving a recommendation of what to do.
> - You upload your report on the web site, the question has now a 'closed'
> status
>
>
> 5) Publishing time
>
> - Our webmaster (Jono ?) collects all the closed questions and give every
> recommendation a number in the UI-bug database.
> - We assemble all the closed questions and publish the whole on dot.kde.org
> lists.kde.org, etc.
>
>
> 6) Developper time
>
> - We'll ask developpers not to answer in general but to answer each UI-bug
> either to close it, to tackle it, to comment it (it is technically
> impossible to do), etc..
>
> We start again... drafting new questions....
>
> As I'm not a Web designer, maybe I'm designing here a nightmare...
> Please comment.
> Cheers,
> Charles de Miramon
> _______________________________________________
> kde-usability mailing list
> kde-usability@master.kde.org
> http://master.kde.org/mailman/listinfo/kde-usability

-- 
 
  6:42pm  up 6 days, 19:16,  2 users,  load average: 0.00, 0.00, 0.00
------------------------------------------------------------------------
Running Caldera eD2.4 - Linux - because life is too short for reboots...

_________________________________________________________
Do You Yahoo!?
Get your free @yahoo.com address at http://mail.yahoo.com

_______________________________________________
kde-usability mailing list
kde-usability@master.kde.org
http://master.kde.org/mailman/listinfo/kde-usability

[prev in list] [next in list] [prev in thread] [next in thread]