941-685-8851

March, 2009

Website User Testing

Testing the usability of a website.

In professional web design circles, the usability testing session has become an essential component of any major project. Similar to focus groups44 in brand development and product launches, usability testing offers a rare opportunity to receive feedback from the very people the website is aimed at – before it’s too late to do anything about it.

But how can you get the most from these usability testing sessions?

1. Choosing your subjects

As with any market research project, the results will only be as good as the people you test. Do not test people from your own company, or friends and family. Go to a market research firm or temp agency and ask them to source participants to a certain profile. Make sure the market research firm does not provide the name of the company or any other details that will cloud the judgement of the participants.

2. Before the usability testing

Online poll

Other than calls and text messages, which of the following do you do most often on your mobile/cell phone?
Download ringtones
Read news or sport content
Check your email
Use social networks (Facebook etc.)
Use maps or get directions
Look for local info or transport news
None of the above

(Submit your answer and we’ll show you the results so far)

As with everything in life, first impressions are vital. Each participant must be put at ease. Remember, the usability testing session is often an extremely artificial environment and, for the most beneficial and informative results, we want them to behave as if they were using the site at home or work.

Provide clear instructions on how to get to the usability testing location, and if necessary meet the participants at local stations. Do not use terms such as ‘usability testing’ or ‘market research’, as these can confuse and put people on edge. Also, ensure that participants know how long the usability testing will take, and the type of tasks they will be expected to perform.

After the initial greeting and welcoming drinks, there are always legal forms that must be signed. It is essential that these are written in plain English, and are as short as possible. The last thing any nervous usability testing subject wants is to be given a contract that looks like they’re signing their soul away. All you want is for them to be reassured that the tests are completely confidential, and for permission to use the data generated during the test as part of our results. So tell them that.

3. Beginning the usability testing

Before diving into key tasks, get the user familiar with the environment. Tell them the website’s name and URL, and ask them for initial feedback on what they would expect from the site or what they would like the site to be. Make note of any terms or phrases they use – this not only demonstrates you are taking their feedback seriously, but may provide useful tips as to possible labels for key functionality or navigation.

Next, let them look at the website they are testing. Gauge their first impressions before allowing them to familiarise themselves with the site.

These few simple tasks will help convince the participant that the usability testing will not be difficult and, perhaps most importantly, that they’re not the ones being tested.

4. Choosing tasks

Set tasks that are essential to the new site’s success, such as:

Buying products
Paying bills
Contacting the client
Remember, you’re not looking for an ego massage. The site was built for a reason – can your target audience do what you need them to do?

It’s also a good idea to ask the user to suggest tasks. While this gives another indication of their expectations and requirements, it may suggest new functionality or priorities.

5. How to word tasks

People tend to perform more naturally if you provide them with scenarios rather than instructions. When giving them tasks, you should use phrases like ‘Scenario A has occurred, and you need to ring the company urgently – find the telephone number’. This is far better than ‘find the contact us section of the site’.

6. Presenting tasks

Only give participants one task at a time. More than this may intimidate them, or alter their approach to the test.

If the user is required to use inputs from outside the test (e.g. an email giving them a password to the site), give them these inputs in the form they will be presented. This will provide useful feedback on all elements of the process, rather than simply the site.

7. How to behave during the usability testing

It’s essential that you remember that it’s the website that is being tested, not you or the subject. Any feedback you get is valuable – make sure the participant knows this. If they can’t do something, make sure they know it’s not their fault.

You must stay quiet and out of sight during the test. You must not alter the test results by providing clues, suggesting directions or by reacting to things they say or do. All feedback you give must be neutral. Do not start shaking your head or huffing, however tempting it might be!

The only time you should speak is to help the participant give an opinion, or to clarify a response. If in doubt, shut up!

Given the investment made in the project, clients often find it difficult to be quiet during tests. If your client wants to be present, put them in another room with an audio/video link.

8. After the usability testing

After all the tasks have been completed, you should gather as much information as possible. Asking for overall impressions of the site will allow you to judge whether expectations have been met, and whether the participant’s view of the client or site has changed during the process.

Always ask for suggestions – this not only demonstrates the value you place on their thoughts, but may provide insights into how the site can better support the user.

Finally, ask the participant what they remember about the site structure and functions of the site. Clear recollection will confirm that the site is structured logically and help identify any labelling issues you may have missed.

Share
 

Music Production Performance Royalties

Performance Royalties
How are performance royalties tracked and calculated? Remember that performance royalties are tracked and paid out by the performance rights organizations like ASCAP, BMI, SESAC, and SoundExchange.

The royalty trail begins when the song is registered with one of the three performing rights organizations mentioned above. Once a song is registered, it becomes part of that PRO’s collection and is available to all of its users. Most of those users have a “blanket license” to use any or all of the PRO’s music, however some users license on a per program basis and only pay for the music they actually use. (This is good for users who don’t use that much music.) The PROs deduct money for their operating expenses and the rest goes to the songwriters and publishers.

PRO customers include just about anyone who plays music in a public place — even those who play “hold” music for their business. These include television networks, cable television stations, radio stations, background music services like MUZAK, colleges and universities, concert presenters, symphony orchestras, Web sites, bars, restaurants, hotels, theme parks, skating rinks, bowling alleys, circuses, you name it — if they play music, they have to have a license and pay royalties.

Tracking the playlists
The difficult thing to imagine in all of this is how these organizations track all of that music to get an accurate record of how much royalty money needs to be paid to which songwriters and publishers. Each of the PROs use a slightly different system for calculations; we’ll use the ASCAP system as an example. ASCAP uses two methods for determining performances: it either counts them or does a sample survey.

For television performances, ASCAP depends on cue sheets that program producers provide them, as well as program schedules, network and station logs, and even tapes of the broadcasts. ASCAP developed its own computer program to help studios and program producers report performances.

For radio performances, ASCAP does a sample survey of all radio stations, including college stations and public radio. To do this, it uses a digital tracking system, station logs provided by the radio stations, and recordings of the actual broadcasts.

For live performances, ASCAP reviews set lists provided by concert promoters, performing artists, and others. In the case of symphony performance information, the printed programs are submitted.

Licensed Internet sites, circuses, theme parks, etc. provide ASCAP with their own music use data.

Others that use music, like restaurants and bars, are not surveyed and simply pay a flat rate that is distributed based on trends in local radio stations (based on the type of music).

Show me the money!
ASCAP’s royalty calculations are based on a system of credits. Here is an example of how the money is calculated based on the ASCAP system.

First, some general information: ASCAP weights different factors in order to come up with a song’s total “credits” and a fair royalty calculation. For example, the song is weighted based on the type of performance (theme, underscore, or promotional); this is known as the use weight. A song that is featured and sung by a recording artist on TV or radio gets more weight than one that was played as background music during a radio commercial. The licensee (radio station, TV station, etc.) is weighted based on its licensing fee, which in turn is based on the licensee’s markets and number of stations carrying its broadcast signal. There is a weight applied to the time of day the music is performed (particularly in television). Music played during peak view/listener times receives more weight.

ASCAP also uses a follow the dollar factor, which means that songwriters and publishers are paid based on the medium from which the money came. For example, money paid out from radio stations is paid for radio performances. A general licensing allocation is figured for fees that ASCAP collects from bars, hotels and other non-broadcast licensees. These fees are distributed to songwriters and publishers based on similar radio and TV broadcasts of the individual songs. In other words, they estimate that restaurants and bars are playing the songs at a similar rate as the local radio and TV stations.

Here is an example of the calculation that ASCAP uses to determine the number of credits a song title has:

Use weight
X
Licensee weight
X
“Follow the dollar” weight
X
“Time of day” weight
X
“General licensing allocation”
+
Any radio feature premium credits (bonus credits for top played songs that reach a specific threshold within a quarter)
= Total number of credits

The total number of credits is multiplied by the shares for the song (how the royalties are split between writers and publishers). This number is multiplied by the credit value for the song. The value of one credit (credit value) is arrived at by dividing the total number of credits for all writers and publishers by the total amount of money available for distribution for that quarter. For example, if there are a total of 10 million credits for a quarter, and there have been 35 million dollars collected for distribution that quarter, then the value of one credit for that quarter is $3.50.

The final number is the royalty payment. Here is how it works:

4,000 Credits
X
50% (.5) Share
X
$3.50 Credit Value
=
$7,000 Royalty payment

Royalty payments are made quarterly.

These calculations are quite difficult and vary somewhat between each of the three PROs. Visit their Web sites (links are the end of this article) for additional information on how these royalty payments are calculated.

Internet royalties
For Webcasts and other digital performances, SoundExchange was formed to collect and distribute those performance royalties. Just as in traditional media, broadcasters of digital performances of music must pay royalties to the songwriters and publishers of the music they play. Because of the Digital Performance Right in Sound Recordings Act of 1995, however, they must also pay royalties to the recording artists. SoundExchange collects electronic play logs from cable and satellite subscription services, non-interactive webcasters, and satellite radio stations. They then distribute the royalty payments directly to artists and recording copyright owners (usually record labels) based on those logs.

Share