As detailed in part one I was nearing the end of the updates to my portfolio site and decided it would be a good idea to perform some user testing before going any further.
The target audience for my site is primarily web agencies I’m looking to work for, which means creative directors, studio managers and designers. At this point in time I’m not thinking about freelancing full-time or setting up my own company and so the site is solely aimed at web professionals.
With this in mind I made two assumptions about the user’s profile:
Technically
They have a modern web browser with a recent version of Flash installed, a resolution over 1024×768 and access to headphones or speakers. The site is optimised for such a person without excluding users with lower technical profiles.
Experience
They are web savvy and spend many hours a day online, they have produced or managed the production of websites and on occasion have browsed designers portfolio sites. They are familiar with a large variety of navigational styles and are comfortable with conceptually led websites.
I was fairly confident that my target audience wouldn’t have issues understanding, navigating and consuming information on my site. The user journeys and interactions hadn’t changed from the three year old portfolio site. The original’s navigation and use of typography was unusual as I took the unique opportunity to express my personal tastes and communicate with users of a similar demographic to my own.
Having worked at an agency that put usability at the core of everything it did I wanted to test that my assumptions were correct and I had created a site that worked well for its audience.
The first version of the new site:

Original site

Version 1
To test version 1 of the site I employed these user testing methods:
1) Informal user testing:
I simply asked the opinion of the site’s demographic; designers, user experience consultants, creative directors and observed how they used the site, an example of a recorded session can be found here. The sessions brought up a number of issues:
i) There is no categoratisation of the projects.
ii) The large letterforms look like active elements rather than passive graphics.
iii) The large letterforms are seen to give sections meaning (i.e. the W section contains only projects starting with the letter W).
iv) The non-linear nature of the site caused confusion.
v) The exploratory nature of the website was inappropriate for employers who need facts quickly.
2) Thinking Aloud:
This involved getting users to verbalise their thought processes as they looked around the site. I was present to answer questions but to not led the interactions. In addition to the points raised by the informal testing Thinking Aloud brought up these issues:
i) Potential employers could be concerned that I would translate the “slightly obscure” approach to site’s layout to their clients projects.
ii) It’s not immediately obvious that the menu letters are section links and are clickable.
iii) The highlight colour on a section might not be enough to indicate to the user they are within a section.
iv) It’s not clear where the contact details are.
v) Screenshots within the slideshow could be mistaken for clickable games or websites.
3) Fivesecondtest:
Fivesecondtest is a simple online usability testing application that helps identify the most prominent elements of a user interface. It presents users a single screenshots and asks them to click on areas which stand out. Firstly I ran the test on, for want of a better word, the splash screen:

Click map for splash screen
The results showed 50% of people clicked on the letterforms, 50% on the ‘Portfolio of David Gillett’ button.
I also tested one of the site’s sections.

Click map inner page
The results showed only 3% of people clicked the ‘more details’ button, 42% of people click on the characters faces, 16% of people clicked on the inactive large W, 23% of people clicked on the already active menu states in pink, 0% users clicked on the active sub menus and 0% users clicked on the external site links. These were the test’s conclusions:
i) There was some confusion over where to click on the splash screen. Although clicking on any of the letters would activate the site, any unnecessary confusion should be avoided.
ii) A large percentage of users were clicking on inactive elements of the design, confusing active and highlighted states.
iii) A tiny percentage of users noticed the link to the slideshow. Although clicking anywhere on the image would activate the slideshow any unnecessary confusion should be avoided.
iv) Images based around characters rather than screenshots would encourage interaction.
vi) Users often labeled the WORK.ME links as a logo.
vii) Some users thought the link to the slideshow would either take them to the site in question or would led to a game.
4) Userfly:
Userfly enables you to remotely record users mouse movements and clicks therefore removing any danger that one could influence their behavior. Unfortunately Userfly doesn’t work with Flash content so I had to create a simple HTML version using imagemaps.

Userfly play back feature
After playing the user sessions back they highlighted these issues:
i) One user clicked the back button to return to a previous section.
ii) Several users mistook the large screenshots in the slideshow for active games or websites.
5) Kampyle:
Kampyle is an online tool for creating custom feedback forms that ask the user to rate and comment on a site. None of the users have chosen to given written feedback yet but the site has an average rate of 4 out of 5. I intend to keep a Kample button on the site for a number of weeks after it’s launch so I can continue to gain feedback and improve the site.

Kampyle tab on the side of the website
The second version of the new site:
Clearly there were still concerns about the site’s usability and so I created another version of the site.

Version 2
To try and address some of the issues in the new version I took these actions:
i) Created a larger and more prominent button to launch the slideshow. The button would also indicated it’s action by including the word ‘Play’ or ‘Slideshow’.
ii) Removed the large graphical letters from the body area and increased the size of the preview image to simplify the design.
iii) Organised the work into clearer categories.
iv) Added a section title to indicated which category the user is in.
v) Added rollovers for the primary menu to aid navigation.
vi) Removed the splash screen.
I then conducted the same round of testing procedures as before, although much improved, clearly usability issues still remained. Further ‘Thinking Aloud’ tests revealed that even with the section title and rollovers the WORK.ME menu system was still not obvious enough. In particular the information on contacting me took too long to locate, an example of these tests can be found here.
The fivesecondtest results showed the number of people clicking on the slideshow button increased by 20% and users had started to notice the links to the external websites. A significant number of users were still clicking on the highlighted menu item, W in this case and misidentifying it as a logo or title of the site. This pointed to improved but still flawed usability.

Click map for version 2
The third version of the new site:
To address the remaining concerns I created a third and final version.

Version 3
These were it’s modifications:
i) The introduction of a traditional top navigation with the site’s sections clearly visible.
ii) The inclusion of a simple logo.
iii) The slideshow’s screenshots were presented within a computer screen surround to show they weren’t an interactive element.
iv) The client and studio the work was produced for was added to the copy for legal reasons.
A final round of Think Aloud user testing and informal feedback suggested that the all the major usability concerns had been addressed. The fivesecondtest also showed a sizable increase in the percentage of people clicking on the slideshow button and banner image. A moderate number of users were still clicking on the highlighted menu item although the Think Aloud tests showed that they quickly find the other section links.

Click map for version 3
Conclusions:
i) The simple user testing undertaken for the redesign as vastly improved the usability of the site.
ii) Although the number of users involved in the testing process was small the usability gains were significant. Jakob Nielsen has proved that 85% of usability problems can be found with just 5 users.
iii) All of the testing methods were free and relatively easy to execute. Cost, both in time and in monetary terms often wrongly put off small agencies from performing any testing at all.
iii) It’s vital to perform user testing at an early stage in the process and not once the pixel has bolted. I rebuilt rough versions of the site three times which put it’s production way off schedule.
iv) Simple wireframes and paper prototypes would have helped iron out some of the site’s issues at an earlier stage.
v) Assuming that because you have a clear idea of the site’s demographic you can judge how they will behave is folly.
In hindsight all of these points are obvious and where possible I have applied them to client’s sites in the past. When it came to my own portfolio I allowed my personal preference for an exploratory website to overshadow it’s purpose, which is to quickly show employers my work and to be contacted.
I’m currently populating the site with content and will be launching within the next two weeks.