Tag Archives: usability testing

Dartmouth Hitchcock Medical Center

Screenshot of DHMC Quality Reports page

I have consulted on a number of projects for the Dartmouth Hitchcock Medical Center, or DHMC. These projects have been great learning experiences for me. Unlike many organizations, DHMC is committed to user-centered design. I was given support for user research, both with resources and timelines. And most importantly, when it came time to make design decisions, user research was the guide.

The most interesting and challenging project that I did for DHMC was the design and usability for their Quality Reports feature. Quality Reports offers comparative data on how DMHC measures up across a variety of diseases, procedures, and cost comparisons. In 2003, DHMC was just beginning to plan for a rollout of this new and innovative feature. They wanted to provide the information in the best, most useful format possible. That’s where I came in—and where user-centered design played a key role.

The team at DHMC had several different elements in mind for presenting the reports: checkmarks indicating how DHMC was measuring against their quality goals; the data itself, and the comparison data; and explanations of the measures, so that readers would understand the significance of, for example, “aspirin at arrival.”

Screenshot of Quality Reports detail page

I developed several different functional mock-ups of the reports, each one combining the elements in different ways. I then did user testing to determine which approach resonated best with DHMC patients, looking for things like:

  • Did people react to the information/visual density of the interface?
  • Did they read the narrative text?
  • Did they like having the comparative data?
  • Did they like the checkmarks?

The most impactful thing we learned was that the scorecard approach, with only checkmarks, was too simplistic. Testing participants preferred access to the data and comprehensive descriptive information. Also, in examining quality reports, participants wanted to learn more generally about the conditions measured.

The interface for Quality Reports is a scorecard of sorts, but with data rather than checkmarks. Each measure includes a brief description, and is linked to a more complete description and data graph. Also, patients can access health information about conditions from the Quality Reports pages.

As of this writing, the designs I created for DHMC, including the home page, are still in use.

Dartmouth Home

Screenshot of Dartmouth homepage

In my time at Dartmouth I have been responsible for three homepage designs. For the most recent version, launched in August of 2006, I collaborated with colleagues in the Office of Public Affairs. We formed a working group called The HomeTeam, established oversight with senior leadership of the College, and embarked on six months of user research, followed by two months of informed design.

We decided early on that we did not want to “tell and sell” Dartmouth. Effectively representing Dartmouth online could not be achieved through static, official narrative. Instead we sought ways to “show” the Dartmouth Experience. We opted to use the site as a news source, highlighting the “now” of Dartmouth through stories, events, and features. While the Dartmouth homepage requires daily care and feeding, it serves an important role in representing the vibrancy of the College, both internally and to the world at large.

Another thing we recognized early on was that the success of the site depended on engaging the Dartmouth community in the design process. People at Dartmouth use the homepage as their portal to information, activities, and tools that are part of their work. If the homepage did not serve their needs, we would be introducing a frustration into their daily lives.

Screenshot of Customize Quicklinks page
The Dartmouth homepage allows users to create a custom set of QuickLinks on the home page, providing easy access to commonly used website and applications.

We spent a good deal of time talking to the community about their needs, checking in through Web Town Meetings to share design ideas and gather feedback, and posting our work and progress and requesting feedback through the HomeTeam website.

For the design, we used a flexible, three-column layout with a full-width photo at the top of the page, similar to a newspaper layout. The widescreen aspect of the photos can be challenging, but the College photographer has a wonderful eye for wide shots.

As of this writing, the design we launched in 2006 is still Dartmouth’s homepage. Five years is an eternity on the web, with its shifting design trends. While I expect a redesign within the next year or so, the current design still serves Dartmouth well, thanks in large part to the good work of its editors who keep the content and images fresh and interesting.

Undergraduate Admissions

Screenshot of Dartmouth Admissions home page

As Dartmouth’s Web Director, my responsibility is to manage and coordinate all development of Dartmouth’s digital environment. Admissions is an important property in that environment. When it came time for a redesign, I persuaded Admissions to work with my in-house group, Web Services, rather than outsource the project.

Having won Admissions as a client over external vendors, I was under pressure to deliver a service that would be comparable. However, because of my broader role at Dartmouth, I had to develop the site within the greater context of the Dartmouth web. The entire process required that I perform a careful balancing act of responding to requests while adhering to institutional standards and meeting user needs.

When it comes time for decision-making in the design process, I have found the best approach is to let users drive the process. User-centered design takes the decision making out of the hands of the designers and stakeholders, and instead allows user needs and preference direct decision-making.

We started the process with usability testing of a range of admissions sites at other institutions. We wanted to see how prospective students approach the process of finding a good match in very different contexts.

In observing about 5–6 high school students it became clear that the process of finding a good school was very similar to that of finding a good partner. Prospective students first determine whether they are right for the school by looking for data, such as average test scores of admitted students. If they pass the “fittedness” test, then they explore whether the school is right for them—the location, whether it offers a major in their field of interest, athletics and arts offerings. If the school passes the test, then they look to the application process.

As a result, our strategy was to provide prospective students and parents with data right up front. The current site has “Facts” front and center, complemented by images, videos, narrative, and stories that demonstrate that Dartmouth students are admitted for more than their ability to do well on standardized tests.

The information design supports the natural process flow, with the “Facts” and “Learn” sections providing ample opportunities for prospective students to determine whether they are right for Dartmouth, and whether Dartmouth right for them. The “Visit” section supports the next phase in the process, providing information and opportunities for both virtual and physical campus visits. And the “Apply” section is the final step in the process, with information and functionality to support prospectives who have decided to take the plunge and become applicants. In April, when decisions have been made and applicants have been notified, the architecture also supports admitted students with a “Class of 20XX” section. The site also has an “Answers” section that answers commonly asked questions.

Supporting these more practical needs is the “Perspectives” section. Here is where we attempt to communicate the richness of the study body through a variety of first-hand perspectives on the Dartmouth experience, through interviews, student blogs, live office hours, and more. This section aims to accomplish a challenging task: to provide authentic stories within the context of an official admissions website. We continually explore which means of communication is the most useful, impactful and, most importantly, credible to prospective students.

Screenshot of Dartmouth Experiences page

The visual design is modeled on a flexible, grid-based layout. I generally build flexible, or “liquid,” layouts, but this was the first time I did so on a grid, and the result provides the best of both worlds. The page elements harmonize, and yet they scale to accommodate different window widths and text sizes. And the line length cannot become too long since the layout is restricted to a generous but readable maximum width.

All of Dartmouth’s sites are built on the same codebase, so the Admissions site uses mostly the same code as, for example, Classics, Budget, and the Office of the President. This architecture allows for site-wide changes, such as the inclusion of an emergency banner on all sites in case of an emergency. It also allows a small team of web professionals to provide support to all Dartmouth departments and programs. On the down side, it limits design options.

For Undergraduate Admissions, I used the standard codebase with only one modification — the header area contains additional elements. I made extensive use of CSS3 properties, including color transparency, transition effects, and radius properties. Since not all browsers support CSS3, I coded these elements to degrade gracefully in browsers that do not provide CSS3 support. I also used JavaScript and the JQuery library to enhance the navigation experience, but users who visit the site without JavaScript have fully functional navigation.