Testing usability

April 18th, 2007 by Wendy Pollock

We were at Museums & the Web in San Francisco last week, getting feedback on ExhibitFiles in the usability lab. Many thanks to Michael Twidale and Paul Marty, who led the process, and Richard Urban, who played the role of user. We’re taking their comments into account in some last-minute adjustments we’re making to the beta site before opening next week. Meanwhile, the core group that’s been advising on development has started setting up accounts and posting case studies and reviews (and reporting bugs), so new users will be able to explore before jumping in. We already have a mix of old and new, large and small, funky and classic, science and art, with more in the works. We hope to see you on the site, Monday, April 23, when ExhibitFiles goes live.

April 23 ExhibitFiles BETA launch

March 22nd, 2007 by Wendy Pollock

We’ve set the date. On April 23rd the ExhibitFiles website will be publicly available. Over the last nine months, we’ve shared part of the process with you via this blog. Now, in a month, you’ll be able to see (and participate in) ExhibitFiles for yourself. We appreciate all of the comments and suggestions we’ve received during this process; they have helped us improve the site’s design and functionality. Randi Korn & Associates will be carrying out a formal evaluation of the site during the summer, but meanwhile we hope you’ll continue to send your comments.
Once ExhibitFiles launches, we’ll continue to publish news here for the first few months as we consider whether and how to continue the blog. Meanwhile, we look forward to seeing you online in April!

East Coast Design Meeting

March 7th, 2007 by Jim Spadaccini

Site Structure 4.0
It’s been a while since we’ve posted anything on the blog, but we wanted to bring you up-to-date on our design process. In mid-February, we met at ASTC headquarters in Washington for a day-long meeting to review the ALPHA site.

Our core team has been working with the ALPHA build for the last few weeks, and their comments have helped us fine tune the structure of the site as work toward BETA. (The latest site diagram above is available as a PDF.) One of our main concerns has been to make this site as responsive to the needs and ways of working of exhibit practitioners — including time constraints. So we’ve been simplying and clarifying while working out bugs. Work has begun on the final phase which will lead to a BETA release. We’ll be publishing that release date soon.

Almost ALPHA

December 14th, 2006 by Jim Spadaccini

We’ve been hard at work building out some of the major features of the site. However, there’s not much we can share during this part of the process, so we haven’t been blogging.

We have made great progress, we have functional forms and a database that is collecting information. We’ll soon be adding the ability to comment and we’re still, of course, squashing bugs. The ALPHA site will be available in early January. We will post a message, and at that time, you can email us for access to try the site out.

Ruby on Rails (the framework that we are using to build the site) presented some challenges at first, but we are becoming increasingly confortable in the environment. Overall, it does some things really well, while other tasks have been made more difficult. The rails community online has been helpful, posts like Things You Shouldn’t Be Doing in Rails have helped us work through some unexpected problems.

The ALPHA site will run for the entire month of January. During that month we’ll be working on finalizing design details and looking at how to best present, search, and sort the information in the collection. In our next post, we’ll invite you to check out the ALPHA.

ExhibitFiles structure emerges

October 23rd, 2006 by Jim Spadaccini

This site diagram (site diagram v2 PDF) illustrates the relationship between the various components of the proposed ExhibitFiles site. Since one of the key functions of the site is to “include shared records of exhibition descriptions,” the ability to add, browse, and search these records is a major part of the site structure. So far the design process has focused on the elements that make up these individual records. (See blog posts, “Personal Profiles” and “Case Studies and Reviews“).

Beyond the specifics, our discussions have focused on what is the “right amount” of information. Too much and users won’t want to add case studies or reviews, too little and we might be omitting important information. Obviously, we need to meet the needs of the members of the ExhibitFiles site. A major and ongoing concern has been how can we best encourage active participation.

Wendy’s last post, Tapping the wisdom of the crowd, explained in detail the concept of drawing ISEN-ASTC-L messages directly into the ExhibitFiles site. This is not the only place that ExhibitFiles members will have opportunities to converse. Comments (and ratings) can be added to any case study or review. Trying to anticipate conversation in a complex social site is difficult, so we intend to see how things go and make some adjustments as the site is launched and these conversations begin.

In our Berkeley design meeting, the issue of “ratings” was discussed and, for the most part, participants were concerned that employing such a system could trivialize contributions to the site. It was agreed that rating systems such as the starred Yahoo! ratings for news stories would not be appropriate in this environment.

As an alternative, we looked to favorites as way to sort reviews, case studies, and other content on the ExhibitFiles site. As members add items to their own favorites, a record of that addition will be associated with that item, so reviews or case studies that are favorited by many users could be presented in some way (e.g., most favorited). Also, each member’s list of favorites can be useful for others, in the same way the del.icio.us bookmarks can be made available to all members.

As our discussion progressed, we revisited the concept of “ratings.” This was due in part to addition of the ISEN-ASTC-L component. Having a way for ExhibitFiles members to help sort the messages that are most relevant to the site is essential, since not all of the messages on the Listserv are directly related to exhibit design. The example of Digg in which visitors give a simple thumbs up or thumbs down to content items as way to sort was discussed, as was Amazon’s Was this review helpful to you? Yes or No feature.

We’re looking to add a similar feature: “Did you find this useful? Yes or No.” This simple Yes/No rating along with favorites will help “score” the Listserv messages as well as case studies and reviews. While ratings won’t be the only way to browse (and search?) the ExhibitFiles content, having some methods for letting the community decide what information is most useful is important. We hope to have a large collection of records and conversations about exhibit design, so community members will need various methods to find the materials that are important to them.

After months of discussion and review we’re finally getting to the point of building out components of the ExhibitFiles site. While the pace will pick up dramatically over the next few weeks, we’re still very interested in your comments and ideas. The current push is for our first build to be ready in January 2007. We will be taking a look at the site again in late spring once the first members begin to contribute and use the site. As we design and develop elements for the ExhibitFiles, we’ll be posting page grids and other diagrams on this blog. As always, we welcome your comments and questions.

Tapping the wisdom of the crowd

October 17th, 2006 by Wendy Pollock

Earlier discussion about the relationship between ExhibitFiles and the ISEN-ASTC-L list got us thinking. Paul Orselli notes that topics recur and wonders whether we could create an FAQ or resource drawn from the list archive. Like Paul, we wondered whether there is a way to integrate ExhibitFiles and the list, with its well-established community of 1,370+ members. And then: Is there a way to tap the collective wisdom of the exhibit community to add value to the discussions already happening on the list? We’ve come up with these ideas:

  • Draw ISEN-ASTC-L messages directly into the ExhibitFiles site, identifying threads and perhaps adding photos for registered ExhibitFiles users. (We would notify ISEN-ASTC-L subscribers, of course, and also encourage them to register as ExhibitFiles users.)
  • Add a simple rating system: “Did you find this message useful? Yes or No
  • Enable registered ExhibitFiles users to add messages (and threads) to a list of “favorites” within their profiles

These ratings would then help sift out what’s of most lasting interest and make it available for others.

Andrea Bandelli (drawing on James Surowiecki’s Wisdom of Crowds) has reflected elsewhere about the qualities that make a crowd “smart.” “It needs to be diverse, so that people are bringing different pieces of information to the table. It needs to be decentralized, so that no one at the top is dictating the crowd’s answer. It needs a way of summarizing people’s opinion into one collective verdict. And the people in the crowd need to be independent, so that they pay attention mostly to their own information, not worrying about what everyone around them thinks.”

We hope that the design approach we envision will help us, collectively, tap the wisdom of the exhibit “crowd.”

Case Studies and Reviews

September 7th, 2006 by Jim Spadaccini

In looking to collect materials about the exhibit/exhibition design process we found ourselves focusing on case studies and reviews. Case studies will be descriptions of projects that a contributor worked on, while reviews are descriptions of exhibits/exhibitions that a contributor observed.

This idea originated in the design workshop in Berkeley in June, and it has stuck with us ever since. There was some discussion that reviews might seem too formal, but given the changing nature of the term it seems appropriate. Afterall, anyone can write a review on Amazon or similar sites.

The use of the terms exhibit and exhibition was also discussed. Exhibit for some, can mean an entire exhibition. To be clear, our use of the term exhibit denotes an individual exhibition component, while the term exhibition refers to a collection of exhibits. For the ExhibitFiles site, we’re looking to collect case studies and reviews on both exhibits and larger exhibitions.

We’ve outlined the following “path” members would use as they begin the process of adding content to the ExhibitFiles site….
—

What would you like to add to
ExhibitFiles?

A case study
of an individual exhibit
or an entire exhibition
that I worked on.

A review
of an individual exhibit
or an entire exhibition
that I saw in person.

By making a selection, a member would then go to the appropriate form. We’ve tried to make the language as clear as possible. Case studies are to be authored by someone involved in the development process. Reviews should be authored by individuals who have actually seen the exhibit or exhibition (not just those who’ve read the case study).

Below check out the PDF that includes details of the basic mockups of the forms. This is a working document, these are not final designs. We’d appreciate any comments that you might have.

Case Studies and Reviews v.6 (PDF 260k)

Personal Profiles

August 28th, 2006 by Jim Spadaccini

Since ExhibitFiles will be a community-built website, it was decided early on to require a membership (it will be free) for authoring and commenting. Since our design workshop, we’ve been actively exploring how we might structure “personal profiles” within the ExhibitFiles community.Based on the comments from the design workshop and our group of advisors, we’ve outlined the following elements as part of ExhibitFiles profile:—-NameWhat I do, where I workWhat I’ve done in the past (multiple-no more than five)City, State, CountryEmailExhibitFiles password (repeat password)Website(s) (multiple-no more than three)More about me (text area)My image (upload a JPEG or PNG)Resume and/or portfolio (upload a PDF, doc, or URL)What I’ve added to ExhibitFiles (automatically populates once a user adds content to the site)Things I’ve bookmarked in ExhibitFiles (automatically populates once a user bookmarks files in the site)Terms of Use, Privacy Policy, Email Use Agreement (check box)—–The purpose of the profiles is to allow ExhibitFile members to connect with each other, but also to learn from one another. We’re hoping that the “What I’ve added to ExhibitFiles” and “Things I’ve bookmarked in ExhibitFiles” will provide additional ways to access the “records” (the content of the ExhibitFiles site).Finding a balance between enough information and too much is an ongoing challenge in planning for the site. Too much and no one will want to fill in lengthy forms, not enough and we may be leaving out valuable information.The profiles (and language used) are intentionally informal and brief. We’re hoping that ExhibitFiles users will post additional information (resumes and porfolios) and/or link to additional sources using the “Website(s)” element. We’re not looking to recreate LinkedIn (who were part of our Competitive Analysis), but rather to create profiles that have a balance between professional in and personal information.As always, if you have any comments or suggestions, please feel free to post them here.

Front-end study: a commitment to the common good

August 14th, 2006 by Wendy Pollock

Exhibits people have been giving generously of their time to advise about development of the ExhibitFiles site. Earlier this year, 17 of them spoke with interviewers from Randi Korn & Associates about the exhibit development process, the resources they draw on in their work, and what they’d find useful in this new site.

Most striking to me is their extraordinary generosity of spirit. Most said they would be willing to share descriptions, photos, evaluations, lessons learned, final budgets, and other material. The reasons for their willingness to share: a commitment to collegiality and collaboration and, to quote the report, “a desire to build a learning community and avoid reinventing the wheel.” We look forward to hearing from others about what they would find useful, and ways they hope to contribute.

Front-End Study (PDF 163K)

Design Workshop

July 26th, 2006 by Jim Spadaccini

As part of the ExhibitFiles design process, we conducted a workshop at the Lawrence Hall of Science, Berkeley, California, June 13-14, 2006. Most of the workshop participants were exhibit developers, the primary users of the website.

We focused on potential features of the ExhibitFiles site. Card sorting, free-listing, and a lot of discussion over the two days really helped move our thinking along.

We’ve captured some of the results from this meeting in a Design Workshop Document (880K PDF). As always, your comments and questions are welcomed.