The Future of Information Discovery

I recently attended the third annual workshop on Human Computer Interaction and Information retrieval ( HCIR 2009) in Washington DC together with my colleague Lina. This is the first in a series of blog posts about what happened at the workshop. First up is the keynote about the Future of Information Discovery, by Ben Shneiderman.

Ben Shneiderman, professor at the University of Maryland and founding director of the Human Computer Interaction Laboratory held the workshop keynote. He started off by talking about what he called the elephant in the room, Google. Because whenever you talk about search these days you have to talk about Google. Google has become the baseline for search and the system that users relate other search experiences to. Almost all of our customers’ users has in one way or another asked “why can’t our intranet be more like Google?” (Read more about expectations to Googlify the company in a previous blog post by Mickel. You can also download the slides to Ben Shneidermans keynote presentation.)

As Ben Shneiderman said, Google does actually do the job, finding facts work. However searching for information can be dangerous. Google does well on handling simple fact-finding tasks but we need better tools to handle other types of searches such as:

  • Extended fact finding tasks where the queries are often vague
  • Tasks involving exploration of availability where the requested results can be vague
  • Open ended browsing and problem analysis where there can be hidden assumptions
  • Mismatch between the users information needs and the available metadata which will require exhaustive searching.

One of the points that I appreciated the most in this keynote was that systems that support searching for information not only need to support simple known-item searches, which Google does well. They also need to support other things:

  • Helping users enrich query formulation
  • Expanding result management
  • Enable long-term effort
  • Enhance collaboration

I am especially pleased by this statement since these are some of the important issues that we are working with in our customer projects. You will also learn more about query formulation in one of our upcoming blog posts from HCIR.

Supporting these cases are important for supporting users in their information seeking tasks and, according to Shneiderman, this should also be done while enabling users to deal with specific cases of search, concerning:

  • Completeness – Do I have all the information on a specific topic? This is especially important in for example legal or medical cases.
  • Absence of information – proving non-existence of information is very difficult but needed when applying for a patent or registering a trademark.
  • Outliers – making unexpected connections between information and finding and learning new  things that you would not have expected to find.
  • Bridging – Connecting different disciplines with each other.

This is very important because when users search the goal is not the information itself. No users go to a search interface just for the fun of searching for information. They need the information for a purpose. Search therefore needs to support things such as decision-making, collaboration, innovation and societal improvement. Search will only be of true value to users when it not only searches the simple fact-finding tasks but when it helps users solve the real problems in the real world. And good tools can force people to reframe their thinking and see things in a different light. That is the kind of tools that we should be designing.

Findwise is attending and Publishing a Paper at HCIR 2009

I’m glad to announce that Findwise is attending HCIR 2009, Human Computer Interaction with Information Retrieval, in Washington DC on October 23. Our paper about designing for Enterprise Search has been accepted to the conference so we (Maria Johansson and Lina Westerling) are going to Washington to attend the workshop and discuss HCIR with the researchers and practitioners most prominent in this area.

HCIR is a field bridging Human Computer Interaction with Information Retrieval. The design of usable search interfaces is off course a focus area in this field.

HCIR 2009 Article

The proceedings from the workshop has already been published on the HCIR 2009 conference website. You can also download our article “Designing for Enterprise Search in a Global Organization” from the Findwise website. We hope you enjoy it.

If you have any questions or topics you would like to know more about, send us an email with a question before October 21 and we’ll take it with us to the workshop. Stay tuned for more about what happened at HCIR 2009.

Customer Service Powered by Search Technology

I was on the train, on my way to Copenhagen and UX intensive a four day seminar hosted by Adaptive Path. Looking forward to this week I was also contemplating the past year and the projects we’ve been working on. I recently finished a project at a customer service organization at a large company. The objective was to see if the agents (employees) helping customers could benefit from having a search platform. Would the search engine help the users in finding the right content to help their customers?

Our point was off course that it would, but it was up to us to prove it. And we did. The usages tests showed results better than I would have dared to hope for.

  • All users found it to be easier to search for information than browsing for it.
  • Searching helped the users not only in finding information faster, but finding information they didn’t know where to find or didn’t even know existed.
  • All users preferred using the search functionality instead of navigation for information.
  • The search functionality helped new employees learn the information they needed to know in order to help the customers, hence they were productive faster.Less time was spent asking for help from colleagues and support since users found the information they needed by searching for it.

These results are all very positive, but the most overwhelming thing for me in this project was the level of engagement from the users. They really enjoyed being a part of the evaluations, bringing feedback to the project team. They felt that they were a part of the process and this made them very positive to the change this project meant.

Change is often a hard thing in development projects. Even if the change is better for the end users of the system, the change in itself can still be problematic making people hostile to the idea, even though it is improving their situation. Involving users not only helps in creating a good product, but also in creating a good spirit around the project. I have experienced this in other projects as well. By setting up reference groups for the development process we have not only managed to get good feedback to the project but have also created a buzz about what’s happening. People are volunteering for being participants in our reference groups. This buzz spreads and creates a positive feeling about the change the project is bringing. Instead of dreading the users are welcoming the change. It’s user research at its best.

So the next time you are asking yourself why you should involve users in your project and not only business stakeholders – think about how not only the end product, but the project and the process as a whole, could benefit from this.

Designing a Good Search Experience – Summer Reading

The people at Findwise are entering vacation mode one after the other. While finishing up my projects before summer vacation I started thinking about what are the important parts of creating a good search experience. So I wanted to give you a few tips before leaving the office for the summer.

Myself and Caroline participated at Business to Buttons in Malmö in June. I met a lot of talented people and had lots of interesting conversations. One of the topics i ended up discussing the most was: Search is just search, right?

A very common opinion amongst designers is that search is just search. You put a search box in the upper right corner and then you’re done. The search engine has thought of everything else, hasn’t it? I found myself arguing about two things that are very close to my heart:

  • Choosing the righ search platform
  • Designing a good search experience

Choosing the right platform

There is a difference between search engine platforms. You just don’t go out and by one and think that’s it. “Search is fixed.” It does matter what platform you choose! Depending on your choice you can tune it in different ways to fit your needs. You don’t just install Google or any other platform for that matter, and think your done. If you do, you’re in trouble. As Caroline wrote about in a previous blogpost, most enterprise search projects with problems, have problems that are not related to the platform but to the fact that the organization does not have a strategic way of working with search.

To give you designers and other design interested people a quick start to this subject I recommend listening to a podcast from Adaptive Paths UX week 2007 where Chiara Fox talks about search and interaction design. (You can download the podcast from Itunes store for free.) It will introduce you to some of the basic things to think about when it comes to getting what you want from your search engine.

Designing a good search experience

When designing a good search experience there are lots of things you should think of. But without getting to involved in advanced filters, navigators, query suggestions and other things you first need to fix the basics. Showing relevant information in the search results. One of the most common problems I meet at new customers is search results lists that make it practically impossible for the users to understand what the result is without clicking on it. All search results look the same no matter if they’re documents, web pages, people, applications, or products. The only way for the user to understand what information they can find in the result is by clicking on it. A search application that forces the user to use pogosticking is in no way better than using poor navigation. So first you need to think about what information needs to be displayed about different types of search result. What information is relevant for a document, or for a web page?

To get you started thinking about this I recommend reading the articlefrom UIe about creating good search results. It will introduce you to some of the basics.The article describes web site search. Enterprise search is off course more complex since you have more types of sources but the basic idea is the same: Show the user the information they need.

So that was two recommendations for your reading list this summer (in case there is a rainy day or two).

If you have any question about choosing the right platform or design good search experiences please contact us. More on these topics will also come after the summer.

From the people here at Findwise, have a great vacation everyone!

Improving Findability – Is your Content Really Available to Users?

Web service award recently issued a press release stating that the web is being flooded in 2008. This flood of information is caused by the demands for availability as well as the users’ demands for finding all information possibly needed, online. So Swedish websites are being flooded with information and navigation and structure aren’t coping with the problem. And so the users can’t find the information… Time to improve findability.

I believe something has been missed here. There is a big difference between just publishing your content online to make it available to users and making it findable. Could you really say your content is available when it’s not findable? When talking about search, I always like to use the quote: “If the user can’t find the information, it’s not there.” You don’t make the information available to users just by publishing it; you also have to make the information findable.

This also has consequences for search. I usually talk about the differences between enterprise search and web search; Enterprise search being more complex with more information sources, more complex information types, where information discovery could be the goal rather than information retrieval. That’s some of the reasons why enterprise search is in need of more complex functionality such as faceted search, categorization or clustering, query suggestion, tunable ranking etc.

Perhaps we have now come so far that “ordinary web search” also is in need of this functionality to get a grip of the vast amount of content available online? At Findwise we see a tendency for our customers to want more functionality in their search applications, in order to add more value for the users of their site.

In the end it all comes down to three questions (asked by Peter Norville in his Google Tech talk)

  • Can our users find our website?
  • Can they find their way around our website?
  • Can they find our product services and information despite our website?

So, making information findable is not about providing a single way of retrieving information. Your site should be able to support several information retrieval models; browsing, searching and asking.

Importance of Interaction Design

Lately I’ve been working in a couple of projects involving big companies which has given me a lot of new experience and knowledge. One of the things I’ve realized is how important it is to have a good interaction design and how that is not always the case.

The common thing in these projects have been that the customer has already started a new IT project. As time comes to implement the search functionality, they contact us. Thus, involvement from our side is after the interaction design has been made.

Since the customers are big companies, the interaction design has been made by external consultants who usually have a long going relationship with our customer, but don’t have a great knowledge about search. When the implementation starts, we’ve discovered that the interaction design is not perfect in terms of giving the end users a great search experience. This is due to lack of knowledge about search technology and what can be made with it. Using my knowledge in the search area I can propose changes in functionality that will give a better user experience. These changes of course requires new interaction design, but since the interaction design consultants has finished their assignment, the interaction design decisions needs to be worked out by our company.

In the worst case scenario this means that the complete interaction design needs to be redone from scratch. This will not be popular for the customer which needs to pay for the same thing twice. However since we at Findwise are search experts with lots of experience from past project and dedicated people working with interaction design we know how to create a good interaction design for search.

In the end this means that the customer is happy with the end result, but hiring us to also do the interaction design would have resulted in less cost for the customer!

Basic Enterprise Search is a Commodity – Let’s Go Further! Trends for 2008

So looking ahead, what are the trends for enterprise search 2008? Well, we have already been talking about Microsoft and IBM and there are a few other vendors (such as Google and Oracle) that have presented ways to develop their enterprise search solutions (looking at clustering, categorisation, taxonomies, entity extraction, visualisation etc.). To conclude: the simple search box is soon a commodity – a search solution for enterprises has to go beyond this.

As a result, experts believe that 2008 will become a year with stronger cooperation and more strategic differentiation among the leading vendors.

BI and search is one example, search within Rich Media (video, speech and music) another. The largest vendors are looking at new ways to develop and enrich their search capabilities and acquisitions of, or cooperation with, other companies is most likely to continue.

The next trend for 2008 is something that I personally look forward to: the user revolution
Enterprise search has for a long time been focusing on technical aspects, such as ability to scale, linguistics features etc. The predicted new era uses enterprise search as a tool based on user needs. At Findwise we have rapidly become clear of this since the need for our usability expert is great. Her work focuses on the end-user, and how the technical platforms can be used to support his or her everyday work. My believe is that this perspective will bridge the gap between IT and business, making enterprise search a tool to enable information retrieval and access in new ways.

What is your opinion? Are there more things to add for the future of enterprise search the following year?

Findwise wish you all a Happy New Year and look forward hearing from you in 2008!

What Differentiates a Good Search Engine from a Bad One?

That was one of the questions the UIE research group asked themselves when conducting a study of on-site search. One of the things they discovered was that the choice of search engine was not as important as the implementation. Most of the big search vendors were found in both the top sites and the bottom sites.

So even though the choice of vendor influences what functionality you can achieve and the control you have over your content there are other things that matter, maybe even more. Because the best search engine in the world will not work for you unless you configure it properly.

According to Jared Spool there are four kinds of search results:

  • ‘Match relevant results’ – returns the exact thing you were looking for.
  • ‘Zero results’ – no relevant results found.
  • ‘Related results’ – i.e. search for a sweater and also get results for a cardigan. (If you know that a cardigan is a type of sweater you are satisfied. Otherwise you just get frustrated and wonder why you got a result for a cardigan when you searched for a sweater).
  • ‘Wacko results – the results seem to have nothing in common with your query.

So what did the best sites do according to Jared Spool and his colleagues?
They returned match relevant results, and they did not return 0 results for searches.

So how do you achieve that then? We have previously written about the importance of content refinement and information quality. But what do you do when trying to achieve good search results with your search engine? And what if you do not have the time or knowledge to do a proper content tuning process?

Well, the search logs are a good way to start. Start looking at them to identify the 100 most common searches and the results they return. Are they match relevant results? It is also a good idea to look at the searches that return zero results and see if there is anything that can be done to improve those searches as well.

Jared Spool and his colleagues at UIE mostly talk about site search for e-commerce sites. For e-commerce sites bad search results mean loss of revenue while good search results hopefully give an increase in revenue (if other things such as check out do not fail). Working with intranet search the implications are a bit different.

With intranet search solutions the searches can be more complex when information not items, is what users are searching for. It might not be as easy to just add synonyms or group similar items to achieve better search results. I believe that in such a complex information universe, proper content tuning is the key to success. But looking at the search logs is a good way for you to start. And me and my colleagues here at Findwise can always help you how to get the most out of your search solution.

Evolution of Enterprise Search

Yesterday I have had an exciting and challenging day. Caroline and I visited a new customer, a large global Swedish industrial enterprise, for whom Findwise is doing a prestudy of the customer’s search requirements. The guy, whom we met was very alert and challenged us in the evolution of enterprise search and if the technology is mature enough for “safe” project deployments. I have managed search projects throughout Europe since 2002 and today it became clear to me how the projects and hence the enterprise search technology has changed.

Back in the early days, connecting to different datasources and indexing a vast amount of different sources were the biggest problem. Most projects were managed with a focus on this and the users should be happy with what we delivered. Today connectors to most data sources as well as managing different formats are commodity. The projects have finally and gladly become user driven so my conclusion is, yes, the technique is definitely mature.

Thank you for an important insight and good challenging thoughts!