The search experience in SharePoint 2013: customised or targeted?

This post is the fourth in a series of four articles providing several best practices on how to implement and customise the search experience in SharePoint 2013. The previous posts listed the differences between the cloud and on-premise SharePoint, provided considerations when upgrading to SharePoint 2013, and dealt with the practicalities of configuring search in SharePoint Online. This fourth post handles the more advanced topic of ranking results and the future of search in SharePoint.

Managing ranking

We’ve previously mentioned the query rules as a way to change the ranking of the search results based on your requirements. These allow the promotion of certain search results or search result blocks on top of the ranked searched results, and more advanced query rules allow even changing the ranking of the search results based on what the query terms are.

By using query rules, customising the search results web part, and a few content by search web parts, you can change the behaviour of the search depending on what user is accessing it. That is, you would also need good metadata to make this work, but having a complete user profile (including the job title, department, and interests) is a good start. Based on such user information, you can define how the search experience for that user will be.

Changing ranking using query rules, however, requires a query rule condition, which describes the prerequisites that the query must fulfil in order for the query rule to fire. For changing the results for all queries, you can use the next approach.

If the default ranking does not satisfy your search requirements and you want to change the order of the ranked search results, SharePoint provides the possibility of changing the ranking models. It is a feature available in SharePoint Online as well, as described in the TechNet documentation: “SharePoint Online customers need to download and install the free Rank Model Tuning App in order to create and customize ranking models.”

A ranking model contains the features and corresponding weights that are used in calculating a score for each search result. Changing the ranking models might require a deeper and theoretical knowledge of how search works, and those that take the challenge of changing the ranking model are often dedicated search administrators or external specialised consultants.

The Ranking Model Tuning app is free on the App Store - http://office.microsoft.com/en-001/store/ranking-model-tuning-WA104192565.aspx

The Ranking Model Tuning app is free on the App Store

The Rank Model Tuning App provides a user interface for creating custom ranking models, and can be used for both SharePoint Online and SharePoint Server, though in SharePoint 2013 Server there is also the possibility to use PowerShell to customise ranking models. New models are based on existing ranking models for which you can add or remove new rank features and tune the weight of a rank feature. It also allows for evaluating the new ranking model using a test set of queries. The set of test queries can be constructed from real queries made by users that can be gathered from previous search logs, for example. How to use the tuning app is explained step-by-step in the documentation on the Office site.

Changing the weight of certain file types (say for example for PowerPoint documents compared to Excel documents) might be enough for many search implementations, but depending on the content, the features that influence the ranking of the search results can become more elaborate. For example, a property defining whether documents are either official or work-in-progress might become an important factor in determining the ranking of search results. SharePoint provides the liberty to create new properties, so it makes sense that these can be used in search to improve the relevance.

It should be pointed out, however, that changing the ranking model influences all searches that are run using that ranking model. Though the main idea of changing the ranking model is to improve the ranking, it can become much too easy to make changes that can have an undesirable effect on the ranking. This is why a proper evaluation of ranking changes needs to be part of your plan for improving search relevance.

The office graph and the future of social

The social features introduced in SharePoint 2013 provide a rich social experience, which is interconnected with the search experience. Many social features are driven by search (such as the recommendations for which people or documents to follow), and social factors also affect the search (such as finding the right expertise from conversations in your network).

In the month of June 2012 Microsoft acquired the social enterprise platform Yammer. The SharePoint Server 2013 Preview has been made available for download since July 2012, and it reached Release to Manufacturing (RTM) in October the same year. The new SharePoint 2013 implements new social features (see for example the newsfeed, the new mysites and the tagging system), many of which are overlapping with those available in Yammer! This brings us to the question on everyone’s mind since the acquisition of Yammer: what is the future of social in SharePoint? Should you use SharePoint’s social features or use Yammer?

In March 2014, Microsoft announced that they will not include new features in the SharePoint Social but rather invest in the integration between Yammer and Office 365. The guidance is thus to go for Yammer.

“Go Yammer! While we’re committed to another on-premises release of SharePoint Server—and we’ll maintain its social capabilities—we don’t plan on adding new social features. Our investments in social will be focused on Yammer and Office 365” – Jared Spataro, Microsoft Office blog

Also at the SharePoint conference this March 2014, Microsoft introduced the Office Graph, and with it Oslo as the first app demo using it. During the keynote, Microsoft mentions that the Office Graph is “perhaps the biggest idea we’ve had since the beginning of SharePoint”. The office graph maps relationships between people, the documents they authored, the likes and posts they made, and the emails they received; it’s actually an extension of Yammer’s enterprise graph. The Oslo application is leveraging the graph, in a way that looks familiar from Facebook’s graph search.

The Office Graph, connecting people and information - Microsoft Office Blog http://blogs.office.com/2014/03/03/work-like-a-network-enterprise-social-and-the-future-of-work/

The Office Graph, connecting people and information – Microsoft Office Blog

The new Office Graph provides exciting opportunities, and has consequences for how the search will be used. Findwise started exploring the area of enterprise graph search before Microsoft announced the Office Graph – see our post about the Enterprise Graph Search from January 2013.

Reluctant to go for the cloud?

Microsoft has hinted during the SharePoint conference keynote in March that they will be adding new functionalities to the cloud version first. Although they are still committed to another version of SharePoint server, new updates might come at a slower pace for the on-premise version. However, Microsoft also announced that with the SharePoint SP1 there is a new functionality in the administrative interface: a hybrid setting which allows you to specify whether you want the social component in the cloud/Yammer, or your documents on OneDrive, so that you don’t need to move everything to the cloud overnight.

Let us know how far you’ve come with your SharePoint implementation! Contact us if you need help in deciding which version of SharePoint to choose, need help with tuning search relevance, have questions about improving search, or would like to work with us to reach the next level of findability.

Search in SharePoint 2010

This week there has been a lot of buzz about Microsoft’s launch of SharePoint 2010 and Office 2010. Since SharePoint 2007 has been the quickest growing server product in the history of Microsoft, the expectations on SharePoint 2010 are tremendous. And also great expectations for search in Sharepoint 2010

Apart from a great deal of possibilities when it comes to content creation, collaboration and networking, easy business intelligence etc. the launch also holds another promise: that of even better capabilities for search in Sharepoint 2010 (with the integration of FAST).

Since Microsoft acquired FAST in 2008, there have been a lot of speculations about what the future SharePoint versions may include in terms of search. And since Microsoft announced that they will drop their Linux and UNIX versions in order to focus on higher innovation speed, Microsoft customer are expecting something more than the regular. In an early phase it was also clear that Microsoft is eager to take market shares from the growing market in internet business.

So, simply put, the solutions that Microsoft now provide in terms of search is solutions for Business productivity (where the truly sophisticated search capabilities are available if you have Enterprise CAL-licenses, i.e. you pay for the number of users you have) and Internet Sites (where the pricing is based on the number of servers). These can then be used in a number of scenarios, all dependent on the business and end-user needs.
Microsoft has chosen to describe it like this:

  • Foundation” is, briefly put, basic SharePoint search (Site Search).
  • Standard” adds collaboration features to the “Foundation” edition and allows it to tie into repositories outside of SharePoint.
  • Enterprise ” adds a number of capabilities, previously only available through FAST licenses, such as contextual search (recognition of departments, names, geographies etc), ability to tag meta data to unstructured content, more scalability etc.

I’m not going to go into detail, rather just conclude that the more Microsoft technology the company or organization already use, the more benefits it will gain from investing in SharePoint search capabilities.

And just to be clear:  non-SharePoint versions (stand-alone) of FAST are still available, even though they are not promoted as intense as the SharePoint ones.

Apart from Microsoft’s overview above, Microsoft Technet provides a more deepdrawing description of the features and functionality from both an end-user and administrator point of view.

We look forward describing the features and functions in more detail in our upcoming customer cases. If you have any questions to our SharePoint or FAST search specialist, don’t hesitate to post them here on the blog. We’ll make sure you get all the answers.

SPC09 Day 2 – FAST Search for SharePoint Made “SharePoint Easy”

After a great evening with Microsoft Sweden touring around Las Vegas, having dinner at the Stratosphere and a good night sleep today’s session started of. Today’s focus has been deep dives in to the different areas. For me it has been deep dives in Sharepoint Search and FAST Search for Sharepoint.

First of was sessions about Sharepoint Search functions and depolyment. This was more or less going through the different functionality that I wrote about yesterday. A thew new things did thou come up, things like crawler policy’s, avoiding that your index is empties just because the web site that you crawl is on service during crawl time, connector framework that now supports developing connectors in .NET and configuration of the whole search service through PowerShell.

But now to the more exiting thing, FAST Search for SharePoint 2010. This something that it has been really quite about. It has gone 18 months since the acquisition of FAST and during that time not much information about the upcoming version has leaked out. But from yesterday everything is made public. There is even gona come a public beta of FAST Search for SharePoint in November for everyone to test it out.

The most exiting thing about this new version of FAST is that it’s almost completely integrated within SharePoint. With almost is that the installation of FAST is still done on separated servers and has it’s own installation program, though simplified. But after completion of installation and node setup (done in a deployment.xml config file) everything is done in the SharePoint central administration interface or through PowerShell. There is not even the possibility any longer to make configurations through config files in the installation of FAST. Some more advanced configurations and extensions can be made through .NET libraries and PowerShell, for example document processing steps. I will know more about this after tomorrows sessions.

Connectors in new FAST are no longer used as before. They are integrated into SharePoint instead. It’s even the same connector for SharePoint search and FAST Search for SharePoint. Setup is done in the same way to ease the transition from SharePoint Search to FAST.

People search in SharePoint 2010 will, even though you use FAST Search For SharePoint, be handled by SharePoint search. And as Jeff Fried sad “why try to set this up in FAST Search for SharePoint when the people search in SharePoint already is amazing”.

Now it’s time for one of the biggest beach parties that Las Vegas ever has hosted here at Mandal Bay Hotel. Over 7000 crazy SharePoint geeks are going to rock there pants of to the sound of the 80’s.

SPC09 Day 1 (Las Vegas) – A New Choice in Enterprise Search

Today the initial key notes and session on the Microsoft SharePoint Conference 2009 has begun here in Las Vegas. The conference is fully booked with over 7400 registered attendees and is hosted at the Mandala Bay Hotel. There are over 240 different sessions covering everything within the new version of SharePoint 2010. SharePoint 2010 is schedules to be released during the first half of next year however a public beta will be available now in November. I will try to cover the Enterprise Search perspective of this conference and summarize new features and functions in this blog.

The conference was started up through two key notes held by among others Steve Ballmer (CEO of Microsoft) and Jeff Teper (VP). They introduces new features in SharePoint 2010 on all levels from both really deep technical to end user perspective. Showing a lot of new cool features, where one feature was especially sticking out and that was Search. They all pointed out over and over again the importance of search as the core functionality of everything.

Enterprise Search

My first sessions during this conference was on Enterprise Search and the overview of this. A lot of new concepts and functions are introduced. I will try here to summarize some of the new functions in a list.

Sharepoint 2010 and Search Server 2010 (Not all is supported in Search Server)

  • Wildcard search support
  • Phonetic Spelling on person name searches
  • Partitioned index/query (for scaling purposes)
  • Support for up to 100 Million documents
  • Zero query search – Used for using search as navigation
  • Query Suggestion
  • Refinement from meta data (Shallow navigators)
  • Related Searches
  • Federate Searches with Desktop
  • Rating/Language used for relevance tuning
  • View related content in people search
  • Multiple crawler

FAST Search for SharePoint

  • All above from SharePoint searches (some times they are even supposed to work together like people search is still done through SharePoint search)
  • Visual preview and thumbnails
  • Same APIs as SharePoint
  • All administration is done through SharePoint administration
  • Similar results
  • Deep refinement navigators
  • Entity extraction
  • Visual Best bet
  • Contextual Search
  • No index profile any more. Everything is set through SharePoint administration even Navigators and meta data mappings.
  • Can use BCS for connecting to other systems
  • User context searching. Promote/denote documents and changing relevance after users context
  • New search interface

That was a summary of the new features that is to come. I will come back every day to post updates and more detailed information about these features. To finish of I want to quote Microsoft: This is a quantum leap in Enterprise Search.

Microsoft SharePoint Conference 2009 in Las Vegas

I will attend to the SharePoint Conference 2009 in Las Vegas USA between the 19-22 October. This will be the perfect opportunity to learn more about upcoming release of SharePoint 2010 and from Findwise perspective, the new FAST Search For SharePoint.

Since Findwise have several years of experience of integrating FAST ESP and SharePoint this will be a great opportunity to meet us face-to-face and talk about how FAST ESP could help you in your future implementations.

Looking forward to meet you!

Roadmap FAST Search for Sharepoint and Internet Business

In view of the fact that it has been a year since Microsoft acquired FAST search, there has been a lot of hush-hush about the Enterprise search roadmap. However, at the yearly FAST forward conference, Microsoft’s press release Microsoft Unveils New Enterprise Search Road Map reached the public.

There are no big surprises, but a lot of interesting details to come. Briefly speaking Microsoft is focusing on two areas: search to enhance business productivity and search to earn money online.

Sharepoint and FAST ESP

Here at Findwise we have been working with customers integrating SharePoint and FAST ESP for some time, and ESP certainly adds a lot of value by extending SharePoint’s main strengths: content management and collaboration. Office 14, which will probably see the light early next year, will hopefully add more flexibility to their infrastructure solutions out of the box.

More information about the licensing models are yet to come and even though FAST search will continue to develop ESP as a standalone (to run on both Unix and Linux), the roadmap ties existing and potential Microsoft customers closer by presenting search as an integrated part of their business productivity offering.

As for FAST Search Internet Business Microsoft’s target group are companies looking for earning money online. During FAST forward 2007 there was a lot of talk about the future search driven portals and during the 2008 event about the ability to understanding user intent.

Today online consumers have higher expectations when it comes to search and the ability to show related information (such as Amazon’s “people that bought this product also bought”..) as well as showing contextual advertising (related to search terms, geographical location etc) and recommendations will create loyal customers. FAST search has quite a few customers using search for strategic online business so one should keep an eye on the release of the new beta version during 2009.

If you read Swedish, Helge Legernes, one of the founders of Findwise is giving his comment in Computer Sweden.