Monday, December 21, 2009

This year in Custom Search


The Custom Search team has had a busy 2009. This is the year we turned 3. And now Custom Search is powering many tens of millions of queries a day on millions of small and large websites. We believe that search should be easy to deploy on your website, and, in addition to providing great relevance, should be flexible, customizable and feature-rich. With the help of your suggestions, we hope we are delivering on these goals.

This year, we hit many milestones. Here are some of the key developments:
  • integration with several hosters to bring Custom Search to your doorstep
  • enabled support for rich snippets, giving you more control over presentation of results
  • it's now easier for you to promote specific content to the top of your search results
  • we deployed contextual search within Blogger, Google Sites and Wikipedia
  • automatic transliteration is now integrated into the search box
  • improved results rendering flexibility with the Custom Search Element
  • plug-n-play with themes for enhanced customizability of results look and feel
  • added support for structured metadata and the ability to restrict results by specific attributes
  • we got you ready for the growing population of users searching your websites with mobile devices, such as Android phones, iPhone, iPod Touch, Palm Pre, etc.
And there's so much more to do with Custom Search. We'll be working next year to give you additional metadata support, more results customization, and search features that will make it even easier for your users to find the right information faster on your websites. Your users will be happier and you can focus on more important things.

As always, we're looking at your feedback to guide our efforts. And don't forget to follow us on Twitter. Meanwhile, happy holidays, and we'll see you soon ... in the next decade!

Friday, November 13, 2009

Mobile Custom Search with themes and structure

We recently announced support for mobile Custom Search for high-end devices like Android-powered phones, iPhone, iPod touch, and Palm Pre. If you use Custom Search, your visitors can now search your website from these mobile devices. Mobile users will also benefit from the features we recently launched, such as structured Custom Search and themes, and other presentation features, such as touchable tabbed refinement labels, promotions and rich snippets with thumbnails and actions. Here's a screenshot from the new Droid phone.

If you have one of these high-end phones in your pocket, try it out now. You can find information on Custom Search with our handy CSE mobile search [URL: http://googlecustomsearch.appspot.com/cse]. Bookmark this on your phone, and you'll have Custom Search information literally at your fingertips. Search for [snippets] or [promotions] or [mobile] to give it a test-drive.

You no longer need to repurpose your content to mobilize your web site. You can use the Custom Search home page that we create for you as the preferred mobile entry point for your website. If you select a theme for your search engine, your mobile home page will automatically use it. If you switch to a new theme in the Custom Search control panel, your mobile users will immediately see the change. Mobile results will also display thumbnails and actions if you have marked up your pages.

Your mobile users will just need to type a query to find the best result. Using their smartphone, they can navigate your website using search!

Monday, October 26, 2009

Three birthday candles for Custom Search

Last Friday was the third anniversary of Custom Search! Here's a photo of our celebratory cake, baked by John Skidgel, our multitalented Senior Interaction Designer. Our cake was baked in between code reviews for our brand new Look and Feel tab. The magnifying glass was a chocolate cake and the handle and cubes are made from marshmallow and rice cereal squares. Luckily, the local cooking store had ready-made fondant in Google colors. :-)

Thanks to you, our users, the Custom Search platform has grown over the last three years: We now have millions of registered Custom Search engines globally, and are serving many tens of millions of search queries per day. Custom Search, now among the top two widgets on the web, powers websites ranging from the New York Times, MacWorld and Orbitz to individual and topical websites. Since the launch of the Blogger gadget a few months back, hundreds of thousands of bloggers use it to help people find information on their sites. Many applications, such as Community Help within Adobe Creative Suite 4 and topical search on About.com, make use of our unique features, such as label refinements, promotions and Linked Custom Search.

In addition to focusing on ranking, on-demand indexing, customizability, ease of use, language support and scalability, we've tried to serve your business needs too — AdSense for Search and Site Search are built on top of the Custom Search platform. These products offer you choice — you can share revenue with Google with topical ads or further control presentation and branding options with the use of XML. We've also developed APIs for our developers and partners.

We wanted to celebrate this week, not just with customized cake, but by treating you to something special. Website owners have always asked about more power and more customization of search results, so we're happy to introduce Custom Search Themes, Structured Custom Search and the Custom Search Wikipedia skin. You can read details about these new features right here on the Custom Search blog. And, starting today, you can follow us at our new Twitter account @googlecse.

Custom Search Themes — Now, with the ultra-configurable Element, you can pick from among a set of convenient layouts and slick styles for your search results. Themes enable well-designed interactive results that you can use instantly on your website and also offer maximum flexibility to further customize every aspect of results presentation. There's also a compact layout for a great mobile experience when using an Android-powered phone, iPhone, iPod Touch or Palm Pre. When you create a Custom Search engine, a mobile home page is automatically created for you.

Structured Custom Search — You know your website and data better than anyone. We already return Rich Snippet metadata attributes in XML results if you provide structured metadata through markup on your pages. Starting today, special attributes, such as Thumbnails and Actions, will be rendered in Custom Search results. More exciting, you can now restrict your search results by specific attributes, based on the metadata that you provide. Custom metadata attributes and custom query restricts will make your searches truly structured.

Wikipedia Custom Search Skin — If you use Wikipedia for research, the Custom Search Wikipedia skin provides highly contextual search results when you search within Wikipedia. You get Google search across all Wikipedia articles as well as topical results based on the links on the Wikipedia article you are currently reading. We think this makes for faster research.


Search is now an expected way to quickly find and navigate information, but there are still many millions of websites out there that don't even have a search box. We hope that these powerful Custom Search tools will help get high-quality search quickly enabled on these websites. After all, you can configure a Custom Search box for your website in minutes!

Plug-n-play with Custom Search Themes

Besides great results relevance, one of the most popular features of Custom Search is the ability for you to customize the look and feel of the results to match your website. Our users have always requested more control over results presentation. What's Custom Search without customization?

Today, we're launching Custom Search Themes, which make customized presentation a blast!

You can now select from among a set of slick styles that make the search results look awesome. If you love a style, but need to tweak it, you can customize it further by changing fonts, colors, backgrounds, promotion settings, as well as interactive features such as tabbing and mouseovers. The preview function shows you the effects of your changes instantaneously - WYSIWYG.

You can also select from among a set of convenient layouts for full flexibility on the location of the search box and results - contiguous or in 2 columns - you decide! We've even added a compact layout (with only 4 results) that is useful for websites where space is at a premium and search results will not occupy the whole page. Mobile Custom Search, launched last week, uses the compact layout for rendering results on high-end mobile devices e.g., Android phones, the iPhone, iPod touch and Palm Pre. We automatically create a Google-hosted home page for every Custom Search engine, so you can redirect mobile visitors to this page, since we automatically serve up mobile-optimized results.

There are several results hosting options. The most flexibility is offered by the Element, which renders results inline on a webpage -- your users can quickly review results, narrow results to specific categories with a simple tabbed interface, and dismiss results, all without leaving your webpage. We believe this will make it easier and faster for your website's users to find the information they are looking for. The Element now renders special structured data, e.g., Thumbnails and Actions, that you can provide via structured markup on the page.

With Themes, we're providing great look and feel options for your results out-of-the-box. If you want even more control, you can directly download and manipulate the Cascading Style Sheet (CSS) files that control results styling. You can also refer to the documentation on the AJAX Search API that the Element is built with. Remember - not all customization is pretty, so choose wisely!

We'd love to hear your feedback about Custom Search Themes. If you build out a great customized theme that you'd like to share with us and other Custom Search users, we'd love to see it.

Sunday, October 25, 2009

Structured Custom Search

Earlier this year, we announced support for Rich Snippets in Custom Search results. If you provide in-page metadata markup, via RDFa, Microformats, or PageMaps, the Custom Search platform extracts the metadata attributes and returns these as PageMaps in your XML results, so you can render these structured attributes in your search results.

Now, our metadata support just got a whole lot better!

Thumbnails and Actions

If you use the Custom Search Element, you can now add publisher-provided links to your search results based on specific metadata markup in your web pages. These special structured data objects, such as Thumbnails and Actions, are generated from the PageMaps you provide. For example, Scribd, one of our partners, provides both Thumbnails and Actions in PageMaps on their pages, so we display both of these in our sample Custom Search engine, as shown below. The Actions in this case are "Download" and "Fullscreen View", but each publisher can provide customized actions, which they can also style via CSS.

In the case of the above document, the PageMap markup for the Thumbnails and Actions is as follows:

<PageMap>
<DataObject type="thumbnail">
<Attribute name="src" value="http://i5.scribdassets.com/public/images/uploaded/70327880/D9mDLlYzlw_thumbnail.jpeg"/>
<Attribute name="width" value="100"/>
<Attribute name="height" value="130"/>
</DataObject>

<DataObject type="action">
<Attribute name="label" value="Download"/>
<Attribute name="url" value="http://www.scribd.com/document_downloads/20258723?extension=pdf"/>
<Attribute name="class" value="download"/>
</DataObject>

<DataObject type="action">
<Attribute name="label" value="Fullscreen View"/>
<Attribute name="url" value="http://d1.scribdassets.com/ScribdViewer.swf?document_id=20258723&access_key=key-27lwdyi9z21ithon73g3&version=1&viewMode=fullscreen"/>
<Attribute name="class" value="fullscreen"/>
</DataObject>
</PageMap>
If you markup your own pages, as shown above, the Element will render your Thumbnails and Actions in your own Custom Search engine.

Structured Search

The above example shows how easy it is for you to add valuable metadata to your pages for use in display in Custom Search results. So, in the sample engine that we used above, here's what the result looks like when you type the query [halloween]. We see a set of nicely formatted results that match the query.

Wouldn't it be nice to use these metadata attributes in your search? We think so too, so we've enabled a way for you to restrict your search results via use of a special operator. Let's say that we wanted to restrict the results to those results that were authored by a specific author, e.g., "lisamorton" (author of the second result above). We can easily do this by adding the following restriction in our search query: [halloween more:pagemap:document-author:lisamorton]. This gives us exactly what we want - documents authored by "lisamorton":

Let's break down the more:pagemap:document-author:lisamorton restriction. The more: operator is what we use for refinement labels. The pagemap: tells us to refine results by specific attributes in the indexed PageMaps. The document-author: qualifier tells us to look for the specific attribute of interest - the document DataObject in the PageMap with child attribute called author. This is followed by lisamorton, which is just the actual value that we are using for the restriction. You can use this open-ended syntax for querying the appropriate DataObjects in your own documents.

The PageMap that represents the document and author information in the markup of the above pages is as follows:

<PageMap>
<DataObject type="document">
<Attribute name="title">The Five Scariest Traditional Halloween Stories</Attribute>
<Attribute name="author">lisamorton</Attribute>
</DataObject>
</PageMap>
You can provide hooks in your application to filter results by attributes that are important for your users, so users will not have to type these restriction qualifiers directly.

Rich Snippet Preview Tool

Check out the Rich Snippet preview tool. This tool allows you to view not only the Rich Snippets markup recognized for Google web search, but also the additional customized markup that we support in Custom Search. You can immediately see how your web page will be processed after indexing, and what metadata attributes will be returned in PageMaps in your Custom Search results. If there are any errors in your markup, you can fix them right away! Remember - you need to add the &view=cse parameter to this tool to review the additional metadata extracted by Custom Search.

Here's a screenshot from the tool for one of the above results, showing all the PageMap markup recognized by Custom Search:

Many customers have asked for additional structured capabilities, richer snippet presentation and filtering and drill-down capabilities in Custom Search. We'd love to hear feedback from you on these structured data features that offer you more power and flexibility to help users find what they are looking for on your site.

A contextual search experience for Wikipedia

Wikipedia users can now configure a Custom Search skin to customize their Wikipedia search experience. Once configured, the skin helps you to search Wikipedia, and for contextually relevant articles, from any Wikipedia page. This can make it easier to find relevant information, especially on Wikipedia pages with many links, and where the topics you are researching are ambiguous. You can find instructions to configure the Custom Search skin at Wikipedia. It works with Wikipedia's Monobook and the Beta Vector skins, and should work on Wikipedia domains globally. Remember that you need a user account and must log in to Wikipedia to use it.

With the skin configured, if you are reading the Wikipedia page on NASA, and do a search for the query [mars], you are presented inline results organized into 3 tabbed groups: All Wikipedia pages, Linked Wikipedia pages, and Linked non-Wikipedia pages. The first tab shows all Wikipedia articles that match, including those about the candy (Mars Bars) and the television series (Veronica Mars). The next 2 tabs provide contextually relevant results that are linked from the NASA page, such as information about various Mars rovers, orbiters, and space labs, as shown in the screenshot.



Here's what's going on under the covers:

Linked Custom Search enables the creation of dynamic search experiences, where the content being searched can be defined on the fly, and can change over time as new information becomes relevant. The Custom Search skin creates a Linked Custom Search engine on demand for every Wikipedia page that you navigate to.

The results from the current Wikipedia domain, as well as the results from the per-page dynamic search engine, are presented inline in tabbed categories via the AJAX search API. You can refine results by the category of choice, and quickly review the results without having to open a new browser window or tab. This happens through the Javascript code in the skin. The skin's CSS defines the look and feel of the results.

As for the page-specific Linked Custom Search engine, it computes the contextual results within the Linked Wikipedia pages (on-domain) and Linked non-Wikipedia pages(off-domain) categories. These two tabs are technically very similar, so we'll just describe how one of them works.

Suppose you're visiting the NASA article and search for [mars]. The Linked Wikipedia tab sends the search query to Google Custom Search, along with a parameter that indicates that the search engine specification is at (view source in browser):


Google picks up this Linked CSE request and uses the above specification and the supplied query. You can simulate this process by visiting:


A different specification is generated for every Wikipedia page (based on url) by a tiny AppEngine application at http://googlecustomsearch.appspot.com. The specification defines a search engine with two facets, labeled "internal" (Linked Wikipedia pages) and "external" (Linked non-Wikipedia pages). The list of "internal" (and "external") webpages to search over is provided by this line in the specification:

<Include href="http://googlecustomsearch.appspot.com/wikipedia/annotations.do?url=en.wikipedia.org%2Fwiki%2FNASA" type="Annotations"/>

This causes Google to visit the webapp at a new URL (annotations.do). Our webapp now collects links from the NASA article, classifies them as "internal" or "external", and returns the annotations in an XML format. You can see the result at (view source in browser)


Now Google can finish building the Custom Search engine for the NASA article, and compute the results for [mars]. The results are returned to your web browser and displayed in the appropriate tab.

But wait! Our little AppEngine webapp doesn't have the CPU horsepower or bandwidth to scan Wikipedia pages on-demand or in nearly-real-time for thousands of Wikipedia users. Instead, the webapp asks Google to scan the page, via a Custom Search tool called makeannotations. The request looks something like this:


After makeannotations returns the list of links in the NASA article in XML, the webapp simply rewrites the XML according to the domain of each link.

Since we are creating the per-page search engines on demand, there can sometimes be a short delay in the creation of the search engine, e.g., for new or obscure pages. However, for popular Wikipedia pages, these definitions should be cached, and you should see no delays. In fact, we use a ping method to load up the Custom Search engine in advance before you search. Remember that if there are not many links on the Wikipedia page you are searching from, you may sometimes find no matches for linked pages.

We've open sourced the code for this application. Feel free to work with it. Feel free to extend the skin beyond Monobook and Vector. We built this skin with the help of Wikipedia, and hope that you will provide feedback on your experience. You can also provide your feedback directly to Wikipedia.

Thursday, October 22, 2009

Google Custom Search for your smartphone

In our recent Product Ideas survey, one of the most-requested features was about enabling a mobile version of Custom Search. Guess what: It's here! As announced on the Google Mobile blog, Custom Search now enables a rich interactive mobile experience on high-end devices such as Android-powered phones, iPhone, iPod touch, and Palm Pre.

Try it out on your phone right now: search for user-generated content (e.g., search for [maradona]) from sites like Wikipedia, Knol, etc., or learn all about the latest and greatest Custom Search features on our product's mobile search engine (e.g., search for [snippets]).

Custom Search engine results can be embedded in your own site, but website owners can also choose to have Google host the search results page. You can now redirect visitors using these high-end mobile devices to Google-hosted search results, and we will serve up search results optimized for these devices. Better yet, we create a Google-hosted home page for every Custom Search engine that we create (even if you decide to host the results on your own website). Starting today, users who arrive at the home page for your Custom Search engine will be automatically served pocket-sized Custom Search results, along with your search engine customizations, like your labels and promotions.

All you need to do at your own end is redirect users who arrive at your website on one of the supported mobile devices to the hosted Custom Search home page. Another alternative is to provide a button or link on your web site that directs people to your Custom Search home page, whose URL looks like (you will need to replace the ID after "cx=" with your own Custom Search engine ID):

http://www.google.com/cse/home?cx=013315504628135767172:d6shbtxu-uo

Of course, if you'd like to serve these mobile results from your own website, you can replicate the functionality of the mobile home page on your own website. This page uses the Custom Search Element. If you do, you will still need to take care of the redirection at your website so that mobile users receive mobile-friendly search results automatically.

If Google web search is the entry point for navigating the web, we hope you'll use this interactive Custom Mobile Search entry point to help people navigate your own web content when they need information on the go!

Thursday, October 8, 2009

Google Sites turns Custom Search on

Google Sites offers users a very simple way to create and publish web sites. Multiple users can collaborate to manage website content as well as add various gadgets into their websites. Google Sites now allows the addition of Google Custom Search as a search option.

In the following example, we add a Yoga Search Custom Search experience to the Yoga for Life web site in a few simple steps. (The example assumes that the Yoga for Life website is hosted by Google Sites, and that the Yoga Search has already been created using Google Custom Search.)
  1. Login to your Google Site, and select the "Manage Site" option in the "More Actions" dropdown.


  2. Select the "Site Layout" option from the Navigation menu on the left. Click the "Configure Search" button.


  3. Select the Advanced tab in the "Configure site search" dialog. To add a new search provider, click on the "Add provider" button.


  4. Now, we'll need to get information about the Custom Search engine we want to use. Open up another tab or browser window and login to the Custom Search control panel. Find the URL for the search engine you want to use by clicking on it's name in the list called My search engines. Copy this URL; you will use it in the next step. In this example, we'll use the URL for Yoga Search.


  5. Go back to the Google Sites search provider dialog. Select "Google Custom Search" as the provider type. Type in the Name, e.g., "Yoga Search" for the search option you'd like your users see on your site, and paste the Custom Search Engine URL that you obtained in the earlier step. Leave the Show results in site option checked. Click OK.


  6. You can change your default provider by clicking on the "General" tab in the "Configure site search" dialog and selecting "Yoga Search". Make sure to Save your settings. You're done.


  7. Your users will see Yoga Search as the default search option in the search box on the Yoga for Life website. Search, and your results from the Yoga Search Custom Search engine will show up inline, with the look and feel of your site.


Try it out for your site, with your own Custom Search engine! As always, we'd love to hear your feedback on new features in the user group.

Tuesday, September 22, 2009

Product Ideas for Custom Search



Your feedback is one of the most important things we consider when planning updates and improvements to Google Custom Search. In addition to reviewing the feedback and suggestions that you make in our user group, we're opening up a Product Ideas page for you to share your opinions about Custom Search. Just like other Product Ideas series, you'll be able to submit your own idea and vote for ideas from other users.

If you've got ideas or suggestions for Custom Search - features you want, things we can do better - tell us! We want to hear from you. We've created a set of categories, so please try to find the most appropriate category for your suggestion or idea. Product Ideas for Custom Search will remain open for you for the next month.

If you have questions, visit the Product Ideas FAQ - but if you want to get started right away, go for it! Vote for a suggestion, or enter your own idea on the Custom Search Product Ideas page.

Monday, August 10, 2009

Custom Search with Style like Peanut Butter with Jelly

Developer Programs Engineer

Creating a custom look and feel for your website can have significant benefits in everything from improving usability to setting a professional or playful tone for your website. In many cases, letting users search the content of your site and related sites gets them the information they need faster. After all, a speedy user experience is a happy user experience. Here are some examples of how Custom Search and custom styles are as easy (and delicious) as peanut butter and jelly.

We start with a Custom Search Element, which uses the CustomSearchControl to add Custom Search to my web page. If you've never used a Custom Search engine before, I think you'll find a lot to love: it uses Google's search technology to include a specific group of websites for indexing, and you can share in ad revenue.



One of the many benefits of using the AJAX Search APIs to dynamically add search capabilities to your web pages is that you can also control the look and feel of the search input and results by using open web standards like cascading style sheets (CSS). When you combine this styling with Custom Search, you can create a seamless search experience for your users.

You can begin by changing the search input box (dynamically added to your page by default) to use an input box that you've placed on the page wherever you like.
// Set drawing options to use my text box
// as input instead of having the library create one.
var drawOptions = new google.search.DrawOptions();
drawOptions.setInput(document.getElementById('query_input'));

// Draw the control in content div
customSearchControl.draw('results', drawOptions);
With the above changes we get a page that looks like this:

Now that we're able to use a Custom Search box (look ma, no button push required!) we can add CSS rules to change fonts, colors, and more in the search results.

For example, see: http://ajax-apis.appspot.com/cse-style which has CSS rules that effect the styling of the search results and compare it to our first step which uses the default styles.

Take a look at the CSS rules to get an idea for how this works, and how you can do custom styling to fit your own website.

We can change the font and add a border around each search result:
#results .gsc-results {
/* Sets font for titles, snippets, and URLs. */
font-family: arial, helvetica, sans-serif;
}

#results .gsc-result {
position: relative;
border: 1px solid #eee;
border-left: 10px solid #eee;
padding: 8px 8px 8px 20px;
border-radius: 8px;
-webkit-border-radius: 8px;
-moz-border-radius: 8px;
}
We can also change the style of a single result when the user moves the mouse cursor over it:
#results .gsc-result:hover {
border: 1px solid #888;
border-left: 10px solid #888;
}


These are just a couple of examples. Since the CSS styling is handled by the browser, you can use any supported CSS rules to select portions of the search results. For more information on the result HTML structure and the CSS classes you may want to select in your own customizations, see the documentation on styling AJAX Search results.

Friday, July 31, 2009

More transliteration languages for Custom Search



A few weeks ago, we announced support for transliteration in Custom Search in a bunch of languages, including Arabic and a set of Indic languages. The auto-transliteration feature allows your users to conveniently type in English, for example, and search in one of these languages.

Now, that list of transliteration languages in Custom Search has grown. We now support a dozen languages, including Urdu and Nepali.

The feature is very simple to use: you can turn transliteration on in the Language settings section of the Basics page on the Custom Search control panel.

Once you've enabled automatic transliteration, a language button next to the search box alerts your users. As a user types, the query is transliterated into the selected language in real-time, allowing the user to search in that language.

For more details, read our original transliteration blog post, or search on the Custom Search website!

Here's the current list of supported transliteration languages:
  • Arabic
  • Bengali
  • Gujarati
  • Hindi
  • Kannada
  • Malayalam
  • Marathi
  • Nepali
  • Punjabi
  • Tamil
  • Telugu
  • Urdu
Feel free to share your feedback on transliteration in our forum.

Thursday, July 16, 2009

Better search on more websites



Earlier this year, we made it easier to add high quality search to your websites by delivering search functionality right to where many of you manage your sites online: your hoster's console. The Custom Search provisioning API allows partners, such as web hosters, to configure search boxes for your site without requiring you to come to Google. This also enabled Custom Search to be added to Google Services for Websites, an offering of useful website tools and services for partners.

Many hosters have enabled Webmaster Tools and Custom Search in their control panels; Aplus.net is the most recent addition to our list of partners that have integrated Custom Search into their service using Google Services for Websites. Aplus.net provides online business services and tools, such as web hosting, domain name registration, web design, and e-commerce services as well as dedicated servers and managed hosting solutions, to small- to medium-sized businesses.

Here's a screenshot of their integration. Websites can enable search with a couple of clicks!


Working with partners such as web hosting providers has made things a great deal easier for webmasters, making useful tools more accessible. Integrating with the right tools will help you analyze your website traffic and improve user retention; Custom Search is a critical element of this, helping people find the right information, products and services quickly.

We are looking forward to enabling more partners to integrate with these important webmaster services. As always, let us know how we can improve our products and services. If you are a web site hoster interested in incorporating Google webmaster services into your platform, check out Google Services for Websites.

Monday, June 29, 2009

Advanced Custom Search Configuration



Here's the presentation on Advanced Custom Search Configuration from Google I/O. You can navigate it with the help of a convenient timeline at YouTube, or download the presentation in PDF format. The talk features Nick Weininger from the Custom Search team on how to create a contextual search experience in minutes, along with details of the Custom Search APIs, including:In addition, Mark Nichoson from Adobe talked about Adobe Community Help, a customized search application that's available within apps in Adobe's Creative Suite 4. Joel Brandt from Adobe followed up with a description of Blueprint, an innovative application that integrates Custom Search into the Flex development environment.

For more information, please check out the Custom Search developer guide.

Tuesday, June 16, 2009

Automatic transliteration for Custom Search

Mohamed Elfeky and Adel Youssef, Software Engineers

Typing is harder in some languages than others! When you're searching for content in a specific language, it is often convenient to think in that language, but type in another, e.g., English.

We've just made this easier to do in Custom Search. We've enabled transliteration in Custom Search for a set of languages, making it easier to find news in Arabic, Indian news in Hindi, your favorite Bollywood song lyrics, or local content in a bunch of other Indic languages - Kannada, Malayalam, Tamil and Telugu. Other languages will be enabled soon.

The Google Arabia blog recently posted information on Google Ta3reeb, enabling Arabic transliteration in various modes, including within Custom Search.

Here's a screenshot from oneindia.in, a website that has enabled transliteration in a set of Indian languages.

Users can type in English; automatic transliteration converts the query to Hindi, Kannada, Malayalam, Tamil, or Telugu, and helps find relevant content in that language.

Automatic transliteration can now be easily configured in the Custom Search control panel using the Language settings. It will enable conversion of Roman characters to the above languages, allowing users to search for content in these languages. After you turn transliteration on, you can select the specific transliteration languages your users can use.

After enabling transliteration, you can preview your search experience - a language button will show up before the search box, alerting users to the fact that transliteration is enabled, and that they can issue queries in that language while entering the queries in English. In fact, multiple languages can be selected for transliteration. As a query is entered, it is transliterated into the selected language in real-time.

Hit search, and results in the desired language are presented. Voila!

For more information on transliteration, you can check out our help center. As always, we're looking forward to your feedback on our user forum.

Friday, May 29, 2009

A search box for Blogger

Nicholas Weininger, Software Engineer

Custom Search enables anyone to create a tuned search experience that's contextually relevant. For example:
  • Individuals can create a personalized search experience around their bookmarks, blogs, and public web sites
  • Web site owners can provide Site Search
  • Publishers can provide search across multiple publications
  • Communities can collaborate to create topical search engines across thousands of web pages
For bloggers, blogging platforms typically provide in-built search tools that allow searching across published blog posts, or across tags and categories. With Custom Search, you can go one step further: you can define a search experience that evolves over time, and includes not just your blog posts, but links extracted from those posts, as well as links from your blog's link lists and blog lists - in short, all items of interest related to your blog.

If you author a blog on Blogger, we've built a search gadget for you that does this - the AJAX Custom Search gadget creates a Linked Custom Search engine that automatically updates to allow your readers to search your blog's entire neighbo(u)rhood. It is a uniquely flavo(u)red search experience that gets richer over time. Search results appear inline, so your users don't have to leave your blog. The results inherit the look and feel of the blog, as shown in the screenshot below.

On Blogger, you can add the gadget with a couple of clicks:
  1. Edit your blog's layout (Page Elements tab)
  2. Click on "Add a Gadget" and configure the new "Search Box" gadget.
You can configure tabs that will allow your blog's readers to restrict their search to specific link lists or blog lists; you decide which ones you want to configure.

If you are using this gadget, we'd love to hear your feedback in our discussion group.

The AJAX Search and the Custom Search APIs have also been combined to create the Custom Search element that we recently announced at Google I/O.

Tuesday, May 26, 2009

Introducing the Custom Search Web Element

Rajat Mukherjee, Group Product Manager and Nicholas Weininger, Software Engineer

Google Web Elements, unveiled today at Google I/O, build on your favorite Google products so you can easily add richness, interactivity and monetization to your website with the simplicity of copy and paste. We've packaged this simplicity into the new Custom Search element, making it even easier for you to add Google-quality search to your website. By helping your users find information faster, you can retain users on your website and monetize search with relevant Google ads. The element will allow you to create an interactive, inline search experience, so users don't need to leave the web page they are on in order to search.

You can create a Custom Search element in two convenient ways: via the Custom Search element wizard, or by selecting the appropriate options within the Custom Search control panel.

When you log on to the control panel, you'll see links to the Custom Search element wizard if you list your search engines (My search engines). If you click through to the wizard from the control panel, the appropriate search engine information is automatically extracted by the wizard -- all you need to do is preview your search results, and copy and paste the generated code into your website.

You can also generate the right code for embedding the Custom Search element into your website by going to the updated Get code tab in the control panel. A new option allows you to generate element code.


The Custom Search element supports Promotions, which let you highlight specific information for specific queries. Refinement Labels automatically appear as separate tabs in the element, so you can navigate quickly to the category of results that you're looking for. The screenshot below shows a preview of the search results in the element wizard.

While the Custom Search element is designed to help you get started quickly without spending time on the deep technical details, it is powered by Google's scalable and flexible developer APIs, including the AJAX Search and Custom Search APIs, offering a world of customization.

Let us know if there are further improvements we can make to this user experience. To learn more about Google Web Elements, check out the AJAX API blog.

Friday, May 22, 2009

Custom Search at Google I/O

Saksiri Tanphaichitr, Software Engineer

If you're attending the upcoming Google I/O Developer Conference (May 27th and 28th), make sure to attend the sessions where we plan to discuss the latest Custom Search developments.

There are 2 sessions that will highlight Custom Search:
These sessions, part of the AJAX + Data APIs track, will discuss ways in which you can easily build, embed, and customize a contextual search experience on your website. You will learn how to develop advanced applications using the AJAX Search and Custom Search APIs, create dynamic experiences with Linked Custom Search, and programmatically provision Custom Search for your users. We'll also talk about interesting developer applications, as well as advanced presentation of search results including features that we recently launched: Rich Snippets and Promotions.

Adobe, one of our partners, will join us in discussing their use of Custom Search, and will also show interesting developer applications built on top of the Custom Search platform at the Developer Sandbox.

Here's a sneak peek:



We look forward to seeing you at Google I/O.

Monday, May 18, 2009

Custom Search promotions made easier



Last year, we made it easier to promote relevant information to the top of your search results for specific queries, but there were still a couple of steps you had to take to make this happen. So now, we've made it easier than ever to create promotions in Custom Search. You can quickly configure specific webpages or information to display above your search results for specific queries, allowing you to highlight key events, announcements, services or products.

We've added a new Promotions tab to the Custom Search control panel to help you manage all your promotions.

Creating a promotion is easy - decide on the queries that should trigger a specific promotion, select a title and URL for your promotion, and add optional information, such as description and image thumbnail. The promotion edit pane also shows a preview of your promotion.

When you're done, promotions will display in your search results for the queries that match your trigger list. You can test a promotion by issuing one of the trigger queries in the control panel results preview.

A few pointers:
  • you can control the look and feel of the promotions to distinguish them from regular search results (through Promotion Design Settings)
  • you may want to create promotions to highlight information for popular queries on your search engine (use search statistics to identify them)
  • you should delete promotions when they are no longer relevant
  • our updated developer documentation includes more information on promotions

We hope to see useful promotions popping up in custom search results all over the web.

Don't miss the promotions when you search on the Custom Search website! We'd love to get your feedback on how we can make this feature even more useful.

Tuesday, May 12, 2009

Enabling Rich Snippets in Custom Search

Posted by: Rajat Mukherjee, Group Product Manager and Nicholas Weininger, Software Engineer

Today, we announced Rich Snippets for Google web search, a new presentation of snippets that highlight structured data embedded in webpages. Rich Snippets provide summary information, including important page-specific attributes, to help you quickly identify the relevance of your results. Experiments on Google have shown that people find this additional data valuable -- if they see useful and relevant information from a webpage, they are more likely to click through to it. Our web search team is currently experimenting with a limited set of attributes for reviews and user profiles that webmasters can provide through in-line markup in their webpages by using open standards such as microformats or RDFa.

Since Custom Search sits on top of the Google web search platform, we're enabling Rich Snippets for custom search engines too. In fact, Custom Search provides support for richer snippets; you can define your own custom attributes that we'll index and return with your custom search results. In addition to microformats and RDFa, you can also provide custom metadata within your webpages via special markup called PageMaps. A PageMap identifies specific attributes that are recognized and preserved by Google at index time, and returned along with search results for presentation.

So, if you're using Custom Search or Site Search on your website, you can now control further how your content appears in search results. You can showcase key information -- such as image thumbnails, summaries, ratings, and prices -- in your result snippets if you provide the appropriate markup on your pages. As in the example shown below, displaying specific attributes can make the snippet more useful for shoppers.


At this time, Rich Snippets attribute information for Custom Search is only returned in XML (via <PageMap> tags), so you can use your own customized presentation controls. We're looking to make this easier for you in the future. Indexing of the rich snippets information can have unspecified latency, as some pages are indexed and refreshed more frequently than others, and PageMap attributes may not be indexed from all webpages.

As an illustration, the webpage featured in the following example provides custom information about an image thumbnail that is displayed in the rich snippet of the result along with date, author and category information.


A sample PageMap for the above example defines custom attributes that are encoded in DataObject tags via the following markup:
<!--
<PageMap>
<DataObject type="image">
<Attribute name="image_src" value="http://www.nytimes.com/images/2009/03/14/business/14vend.751.jpg"/>
</DataObject>
<DataObject type="publication">
<Attribute name="author" value="John Tagliabue"/>
<Attribute name="date" value="March 14, 2009"/>
<Attribute name="category" value="Business/World Business"/>
</DataObject>
</PageMap>
-->

If you are getting results back via XML, then the custom attributes are returned in the results within the PageMap tag, as shown below. You can parse the DataObjects within the PageMap tag and provide customized presentation of the relevant attributes.

<r n="1">
<u> http://www.xyz.com/business/vending_machine.html </u>
...
<t> In Italy, a Vending Machine Even Makes the <b>Pizza</b> </t>
...
<s>The European vending machine industry has annual sales of about #33 billion, much of it coming from factories and offices.</s>
...
<PageMap>
<DataObject type="image">
<Attribute name="image_src" value="http://www.nytimes.com/images/2009/03/14/business/14vend.751.jpg"/>
</DataObject>
<DataObject type="publication">
<Attribute name="author" value="John Tagliabue"/>
<Attribute name="date" value="March 14, 2009"/>
<Attribute name="category" value="Business/World Business"/>
</DataObject>
</PageMap>
...
</r>

Let us know if you have feedback about custom Rich Snippets. For more information, join us for a discussion on Advanced Custom Search Configuration at Google I/O on May 27.