Apple yesterday gave a few interesting details on something it's calling "Applebot", the company's in-house web crawler that is used to help power services like Siri and Spotlight on iOS and OS X platforms



From MacRumors:

In the past, Apple has partnered with companies like Google and Bing to provide search results in a few of its own products like Siri, but this week's news could be an additional hint at Apple introducing its own complete search platform in the future. Most recently, in early February, a job listing provided more fuel to a rumor that the Cupertino company was doing just that, although it was likely to be describing ongoing efforts to improve Spotlight and was never legitimized.

  Apple Confirms 'Applebot' as In-House Web Crawler for Services Like Siri and Spotlight