Can Swiftype's crawler index dynamically generated (AJAX) page content?

ajax
api

#1

Is the Swiftype content crawler able to handle asynchronously served content (AJAX content)?

Swiftbot is unable to process JavaScript directly, however, it can index dynamic AJAX or Single-Page Application content as long as your server is able to return a pre-rendered HTML snapshot.

You can read more about this practice in this Google specification guide:
https://developers.google.com/webmasters/ajax-crawling/

For assistance in creating those pre-rendered pages for crawling, Swiftype customers have been successful using middleware services like prerender.io.

If your site or app infrastructure doesn’t allow for middleware services, you may want to consider building out your engine(s) with our developer API:


Dynamically Added Meta Data Indexing