How does the Swiftype web crawler treat trailing slashes in URLs?


#1

The Swiftype web crawler normalizes URLs to remove the trailing slash as part of its URL de-duplication process.

For example:

http://yoursite.com/ becomes http://yoursite.com

For most web servers, it does not matter which version of the URL is used, because the server will redirect to the trailing slash version if it is the correct one.

If your site has problems with Swiftype’s treatment of trailing slashes, we recommend setting up a redirect so that when one of your users clicks on a search, they are redirected to the trailing slash version automatically.


#3

#4