Swiftype search on sites that require authentication

Frequently Asked Questions Setup & Indexing
1

Hi,

Can we use Swiftype search on sites that require authentication? We are using IIS with Basic authentication enabled.

Regards,
Milan

2

Hi Milan,

If asking about crawling content on a site that requires authentication, it’s not currently possible to associate specific credentials to our Search Agent. A common solution is to whitelist our crawler’s fetch requests by specific UID or origin IP block.

We’ve additional information here: Can Swiftype index password protected sites?

3

Hi Mike,
Can you please elaborate a little bit? How we can whitelist Swiftbot crawler’s fetch requests by specific UID or origin IP block and to keep the authentication on the website?
Regards,
Milan

4

Hi Milan!

I’ve also followed up with your support request via email. Let’s continue this conversation there.

If the reply is not found in your inbox, please check the spam/junk folder in case it got caught in there, and whitelist the swiftype.com domain.