# Does Swiftype respect robots.txt files?

**URL:** <https://community.swiftype.com/t/does-swiftype-respect-robots-txt-files/75>\
**Category:** Setup & Indexing\
**Created:** [December 21, 2015, 10:58pm UTC](https://community.swiftype.com/t/does-swiftype-respect-robots-txt-files/75 "2015-12-21T22:58:02Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/flex019/uploads/swiftype/original/1X/fd652d1735c60057fa71c371375511028f9a1832.png) [@system](https://community.swiftype.com/u/system)\
**Post date:** [December 21, 2015, 10:58pm UTC](https://community.swiftype.com/t/does-swiftype-respect-robots-txt-files/75/1 "2015-12-21T22:58:02Z")

</div>

Absolutely! You can use a robots.txt file to limit what parts of your site the Swiftype search agent will crawl for engine indexing.

For additional details about robots.txt support, you can refer [to our documentation](https://swiftype.com/documentation/robots).