# How do I exclude parts of my site from being indexed?

**URL:** <https://community.swiftype.com/t/how-do-i-exclude-parts-of-my-site-from-being-indexed/177>\
**Category:** Setup & Indexing\
**Tags:** crawler\
**Created:** [April 11, 2016, 5:23pm UTC](https://community.swiftype.com/t/how-do-i-exclude-parts-of-my-site-from-being-indexed/177 "2016-04-11T17:23:01Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/flex019/uploads/swiftype/original/1X/fd652d1735c60057fa71c371375511028f9a1832.png) [@system](https://community.swiftype.com/u/system)\
**Post date:** [April 11, 2016, 5:23pm UTC](https://community.swiftype.com/t/how-do-i-exclude-parts-of-my-site-from-being-indexed/177/1 "2016-04-11T17:23:01Z")

</div>

> **I do not want my Swiftype to index part of my site. How can I exclude certain pages from being indexed?**

Swiftype gives you a number of ways to control _exactly_ want you want indexed.

**1. To delete a single page result from your engine index:**

Look up the page using the **Content** tab (within the **Manage** section) in the Swiftype Dashboard. You can search/filter by title or URL. Next, click the _Details_ button, to view the full result document. Under the _Options_ dropdown in the upper right, you’ll see an option to delete the current page result. Once you’ve deleted a page, it will not be reindexed.

**2. To exclude content on a page from being indexed:**

If there are parts of your template or page that are being indexed which you do not want, you can use [content exclusion](http://swiftype.com/documentation/content_inclusion_exclusion) to remove them.

```auto
<div data-swiftype-index="false">This will not be indexed.</div>

```

**3. To exclude sections of your site from the crawl:**

If there are sections of your site you do not want crawled by Swiftype, use a robots.txt file. Swiftype’s [robots.txt support](https://swiftype.com/documentation/robots) will prevent our web crawler from visiting those sections of your site.

```
User-agent: Swiftbot
Disallow: /blog/
Disallow: /photos/

```

If you cannot edit your site’s robots.txt, or you have more complicated rules, you can also take advantage of Swiftype’s [path-based whitelists and blacklists](https://swiftype.com/documentation/path_rules).
