How to control crawler indexing to get a page fall in a certain document_type



your documentation states:

“The crawler creates a DocumentType called page with the following schema […]”

There is a way, using meta tags, to make the crawler index the page in a specific document type which I previously created via API?


I asked support this not to long ago, copying their reply here but basically no the crawler doesn’t support it.

The concept of document types is limited to our current API indexing method. All crawler-based engines will belong to the document type page. What you can do via meta tags, is create a unique key/value pair combination that will allow you to filter results.

One use case is making use of the existing type field, or create your own: