# Prevent Googlebot-Video from crawling - robots.txt / X-Robots-Tag?

**URL:** <https://community.wowza.com/t/prevent-googlebot-video-from-crawling-robots-txt-x-robots-tag/53723>\
**Category:** Wowza Streaming Engine\
**Created:** [July 29, 2019, 11:55am UTC](https://community.wowza.com/t/prevent-googlebot-video-from-crawling-robots-txt-x-robots-tag/53723 "2019-07-29T11:55:41Z")\
**Posts on this page:** 1\
**Showing post:** 1

<div class="post-metadata">

**Author:** ![Elio\_Wahlen](https://avatars.discourse-cdn.com/v4/letter/e/3be4f8/32.png) [@Elio\_Wahlen](https://community.wowza.com/u/Elio_Wahlen)\
**Post date:** [July 29, 2019, 11:55am UTC](https://community.wowza.com/t/prevent-googlebot-video-from-crawling-robots-txt-x-robots-tag/53723/1 "2019-07-29T11:55:41Z")

</div>

Our VOD-Servers are being crawled by the Googlebot (User Agent “Googlebot-Video/1.0”)

We have many terabytes of data there and we want to avoid that traffic.

I would like to put a robots.txt to prevent the googlebot from continuing.  
Wowza runs on its own subdomain so the robots.txt would need to be hosted from Wowza itself.  
Is there a good practice for that

Or does wowza support ways of setting up the X-Robots-Tag in the HTTP headers?

---

_[View the full topic](https://community.wowza.com/t/prevent-googlebot-video-from-crawling-robots-txt-x-robots-tag/53723)._
