I wonder if this topic would give you a starting point: Is there an easy way to add a robots.txt to a tutor-based OpenEdX deployment? - it discusses how to use a robots.txt file to avoid crawling the whole site, which I realize is not your goal, but it could be useful? I don’t know how to answer your question but figured I’d point you in a potentially helpful direction.
sarina
(Sarina Canelake)
2
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Prevent crawling by robots | 3 | 457 | September 16, 2020 | |
| Is there an easy way to add a robots.txt to a tutor-based OpenEdX deployment? | 19 | 376 | March 24, 2025 | |
| SEO for an Open edX site | 4 | 527 | March 22, 2021 | |
| Search engines and robots.txt | 4 | 296 | March 13, 2024 | |
| How to correctly inject a header button via Tutor Plugin in CMS (Studio)? | 1 | 63 | May 13, 2025 |