TNO Diamonds Bot
This bot is part of the TNO Diamonds platform and automatically collects publicly available university master’s theses and related academic documents for research purposes.
Organization
TNO (Netherlands Organization for Applied Scientific Research) is the largest independent applied research institute in the Netherlands. https://www.tno.nl
Purpose of the Bot
- Collect and index publicly available master’s thesis documents.
- Provide structured access to academic work for research purposes.
- Support the training of AI models.
The bot does not access private data, login pages, or restricted documents.
Crawl Behavior & Traffic Pattern
- Respects
robots.txtguidelines and implements rate limiting to avoid overloading university servers. - Temporary intensive activity: The bot may perform 10,000+ requests per day for a short period (e.g., one week), then remains inactive until the next scheduled crawl.
Technical Details
| User-Agent | TNOThesisCrawler/1.0 (+https://diamonds.tno.nl/bot-policy; email: support.diamonds@tno.nl) |
|---|---|
| Rate Limiting & Robots.txt | Max ~5 request/sec per host |
Contact & Transparency
Contact / abuse email: support.diamonds@tno.nl