siftlode/frontend/public/robots.txt

# Siftlode is mostly a private, login-gated app; only the public landing and legal
# pages are worth indexing. Allow crawling but keep bots out of the API surface.
User-agent: *
Allow: /
Disallow: /api/
Disallow: /auth/
Disallow: /watch/
feat(seo): meta description, Open Graph tags and robots.txt The public landing had no meta description and no robots.txt (the SPA fallback returned index.html for /robots.txt, so crawlers saw an invalid file). Add a description + basic OG tags to index.html and a real robots.txt that allows the landing but disallows the API/auth/watch surfaces. Lighthouse (dev): SEO 83->100. 2026-07-04 18:17:24 +02:00			`# Siftlode is mostly a private, login-gated app; only the public landing and legal`
			`# pages are worth indexing. Allow crawling but keep bots out of the API surface.`
			`User-agent: *`
			`Allow: /`
			`Disallow: /api/`
			`Disallow: /auth/`
			`Disallow: /watch/`