From 2a8d5c0a1e2d01eb28805024e18fa5618a577c2c Mon Sep 17 00:00:00 2001 From: npeter83 Date: Sat, 4 Jul 2026 18:17:24 +0200 Subject: [PATCH] feat(seo): meta description, Open Graph tags and robots.txt The public landing had no meta description and no robots.txt (the SPA fallback returned index.html for /robots.txt, so crawlers saw an invalid file). Add a description + basic OG tags to index.html and a real robots.txt that allows the landing but disallows the API/auth/watch surfaces. Lighthouse (dev): SEO 83->100. --- frontend/index.html | 10 ++++++++++ frontend/public/robots.txt | 7 +++++++ 2 files changed, 17 insertions(+) create mode 100644 frontend/public/robots.txt diff --git a/frontend/index.html b/frontend/index.html index fef8afa..c7ed055 100644 --- a/frontend/index.html +++ b/frontend/index.html @@ -5,6 +5,16 @@ Siftlode + + + +
diff --git a/frontend/public/robots.txt b/frontend/public/robots.txt new file mode 100644 index 0000000..43d4e0c --- /dev/null +++ b/frontend/public/robots.txt @@ -0,0 +1,7 @@ +# Siftlode is mostly a private, login-gated app; only the public landing and legal +# pages are worth indexing. Allow crawling but keep bots out of the API surface. +User-agent: * +Allow: / +Disallow: /api/ +Disallow: /auth/ +Disallow: /watch/