User-agent: * Disallow: /admin/ Disallow: /api/ Disallow: /download/ Disallow: /pages/ Disallow: /html/ Disallow: /d/ Disallow: /history/ Disallow: /html-test/ Disallow: /digital/ Disallow: /hybrid/ Disallow: /llamaparse/ Disallow: /accounts/profile/ Disallow: /accounts/credits/ Disallow: /accounts/welcome/ Disallow: /accounts/export-data/ Disallow: /accounts/verify-email/ Disallow: /*/document/ Disallow: /*/digital/ Disallow: /*/hybrid/ Disallow: /*/llamaparse/ Allow: /$ Allow: /digitise/ Allow: /about/ Allow: /contact/ Allow: /careers/ Allow: /privacy/ Allow: /terms/ Allow: /accounts/login/ Allow: /accounts/register/ Sitemap: https://lingvert.com/sitemap.xml # LLM/AI crawler reference # LLM-txt: https://lingvert.com/llm.txt