NuxtN
Nuxt•2y ago
romain

Robots.txt

What are you putting in your robots.txt ?

Mine is:

robots: {
  disallow: [
    '/api/_content',
    '/_nuxt'
  ],
  credits: false
}


But I wonder if it's a good idea.
Is it better to let Google crawl these ?

I can see in my Google Search console there are 370 not indexed pages (for 11 indexed) which are all api/_content/query/ urls.

Should I remove the Disallow ?
Was this page helpful?