Nuxt•2y ago

Robots.txt

What are you putting in your robots.txt ?

Mine is:

robots: {
  disallow: [
    '/api/_content',
    '/_nuxt'
  ],
  credits: false
}

robots: {
  disallow: [
    '/api/_content',
    '/_nuxt'
  ],
  credits: false
}

But I wonder if it's a good idea.
Is it better to let Google crawl these ?

I can see in my Google Search console there are 370 not indexed pages (for 11 indexed) which are all api/_content/query/ urls.

Should I remove the Disallow ?

Communities Docs About Terms Privacy

Robots.txt - Nuxt

Robots.txt

Similar Threads

Robots.txt

Similar Threads

Similar Threads

Similar Threads