issues with /map
Hi. I have some issues with map.
1) These urls do not work I assume the crawler is blocked but I am not sure?
- https://www.card-corner.de/
- https://www.cardbuddys.de/
2) the map endpoint doesn't work at all in the self hosted version (I encountered these issues with the paid cloud version of /map)
3) The "search" functionality doesn't work reliably. My search term is "pokemon" and the following URL is not found despite literally including the word pokemon. how does this work?
Thanks!
Sammelkarten kaufen bei Card-Corner
Sammelkarten kaufen bei Card-Corner
Pokémon, One Piece, Topps, Lorcana und vieles mehr. Jetzt günstig Sammelkarten kaufen bei Card-Corner (ehemals Poke-Corner)!
cardbuddys.de
Cardbuddys Shop

1 Reply
bump; still experiencing issues with the map endpoint being unreliable 5 mins a go I was able to map a website now I am not even after 10 retries
cc @Adobe.Flash
in the playground the same urls fail as well
sometimes they work sometimes they dont so it seems to be an issue with the /map endpoint in general
since now it's always the same urls (at least today) I have the feeling that your proxies/ip's are blocked are you using rotating residential proxies?