Show 404 when navigating to a route without index.tsx

Since the route /ag has only a layout without an index.tsx, accessing it should throw a 404, but instead I'm able to access it and it just shows a blank page. Is this intended behaviour and how do I fix it?