Unlisted pages appear in llms.txt

[honzajavorek]

See #2275 (comment), for example https://docs.apify.com/platform/integrations/make/youtube is present in https://docs.apify.com/llms.txt

[TC-MO]

the page (and other related) in question has been removed as it was overdue for it, but the issue still stands, we might make use of unlisted in the future,and they should not under any circumstances show up in llms.txt

[TC-MO]

@webrdaniel This is the issue I mentioned last time we spoke

[B4nan]

I'd be surprised if this is not an upstream bug.

[birosrichard]

This is actually an upstream bug caused by the plugin we use. A few months ago I reported an issue. They told me that the fix will come in the new version. But the version is nowhere to be released yet. I created a PR that fixes this issue in their codebase.