feat: High-velocity soul-building

[TomLucidor]

Problem or use case

Sometimes getting a whole website (or worse yet an IA archive of a website) is hard, and Thoth could have a tool to reduce friction, ideally webpage fetching + hyperlink-awareness + exclusion of index/pagination + aware of keywords/tagging/categories, can be streamlined a little

Proposed solution

Based on the following toolkit https://github.com/aaronjmars/soul.md
See also Ribbonfarm as an example aaronjmars/soul.md#20

Area

Memory / knowledge graph

Alternatives considered

No response

[siddsachar]

Thanks. We will review this. v3.22.0 was released yesterday and it now comes with a custom tool builder. You can actually point it to any repo and ask it to analyse and extract a custom tool out of it. Works using natural language and also a UI wizard. You could try that for some of these tools. We will review it for one of the upcoming releases.