Don't you find it dangerous to just run the code w/o any sanitizing?
Why not capture a few strategies that the LLM returns as code that can be properly audited (and ran locally improving the overall performance)?
Why not capture a few strategies that the LLM returns as code that can be properly audited (and ran locally improving the overall performance)?
The idea of auditing the strategy is interesting. The flow that we have used for the semantic chunkers up to date has been along these lines where we : 1) Use the utility to generate the code snippets (and do some manual inspection) 2) Test the code snippets against some sample text 3) Validate the results