If the model is really good at tool use, then it will broadly useful as it needs capabilities to generate the tool definition. So, there should be some transferability.
26 karma · joined April 9, 2020
If the model is really good at tool use, then it will broadly useful as it needs capabilities to generate the tool definition. So, there should be some transferability.
We offer testing/evaluation in development ([1], [2]), and production ([3]). You can use pre-built evals ([4]) or create your own ([5]). Do logging ([6]) and go from trace to playground ([7]). For TypeScript & Python.
[1]: https://docs.parea.ai/evaluation/offline/experiments
[2]: https://docs.parea.ai/platform/test_hub/benchmarking
[3]: https://docs.parea.ai/evaluation/evals-in-trace
[4]: https://docs.parea.ai/evaluation/list_of_autoeval_functions
[5]: https://docs.parea.ai/evaluation/evaluation-functions/create
[6]: https://docs.parea.ai/observability/logging_and_tracing
[7]: https://docs.parea.ai/observability/open_trace_in_playground