[ChatHelper] Parallel tool calls

[e-marchand]

• _processToolCalls runs the For each sequentially
• A model can return independent tool_calls in one message
• dispatching them concurrently (e.g. via4D.SystemWorker?) cuts latency.

[miyako]

Technically you don't need multiple workers for concurrent calls. A worker process can run multiple HTTPRequest cycles. However it seems like you need to create a new agent for each request.

https://discuss.4d.com/t/httprequest-intermittent-error-socket-stream-is-over/34498/18

It might be a feature not bug (see https://discuss.4d.com/t/http-request-class-and-agents/37387/7) basically a keep-alive agent can close the socket for pending requests that respond out of sequence).

[e-marchand]

Tool calls are not http request
It could be any task

[miyako]

OK, like sed, grep, etc. The same applies to SystemWorker, you can launch multiple async workers from the same worker process.

[e-marchand]

or any code in 4D that take times or not (query db etc...)
Tools are user code, so we cannot assume what they are doing or even group it by types to make some optimizations [even If description of bug talk about 4D.SystemWorker :(]