This update improves the speed of database synchronization by intelligently grouping requests and processing them in parallel. This resulted in a significant reduction in synchronization time – specifically, a 30-database sync that previously took 50 seconds now completes in just 15 seconds. This enhancement improves overall system performance and responsiveness.

With this commit, the requests sent to retrieve the information from the databases are grouped by IP, and each group is treated in parallel using a ThreadPoolExecutor, which uses a pool of 5 times the number of CPUs.

On a set of SaaS databases, we reduced the time needed to synchronize 30 databases from 50s to 15s.