I use scidb from R. The cluster configuration is 12 instances on 2 servers.
I build R sparse matrices that I send to scidb using the as.scidb function. I am surprised by the time it takes to complete.
Sending an array of 50000 entry takes 3s
The following piece of code takes 80 seconds to complete even though the amount of data to be transferred should be similar to the above query.
U = as.scidb(sparseMatrix(i = sample(1:50000, 50000, replace = TRUE), j = sample(1:50000, 50000, replace = TRUE), x = rnorm(50000), dims = c(50000, 50000)))
Do you know why I observe this behavior?