I am making my first steps with SciDB. I managed to get it up and running on a single Linux machine, including shim. I then ran the following example in an ipython shell:
In : import scidbpy as scidb
In : sdb = scidb.connect('http://localhost:8080')
In : x = sdb.random((800,600))
In : %timeit x[67, 456]
1 loops, best of 3: 1.17 s per loop
In : %timeit x.toarray()
1 loops, best of 3: 2.4 s per loop
I expected this to take some milliseconds. But it takes more than 1 second to extract a single value from a 800x600 array. Is this normal? Or is there something wrong with my installation?
My plan was to use SciDB as a database for (2D) meteorological data. My use cases are, basically, extracting time series for given points, creating 2D plots, and serving these over the Web in “real time”. But if it takes more than 2 seconds to read a 800x600 array from the DB, plotting in real time is pretty hopeless.
Any advice is appreciated!
BTW, why are the R and Python packages communicating with SciDB through HTTP? Wouldn’t Unix Domain Sockets (or even TCP sockets) be much faster?