I’ve been looking into parallel load scenarios using my own code, and thought I could do the following:
aql: create array timeseries_set<timeseries:int64,time:double,value:double>[row=0:*,1000000,0] afl: load(timeseries_set, '/shared/a', 0, '(int64,double,double)') afl: load(timeseries_set, '/shared/b', 1, '(int64,double,double)')
… the idea being that two separate processes could write data in binary load format to named pipes “a” and “b” in a shared filesystem and have the data loaded by SciDB instances 0 and 1, respectively. However, it seems that this is actually treated as two consecutive loads of the array, with one overwriting the other. Am I missing something? This seems to negate the value of being able to specify a particular instance in load(), as it appears that the only way to do a parallel load is to use -1 for the instance?