Load data is so slowly


#1

When i load data more than 50000 row,it’s very snowly.

AFL% create array A <id:int64,alpha:double, delta:double> [i=0:*,1,0];
Query was executed successfully
AFL% load(A, '/root/Desktop/5w1 (copy).txt');

The load speed is not as fast as i expected.It’s very slow.How can i slove my problem. Thank you.
My data format is:
[(1,95.2598839,61.1183840)];

[(2,95.7973775,61.1192713)];

[(3,97.9809146,61.1025673)];

[(4,93.1733440,61.0910288)];

[(5,95.4062493,61.1113993)];

[(51110,91.3307057,61.0377044)]


#2

First and foremost, try to make chunk size larger than 1. For one-dimensional dense arrays, 500,000 - 1,000,000 would be a good number. That should speed things up.

After that works, you can further speed load up by parallelizing it.