I get an error because of "lasso" function and the interplay to Tall Arrays/Datastore.
I use tall arrays for Feature Engineering. The next step is to do a huge amount of feature engineering. About 500.000 features. At this point, the tall arrays are written to the disk. Afterwards, the data of the datastore is called via the tall array command. The written data has then about 60 GB.
X_tall = tall(ds);
lambda = [0.5 0.75 1];
Error using tall/gather (line 50)
Unable to access intermediate data in the temporary folder, most likely because it ran out of space. Clear space on the local
drive, or avoid operations that reorder tall arrays (such as SORT or indexing with a tall numeric column vector).
Learn more about errors encountered during GATHER.
Error in tall/lasso (line 73)
[xtx, xty, yty, n, p, muX, muY, sigX] = gather(xtx,xty,yty, n, p, muX, muY, sigX);
Error in lasso_20211103 (line 128)
Error in adding keys and values.
Value max size exceeded for database
(string or blob too big)