Using parfor and parfeval in separate pools

1 view (last 30 days)
Is it possible, or even desirable, to make separate pools of workers that total to the number of cores on a system to speed up code processing?
Take the pseudo-code as an example for a 20-physical-core server:
parpool(16)
p = gcp();
parpool(4)
q = gcp()
parfor i = start:last % p
func1(q, i)
end
where
function func1(q, i)
for j = 0:i
parfeval(q,func2(j),...)
end
end

Accepted Answer

OCDER
OCDER on 22 May 2018
Edited: OCDER on 22 May 2018
I don't think it'll be beneficial nor possible. I get an error like this, since you can't have multiple pools running. Matlab won't know which pool to distribute which data:
parpool(16)
p = gcp();
parpool(4)
q = gcp()
Error using parpool (line 104)
Found an interactive session. You cannot have multiple interactive sessions
open simultaneously. To terminate the existing session, use 'delete(gcp('nocreate'))'.
This seems like the simplest use of parfor for 20 cores:
parpool(20)
parfor i = start:last % p
B(i) = func2(A(i));
end
If this was for working around the 16-core limit when using parpool, this limit was removed in R2014a. See notes here for R2014a, 1st line: https://www.mathworks.com/help/releases/R2017a/distcomp/release-notes.html?rntext=&startrelease=R2014a&endrelease=R2017a

More Answers (0)

Categories

Find more on Parallel Computing Fundamentals in Help Center and File Exchange

Tags

Products


Release

R2017b

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!