How can I get higher throughput using fread with tcpip?
3 views (last 30 days)
Show older comments
I have a device that produces a binary data stream of approx 3MB/sec, i.e. roughly 30Mbps, on a tcpip port.
Tried a few different things with fread using the tcpip object of the Instrument Control Toolbox; but can only get around 2Mbps.
1 Comment
Friedrich
on 11 Feb 2014
What is you code? How do you read the data? How did you configure your TCPIP object on the MATLAB side?
Answers (3)
Philipp S.
on 23 Mar 2019
Has the performance of the tcpip / icinstrument fread been improved since? I'm getting just the same weird behaviour here. And I am not quite happy implementing the suggested workaround.
The problem seems to be rooted in the underlying Java method called by icinstrument, as almost all of the time is spent in line 234 of icinstrument.fread:
out = fread(igetfield(obj, 'jobject'), totalSize, type, signed);
1 Comment
Tom DeLonge
on 27 Mar 2019
Have you found a solution? Which workaround are you referring to? Reading data in chunks?
Vinod
on 14 Feb 2014
There are a lot of details to look into -
- Are the two devices on the same network/subnet?
- Is there other networks traffic that could be slowing things on the network?
- Are you using the optimum input and output buffer sizes when creating your TCPIP object?
- Could you use a cross over cable between the device and your computer to cut out other factors?
Vinod
on 14 Feb 2014
Good to know you've eliminated other potential bottlenecks.
We've done performance tests that achieve in excess of 45 Megabytes/s for binary data using gigabit networks that had other data running through it at the same time. We did find that the number of bytes being FREAD in each read affected the throughput. The best throughput we achieved was with a large inputbuffersize (1e9) and reading in data in chunks of 1e6 (i.e., fread(tcpipReadObj,1e6)).
I suspect you may need to pick some optimum parameters for FREAD size to get the throughput you need. If you are doing any datatype conversions, they may add to your overheads on the FREAD.
0 Comments
See Also
Categories
Find more on Instrument Control Toolbox Supported Hardware in Help Center and File Exchange
Products
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!