What is more efficient: writing to disk or message passing a huge amount of data as an array between a Python node and CPP node?
Does anyone have experience with the following scenario:
A Python node that needs to pass a large amount of float values (an array of images) as a multidimensional numpy array
to a CPP node.
The dilemma: What is better (in terms of memory or speed):
a) To pass the data as a serialized float32[]
message array between these nodes?
b) To write the data to a binary file and just communicate the file's location as a string
msg?
Can you quantify huge?