Hi,
I learnt that MPI does broadcast with some tree-based hierarchical communication, which result in O(log p) latency, where p is the number of processes. However, I'm thinking that if I do the broadcast naively(send to all receivers simultaneously), seems that conceptually the latency can be reduced to O(1).
Does the above make sense? Thanks!
Best Regards,
Fan