This interface describes communication primitive for GradientsAccumulator PLEASE NOTE: All implementations of this interface must be thread-safe.
This class provides accumulation for gradients for both input (i.e.
This GradientsAccumulator is suited for CUDA backend.
This MessageHandler implementation is suited for debugging mostly, but still can be used in production environment if you really want that.
This BlockingQueue implementation is suited only for symmetric gradients updates, and should NOT be used anywhere else.
MessageHandler implementation suited for ParallelWrapper running on single box PLEASE NOTE: This handler does NOT provide any network connectivity.