org.nd4j.remote.grpc

Class GraphInferenceGrpcClient

java.lang.Object

org.nd4j.remote.grpc.GraphInferenceGrpcClient

public class GraphInferenceGrpcClient
extends Object

This class is a wrapper over GraphServer gRPC complex

Author:

raver119@gmail.com

Constructor Summary

Constructors

Constructor and Description
GraphInferenceGrpcClient(@NonNull io.grpc.ManagedChannel channel) This method creates new GraphInferenceGrpcClient over given ManagedChannel
GraphInferenceGrpcClient(@NonNull String host, int port) This method creates new GraphInferenceGrpcClient, with plain text connection
GraphInferenceGrpcClient(@NonNull String host, int port, boolean useTLS) This method creates new GraphInferenceGrpcClient, with optional TLS support

Method Summary

Modifier and Type	Method and Description
void	dropGraph(long graphId) This method allows to remove graph from the GraphServer instance
Operands	output(long graphId, @NonNull Operands operands)
INDArray[]	output(long graphId, Pair<String,INDArray>... inputs) This method sends inference request to the GraphServer instance, and returns result as array of INDArrays
<T> T	output(long graphId, T value, OperandsAdapter<T> adapter) This method is suited for use of custom OperandsAdapters
INDArray[]	output(Pair<String,INDArray>... inputs) This method sends inference request to the GraphServer instance, and returns result as array of INDArrays PLEASE NOTE: This call will be routed to default graph with id 0
void	registerGraph(long graphId, @NonNull SameDiff graph, ExecutorConfiguration configuration) This method adds given graph to the GraphServer storage PLEASE NOTE: You don't need to register graph more then once PLEASE NOTE: You don't need to register graph if GraphServer was used with -f argument
void	registerGraph(@NonNull SameDiff graph) This method adds given graph to the GraphServer storage
void	shutdown() This method shuts down gRPC connection

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GraphInferenceGrpcClient

public GraphInferenceGrpcClient(@NonNull
                                @NonNull String host,
                                int port)

This method creates new GraphInferenceGrpcClient, with plain text connection

Parameters:

host -

port -

GraphInferenceGrpcClient

public GraphInferenceGrpcClient(@NonNull
                                @NonNull String host,
                                int port,
                                boolean useTLS)

This method creates new GraphInferenceGrpcClient, with optional TLS support

Parameters:

host -

port -

GraphInferenceGrpcClient

public GraphInferenceGrpcClient(@NonNull
                                @NonNull io.grpc.ManagedChannel channel)

This method creates new GraphInferenceGrpcClient over given ManagedChannel

Parameters:

channel -

Method Detail

shutdown

public void shutdown()
              throws InterruptedException

This method shuts down gRPC connection

Throws:

InterruptedException

registerGraph

public void registerGraph(@NonNull
                          @NonNull SameDiff graph)

This method adds given graph to the GraphServer storage

Parameters:

graph -

registerGraph

public void registerGraph(long graphId,
                          @NonNull
                          @NonNull SameDiff graph,
                          ExecutorConfiguration configuration)

This method adds given graph to the GraphServer storage PLEASE NOTE: You don't need to register graph more then once PLEASE NOTE: You don't need to register graph if GraphServer was used with -f argument

Parameters:

graphId - id of the graph, if not 0 - should be used in subsequent output() requests

graph -

output

public INDArray[] output(Pair<String,INDArray>... inputs)

This method sends inference request to the GraphServer instance, and returns result as array of INDArrays PLEASE NOTE: This call will be routed to default graph with id 0

Parameters:

inputs - graph inputs with their string ides

Returns:

output

public <T> T output(long graphId,
                    T value,
                    OperandsAdapter<T> adapter)

This method is suited for use of custom OperandsAdapters

Type Parameters:

T -

Parameters:

adapter -

Returns:

output

public Operands output(long graphId,
                       @NonNull
                       @NonNull Operands operands)

output

public INDArray[] output(long graphId,
                         Pair<String,INDArray>... inputs)

This method sends inference request to the GraphServer instance, and returns result as array of INDArrays

Parameters:

graphId - id of the graph

inputs - graph inputs with their string ides

Returns:

dropGraph

public void dropGraph(long graphId)

This method allows to remove graph from the GraphServer instance

Parameters:

graphId -