org.nd4j.remote.clients

Class JsonRemoteInference<I,O>

java.lang.Object

org.nd4j.remote.clients.JsonRemoteInference<I,O>

Type Parameters:

I - type of the input class, i.e. String

O - type of the output class, i.e. Sentiment

public class JsonRemoteInference<I,O>
extends Object

This class provides remote inference functionality via JSON-powered REST APIs. Basically we assume that there's remote JSON server available (on bare metal or in k8s/swarm/whatever cluster), and with proper serializers/deserializers provided we can issue REST requests and get back responses. So, in this way application logic can be separated from DL logic. You just need to provide serializer/deserializer and address of the REST server, i.e. "http://model:8080/v1/serving"

Author:

raver119@gmail.com

Constructor Summary

Constructors

Constructor and Description
JsonRemoteInference(@NonNull String endpointAddress, JsonSerializer<I> inputSerializer, JsonDeserializer<O> outputDeserializer, BinarySerializer<I> inputBinarySerializer, BinaryDeserializer<O> outputBinaryDeserializer)

Method Summary

Modifier and Type	Method and Description
O	predict(I input) This method does remote inference in a blocking way
Future<O>	predictAsync(I input) This method does remote inference in asynchronous way, returning Future instead

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

JsonRemoteInference

public JsonRemoteInference(@NonNull
                           @NonNull String endpointAddress,
                           JsonSerializer<I> inputSerializer,
                           JsonDeserializer<O> outputDeserializer,
                           BinarySerializer<I> inputBinarySerializer,
                           BinaryDeserializer<O> outputBinaryDeserializer)

Method Detail

predict

public O predict(I input)
          throws IOException

This method does remote inference in a blocking way

Parameters:

input -

Returns:

Throws:

IOException

predictAsync

public Future<O> predictAsync(I input)

This method does remote inference in asynchronous way, returning Future instead

Parameters:

input -

Returns: