Quick Start

Train or download the TensorFlow SavedModel.

import tensorflow as tf

export_dir = "./model/1"
input_keys_placeholder = tf.placeholder(
    tf.int32, shape=[None, 1], name="input_keys")
output_keys = tf.identity(input_keys_placeholder, name="output_keys")

session = tf.Session()
tf.saved_model.simple_save(
    session,
    export_dir,
    inputs={"keys": input_keys_placeholder},
    outputs={"keys": output_keys})

This script will export the model in ./model.

Start serving to load the model.

simple_tensorflow_serving --model_base_path="./model"

Check out the dashboard in http://127.0.0.1:8500 in web browser.

dashboard

Generate the clients for testing without coding.

curl http://localhost:8500/v1/models/default/gen_client?language=python > client.py

python ./client.py