(For MindSpore 1.2 Only)

Build cloud inference-serving with MindSpore API on CMC training server

Setup & Installation

The detailed instructions are all listed in the documentation below — the content listed on this page is a condensed form from the doc.

Step 1: Downloading .whl file directly

Step 2: Pip Install the wheel file

RESTful Integration — RESTful-based MindSpore Serving Access

On the CMC Apulis platform, log into your instance and change directory to:

Project Directory Structure

The model in this example is a simple Adder network (hence the model name is ‘add’)

  1. **<model_name>/servable_config.py** — Config file for servable services, this is where you register the APIs (method names) that you wish to support for your model here.
  2. **master_with_worker.py** — Configuration for Master/Worker node for lightweight deployment, this is where you configure the IP and port number for your service.

Untitled

<aside> 💡 Only POST method is supported with MindSporeServing. The POST-Request format is: POST <http://$>{HOST}:${PORT}/model/${MODLE_NAME}[/version/${VERSION}]:${METHOD_NAME}

</aside>

Inside **master_with_worker.py** — use the master.start_restful_server API to start the RESTful service. Using the Add network as an example, the following arguments are:

Untitled