Canary Promotion

Launch a SKLearn model and update model by canarying

Iris Model

iris

We will:

  • Deploy a pretrained sklearn iris model
  • Load test the model
  • View request payloads
  • Canary a new XGBoost model
  • Load test canary model
  • Promote the canary model

Deploy Model

deploy1

Use the model url:

gs://seldon-models/sklearn/iris

Start Load Test

Complete the load test wizard:

Use the request.json file in this folder:

{
    "data": {
	"names": ["Sepal length","Sepal width","Petal length", "Petal Width"],
	"ndarray": [
	    [6.8,  2.8,  4.8,  1.4],
	    [6.0,  3.4,  4.5,  1.6]
	]
    }
}

load1

When running you should see metrics on dashboard. Enter the request logs screen to view requests.

logs

Create Canary

Create an XGBoost canary model using the saved model at:

gs://seldon-models/xgboost/iris

canary

Rerun the load test and you should see metrics for both default and canary models.

canary-load

Promote the XGBoost Canary to be the main model.

promote


Last modified September 5, 2020: Update Demos section (91a072d)