v0.9.0

New features

• Add Cortex Python client #488 #467 (vishalbollu)
• Add Cortex support CLI command #491 #336 (vishalbollu)
• Add configure --print CLI command 52ceae3 (deliahu)

Bug fixes:

• Prevent load balancer from timing out requests #490 adcf18c #487 (vishalbollu)
• Remove unnecessary lock in operator init 411bac6 (deliahu)
• Silence stale API saved status not found errors aeac492 (deliahu)
• Remove availability zone configuration 2e8913b #494 (deliahu)
• Show correct URL upon failed HTTP request from CLI #504 (vishalbollu)

Examples

• Shorten gpt-2 model output length 1a56661 (deliahu)

Misc

• Validate access to cortex bucket on deploy #511 #502 (deliahu)
• Remove cortex namespace configuration option abdc0cd (deliahu)

v0.8.0

New features

• Add prediction response tracking #322 #360 #378 #419 #481 81718b4 #225 (vishalbollu)
• Add networking metrics (latency, error codes) #278 #420 #475 #472 #187 (vishalbollu, 1vn)
• Support importing local python files in handlers #398 #452 (1vn, vishalbollu)
• Support TensorFlow model directories on S3 #323 #373 #215 #366 (1vn)
• Support user-specified TensorFlow signature def keys #365 #471 #459 #343 (1vn, vishalbollu, deliahu)
• Improve signature def detection #460 28dc989 #451 (vishalbollu)
• Add debug mode to API requests #369 #328 (1vn)
• Support print statements in handlers #406 #377 #339 (vishalbollu, 1vn)
• Automatically configure operator URL when installing Cortex #401 #334 (1vn)

Bug fixes:

• Evict pods that consume too much memory #426 #424 (deliahu)
• Show logs from init containers #393 #324 (vishalbollu)
• Support "None" dims in model signatures #465 (deliahu)
• Fix line wrapping with CLI --watch flag b4f7257 (deliahu)

Examples

• Convert example model code to notebooks #480 (deliahu)
• Add GPT-2 text generation example #353 (1vn)
• Add Bert sentiment anaylsis example #295 (1vn)
• Add Alexnex Pytorch example #477 (vishalbollu)
• Add Imagenet inception example #344 #318 (1vn)
• Add normalizaion to iris sklearn example #337 (deliahu)

Misc

• Remove sample key from prediction API and prediction key from prediction response #399 #389 (vishalbollu)
• Remove response key from TensorFlow prediction response #478 (vishalbollu)
• Pass onnx model output directly to post_inference request handler #476 (vishalbollu)
• Use HTTP endpoints by default #350 #327 (1vn)
• Remove verbose flag from logs command #400 #391 (vishalbollu)
• Add operator AWS credentials #349 (ospillinger)
• Replace non-ready APIs without rolling update #448 #407 (deliahu)
• Autocast numpy objects to appropriate type #384 #338 (vishalbollu)
• Add out-of-memory error #418 #372 (deliahu)
• Add more fine-grained status messages #440 #408 (deliahu)
• Don't require --force once min replicas are met #449 #359 (deliahu)
• Validate that requested resources can fit in a node before deploying #379 #306 (1vn)
• Validate that request handlers exist before deploying #438 #427 #428 (vishalbollu)
• Enforce zip file size limit #457 #437 (vishalbollu)
• Support numeric CPU values in API configuration #413 #395 (deliahu)
• Improve handler loading error messages #382 #352 #479 #292 #341 (vishalbollu)
• Improve cortex.sh configuration and logging d4e7738 577b31e 5a96fa7 08fde5b 994a49b 4c196a6 (deliahu, ospillinger)
• Add timestamp to logs #402 #390 (vishalbollu)
• Only read deployment configuration from cortex.yaml #396 #387 (deliahu)
• Rename default environment to "default" 6051dcd (deliahu)
• Set Python version to 3.6 #461 (deliahu)
• Update TensorFlow version to 1.14 ba0b541 (deliahu)
• Use Istio for networking #237 #374 #201 (1vn deliahu)
• Stream logs from cloudwatch #447 #466 (vishalbollu)

v0.7.3

Bug fixes:

• Update TensorFlow create_raw_prediction_request 55f9916 bcc5401 (1vn)

Misc

• CLI output redesign #335 #297 (vishalbollu)
• Add upgrade docs 97e9282 (ospillinger)

v0.7.2

Bug fixes:

• Allow unlimited request body size f846bd8 (deliahu)
• Increase TF Serving GRPC timeout b793524 (1vn)
• Validate prepared sample e8df4f5 (1vn)
• Add TensorFlow data types 73471d5 (deliahu)
• Fix shape inference for TF serving ec3a798 (1vn)

Misc

• Improve model schema printing on errors b793524 (vishalbollu)
• Add API request logging 483fb13 (deliahu)
• Use tensorflow/serving Docker images 2e7a4ac (deliahu)
• Remove sample logging b793524 (1vn)

v0.7.1

Bug fixes:

• Show TensorFlow Serving logs #299 #300 (vishalbollu)
• Update AWS CNI version to 1.5.2 #291 #247 #219 (deliahu)
• Fix handler packages #298 (vishalbollu)
• Update pod status logic d9ced09 af9059f ee4b3fc (deliahu)
• Add retries to metadata downloading #286 #45 (deliahu)

Misc

• Update to TensorFlow 1.14.0 ba0b541 #302 (deliahu)

v0.7.0

New features:

• Add GPU support for serving ONNX models #232 #233 #220 (vishalbollu)
• Set model format based on path if not explicitly specified #251 #206 (vishalbollu)
• Improve get command output for APIs #263 #177 #257 #256 (vishalbollu)
• Aggregate API logs in cortex logs command #227 #214 (vishalbollu)
• Aggregate API logs in CloudWatch #259 #226 (vishalbollu)
• Add CLI command to list active Cortex deployments #268 #117 (vishalbollu)

Misc:

• Improve API ready timestamp #244 (deliahu)
• Prevent scaling immediately after API creation #255 #222 (deliahu)
• Add Cortex Namespace to python modules #230 #205 (vishalbollu)
• Allow ctrl+c to kill the manager process #252 #246 (vishalbollu)
• Improve logging around request handlers #240 #207 #204 (vishalbollu)
• Improve error message for prediction api mismatch #249 #176 (vishalbollu)
• Make all logs one line #216 (vishalbollu)
• Document how to add system packages to docker containers #250 #245 (vishalbollu)
• Replace Argo with in-operator DAG manager #235 #218 (deliahu)
• Improve uninstall process #711017f (deliahu)
• Restructure iris example #270 #266 (vishalbollu)

Full Changelog

v0.6.0

New features:

• Add cluster autoscaler #194 #189 (ospillinger)
• Add pod autoscaler #196 #188 (deliahu)
• Automate/improve installation process, add manager image #193 #192 (ospillinger)
• Add support for serving ONNX models #182 #181 #164 (vishalbollu)
• Support Python pre- and post-processing for inference #182 #178 (vishalbollu)

Misc:

• Add Iris TensorFlow example #208 (1vn)
• Add more fine grained API status #195 (deliahu)

Full Changelog

v0.5.0

New features:

• Remove status command, fold into get and logs #171 #166 #165 (deliahu)
• Remove region for external data fa227d1 #174 (deliahu)
• Return expected input schema for prediction request errors febc293 (deliahu)

Bugs fixes

• Show previous logs for failed API pods f620125 #179 (deliahu)
• Fix external constants ec96d80 (deliahu)

Misc:

• Hide end-to-end components if only using serving ff4910a b0666fb #180 #167 (deliahu)
• Rename app to deployment #175 #180 (deliahu)
• Rename app.yaml to cortex.yaml 355fdfc #168 (deliahu)
• Improve get command resource printing 5e301c6 (deliahu)
• Improve python error message if external data doesn't exist #183 (deliahu)
• Remove init CLI command a044d81 #172 (deliahu)
• Update to go 1.12 #170 #169 (deliahu)

Full Changelog

v0.4.1

New features:

• Support external constants #96 #163 (1vn)

Bug fixes:

• Remove my_model.py from init CLI command fef5fae (deliahu)
• Fix constant data status bug b7e0aa4 (deliahu)
• Support resource references in model target_vocab 597d844 80e091e (deliahu)

v0.4.0

New features:

• Input redesign #72 #154 (deliahu)
• Add estimators #72 #154 (deliahu)
• Support deploying external TensorFlow models #124 #154 (1vn)
• Make raw columns optional #103 #111 (1vn)
• Make aggregators and transformers optional #90 #100 (1vn)
• Respond to prediction request with transformed columns #97 #153 (1vn)
• Support bucket regions for data ingestion #115 #155 (vishalbollu)
• Support not using an ingested column as a raw_column #69 #92 (vishalbollu)
• Update to TensorFlow 1.13 #95 #116 (1vn)
• Update to Spark 2.4.2 #87 (vishalbollu)
• Validate app name does not have underscore #59 #112 (1vn)

Bug fixes:

• Resolve Spark Context file added warnings #79 #137 (1vn)
• Improve built-in index_string data format #68 #127 (1vn)
• Address TF Serving gRPC Warning #61 #128 (1vn)
• Ingestion of Parquet containing int or double columns throw validation errors #91 #92 (vishalbollu)
• Update Argo version #74 #125 (1vn)
• API is sometimes temporarily unavailable when updating #71 #85 (deliahu)
• Resources not allocated to Spark workloads to generate training datasets #56 #86 (vishalbollu)

Misc:

• Add development instructions #64 #102 (1vn)
• Add recommendation example #58 #57 (vishalbollu)

Full Changelog