Autogluon: Predictor Object for AutoGluon Fit API

Created on 14 Oct 2019  路  4Comments  路  Source: awslabs/autogluon

Issue tracker for discussion with @jwmueller @cgraywang today.

results returned by fit may not be a good way to saving state and handling multiple experiments.

We decide to make a Predictor object which contains the following method:

save()
load()
predict()
evaluate()
good first issue

All 4 comments

I think this object should also support a fit_summary() method which returns something like the current Results object, with more informative/comprehensive instance-variable names as described here:

https://github.com/awslabs/autogluon/issues/32

Also I'd make sure all task.fit() calls automatically call save at the end before returning. We do not want to burden the user with having to explicitly call save.

By the way, load() should be a class method, so the user can call task.load(filepath) without any predictor object.
In contrast, save() should be an instance method, so the user calls predictor.save(filepath).

Just to be clear, we should also try to ensure predictor.predict() is overloaded to be able to handle:
1) single example (e.g. single image, single document)
2) batch of many examples
3) MXNet Dataset object (ie. already preprocessed examples with a defined iterator)

For classification tasks, the sklearn convention is to use: predict_proba underneath the hood to produce predicted class probabilities, and then predict is just a wrapper around this that computes the argmax of the class probabilities.

Just to be clear, we should also try to ensure predictor.predict() is overloaded to be able to handle:

  1. single example (e.g. single image, single document)
  2. batch of many examples
  3. MXNet Dataset object (ie. already preprocessed examples with a defined iterator)

For classification tasks, the sklearn convention is to use: predict_proba underneath the hood to produce predicted class probabilities, and then predict is just a wrapper around this that computes the argmax of the class probabilities.

This is great suggestion. I will work on it 馃憤

Was this page helpful?
0 / 5 - 0 ratings

Related issues

Innixma picture Innixma  路  5Comments

tigerhawkvok picture tigerhawkvok  路  6Comments

braaannigan picture braaannigan  路  5Comments

mli picture mli  路  6Comments

rebotnix picture rebotnix  路  3Comments