Autogluon: Text Classification Customized Dataset

Created on 19 Dec 2019  路  6Comments  路  Source: awslabs/autogluon

TODO: need to implement customized dataset for NLP
some prototype we can use:

https://github.com/awslabs/autogluon/blob/master/autogluon/task/text_classification/dataset.py#L109

feature request nlp urgent

Most helpful comment

This feature is very necessary. Without supporting customized datasets, the TextClassification is hard to use for real data. The dataset class in the tabular is more feature complete, and we would better to adopt a consistent interface. Basically, allowing loading data from path or a pandas dataframe

All 6 comments

This feature is very necessary. Without supporting customized datasets, the TextClassification is hard to use for real data. The dataset class in the tabular is more feature complete, and we would better to adopt a consistent interface. Basically, allowing loading data from path or a pandas dataframe

@Innixma Excuse me, do you support the case of Chinese data set?

@Innixma Excuse me, do you support the case of Chinese data set?

At present for Tabular, a Chinese data set for text will not work well due to the lack of space characters to generate ngrams with. In regards to the text classification module, @cgraywang can you answer this?

@Innixma do you support customized dataset for text classification now?

@Innixma do you support customized dataset for text classification now?

We will once #556 is merged, which is a full overhaul to the TextClassification task.

Easy usage of custom text datasets has been addressed in: https://github.com/awslabs/autogluon/pull/556

Was this page helpful?
0 / 5 - 0 ratings

Related issues

misterm10 picture misterm10  路  3Comments

ZhangSanMo picture ZhangSanMo  路  6Comments

tigerhawkvok picture tigerhawkvok  路  6Comments

nathan-wood picture nathan-wood  路  5Comments

oke-aditya picture oke-aditya  路  7Comments