Spacy: intents?

[lmessinger]

Hi Mathew/guys

I cannot thank you enough for creating this project.
One thing I wondered about is slots and intents.
I'm wondering what are my best options for Intent detection - is it something I can do with Spacy? any other tools?

Thanks for any lead and again, thanks for this project

[honnibal]

Hey,

Ultimately slot and intent detection are going to be a different problem for every user. spaCy makes it easy to extract features from text, for use in other machine learning libraries. But your problem is going to be different from any other --- so you still need to collect data, annotate it, and experiment with machine learning solutions.

[amn41]

Hey @lmessinger , am currently working on something which might do what you need. If this is still relevant to you, let me know! Otherwise would love to know about your solution :)

[lmessinger]

Hi

I've resorted to use luis.ai. but it doesnt really work well at all, many bugs. Totally unreliable.

I would love to hear about your solution,yes!

many thanks

[amn41]

rasa NLU is open source and does intent recognition: https://github.com/golastmile/rasa_nlu

[uwol]

spaCy 2.0 now offers a text categorizer, which works perfectly well for intent classification.

@honnibal: Thanks for your great work with spaCy 2.0! By adding textcat, you eliminated the need for us to add a tensorflow/keras Bi-LSTM categorizer on top of your spaCy word vectors!

[ines]

Update: The new train_intent_parser.py example might also be relevant – it shows how to train spaCy's parser to predict semantic relations instead of syntactic dependencies.

Custom processing pipeline components could also be nice approach to add additional semantic information to the Doc, Token and Span.

[honnibal]

@uwol Thanks! There's a fair bit more to say about the text classifier -- lots of parameters to potentially tune :). It can also be useful to get the values from the attention layer, so that you can see which words were used for the classification. Finally, for annotating intents, you might find Prodigy useful.

[honnibal]

With the TextCategorizer now fairly stable, I think this can be closed.

[lock[bot]]

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.