Spacy: With spaCy 2.1, is Brown Clusters part required yet?
I trained my model with spaCy v2.0.18 and I trained Brown Clusters which took a long time. Now that spaCy 2.1 is out, are Brown Clusters need yet? I like so much to skip this step if it does not affect the model performance and accuracy.
training
mosynaq
All 5 comments
The clusters aren't required by the models anymore. I agree this was a big relief: I had a lot of trouble getting clusters trained as well, especially on bigger corpora.
honnibal
on 16 May 2019
👍2
🎉1
Are freqs deprecated as well?
aatimofeev
on 16 May 2019
freqs are used to calculate the .prob attribute in the vocabulary. You don't need this for the models, it won't affect accuracy.
honnibal
on 16 May 2019
👍2
That's big relief! Thanks @honnibal!
mosynaq
on 17 May 2019
This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.
![lock[bot] picture](https://avatars1.githubusercontent.com/in/6672?v=4&s=40)
lock[bot]
on 16 Jun 2019
Was this page helpful?
0 / 5 - 0 ratings
Related issues
besirkurtulmus
路
3Comments
ines
路
3Comments
prashant334
路
3Comments
ajayrfhp
路
3Comments
bebelbop
路
3Comments
Most helpful comment
The clusters aren't required by the models anymore. I agree this was a big relief: I had a lot of trouble getting clusters trained as well, especially on bigger corpora.