I am trying to understand how to use Bloodhound but the documentation feels incomplete. What exactly is the "Bloodhound.tokenizers.whitespace"? Can/should I write my own tokenizer function? Are there other options? how does it compare to a simple substring matcher?
I think it just normalizes the query and data source by stripping whitespace. So if the data was "war rabbit" and you typed "warrab" then it would be able to match.
Here's a better explanation of tokenization: https://github.com/twitter/typeahead.js/blob/master/doc/migration/0.10.0.md#tokenization-methods-must-be-provided
Most helpful comment
Here's a better explanation of tokenization: https://github.com/twitter/typeahead.js/blob/master/doc/migration/0.10.0.md#tokenization-methods-must-be-provided