Chatterbot: Key too large to index

Created on 27 Aug 2016 · 11Comments · Source: gunthercox/ChatterBot

Traceback (most recent call last):
  File "./run.py", line 8, in <module>
    read_only=True)
  File "/home/nikhil/PycharmProjects/chatterbot/lib/python3.3/site-packages/chatterbot/chatterbot.py", line 51, in __init__
    self.storage = StorageAdapterClass(**kwargs)
  File "/home/nikhil/PycharmProjects/chatterbot/lib/python3.3/site-packages/chatterbot/adapters/storage/mongodb.py", line 32, in __init__
    self.statements.create_index('text', unique=True)
  File "/home/nikhil/PycharmProjects/chatterbot/lib/python3.3/site-packages/pymongo/collection.py", line 1387, in create_index
    self.__create_index(keys, kwargs)
  File "/home/nikhil/PycharmProjects/chatterbot/lib/python3.3/site-packages/pymongo/collection.py", line 1298, in __create_index
    sock_info, cmd, read_preference=ReadPreference.PRIMARY)
  File "/home/nikhil/PycharmProjects/chatterbot/lib/python3.3/site-packages/pymongo/collection.py", line 208, in _command
    read_concern=read_concern)
  File "/home/nikhil/PycharmProjects/chatterbot/lib/python3.3/site-packages/pymongo/pool.py", line 239, in command
    read_concern)
  File "/home/nikhil/PycharmProjects/chatterbot/lib/python3.3/site-packages/pymongo/network.py", line 102, in command
    helpers._check_command_response(response_doc, None, allowable_errors)
  File "/home/nikhil/PycharmProjects/chatterbot/lib/python3.3/site-packages/pymongo/helpers.py", line 205, in _check_command_response
    raise OperationFailure(msg % errmsg, code, response)
pymongo.errors.OperationFailure: WiredTigerIndex::insert: key too large to index, failing  1132 { : "First of all, basement sales like tonight aren't gonna last much longer.  It's too risky, one, and two, everything's going on the internet.  Anyone wi..." }

Long sentences causing error.

bug

Source

nikhil-pandey

Most helpful comment

Just hit this recently.

itsmehemant123 on 15 Mar 2018

🎉1 👍1

All 11 comments

@nikhil-pandey Exactly what code you executed which resulted that error ?

navyad on 4 Sep 2016

@navyad I was training the bot. It happens when there are long sentences that exceed the mongodb's index limit.

nikhil-pandey on 5 Sep 2016

Happened with me too. I had to split long replies, only taking first sentence or discarding it if it's too long, but it's still a bad solution imho

Nixellion on 19 Oct 2016

Just a note on this, newer versions of ChatterBot include more verbose error handling for MongoDB and part of message for this error now also states distinct too big, 16mb cap.