Bert-as-service: On Windows: FileNotFoundError: graph optimization fails and returns empty result

[jacky7788]

Prerequisites

• [x ] Are you running the latest bert-as-service?
• [x ] Did you follow the installation and the usage instructions in README.md?
• [x ] Did you check the FAQ list in README.md?
• [x ] Did you perform a cursory search on existing issues?

• TensorFlow version:1.12.0
• Python version:3.6.5

I'm using this command to start the server:

python bert-serving-start -model_dir=../../pre-trained-model/

Then this issue shows up:

[davidlenz]

I had the same issue (Win 10). What fixed it for me was to comment out two lines of logger code in the /server/graph.py file.

logger.info("freezing %d variables...", len(returned_variables))

logger.info("Converted %d variables to const ops.", how_many_converted) 

[hanxiao]

Could you do bert-serving-start -version and tell me your version? as I already solved the logger issue on Windows in #183 and shouldn't be any problem since 1.7.0.

Please do pip install -U bert-serving-server bert-serving-client and upgrade to the latest version and retry.

[jacky7788]

My version is 1.7.5

[jacky7788]

@davidlenz it works! thx!

[hanxiao]

I'm reopening this as a bug.

[aloosley]

I also have the same issue,

• Windows 10
• tf version 1.12.0 (conda tensorflow-gpu venv)
• Same issue with and without -cpu flag
• Python version 3.6.8
• bert-serving-start -version gives: 1.7.4, upgraded now to 1.7.5 but the result is the same.

UPDATE: @davidlenz solution seems to work (tested with GPU)

[hanxiao]

Somehow my logger mysteriously fails on Windows for this particular part. I did a quick fix, could you please give a try on 1.7.6 using pip install -U?

[aloosley]

@hanxiao, thanks for the update. Unfortunately I get the same error with 1.7.6, and it is again fixed by commenting out the logger lines 194 and 248 in graph.py.

[hanxiao]

🤦‍♂️

[hanxiao]

Instead of bumping versions, I'd keep it as it is for now. In the next version, I will remove logger in graph.py for better compatibility on Windows. For all windows users, if you encounter such problem, please refer to the quick fix as https://github.com/hanxiao/bert-as-service/issues/207#issuecomment-455890549 suggested. Meanwhile stay tuned.

[willysys]

I also got this problem. My version is 1.7.6, os is win7 .

[hanxiao]

fyi, this is fixed in #212, the new feature is available since 1.7.7. Please do

pip install -U bert-serving-server bert-serving-client

for the update.

[Constant-TL]

I encountered this problem again in version 1.8.0.