Haystack: Probability value is more than 100% in case of FAQ with elastic search while dealing with Tutorial 4 Even I tried the same colab.

[Gourav-infobiz]

[tholor]

Hey @Gourav-infobiz ,

Thanks for reporting this bug. Happy to investigate and fix this. What Elasticsearch version are you using here?

[Gourav-infobiz]

I am using elastic search 7.6.2 and 7.9.2 in both cases i am getting this error

[tholor]

Are you by any chance using farm-haystack==0.4.0 here (as in #662)? If yes, please update to haystack 0.5.0, elasticsearch 7.9.2 and verify if this bug persists. Thanks!

[Gourav-infobiz]

I am Using the updated version i.e farm-haystack==0.5.0 and Elasticsearch== 7.9.2 only.

But still I am getting error. @tholor

[Gourav-infobiz]

I am Using the updated version i.e farm-haystack==0.5.0 and Elasticsearch== 7.9.2 only.

But still I am getting error. @tholor

Please See @tholor

[tholor]

Ok, thanks for the update. @brandenchan will investigate this in the next days.
If you have an example (i.e. document + query + used embedding model) where this probability > 100% happens, it would accelerate his debugging work a lot.

[Gourav-infobiz]

Ok, thanks for the update. @brandenchan will investigate this in the next days.
If you have an example (i.e. document + query + used embedding model) where this probability > 100% happens, it would accelerate his debugging work a lot.

Sure you may share your email i will try to share the same. Even you may refer this
(https://colab.research.google.com/github/deepset-ai/haystack/blob/master/tutorials/Tutorial4_FAQ_style_QA.ipynb)
as well because i tried to run this notebook even same result getting prob > 100%

[tholor]

branden.chan [at] deepset [dot] ai

[Gourav-infobiz]

branden.chan [at] deepset [dot] ai

Please follow the above link. in my edited comment.

[brandenchan]

Hi @Gourav-infobiz, this issue was coming up due to a bug in the scaling functions that convert similarity scores to probabilities. I have been working on this in #667. Would you like to try it out? If you pull the new branch called scale_prob you can try the changes. Otherwise they should be merged in to master very soon.

[Gourav-infobiz]

Hi @Gourav-infobiz, this issue was coming up due to a bug in the scaling functions that convert similarity scores to probabilities. I have been working on this in #667. Would you like to try it out? If you pull the new branch called scale_prob you can try the changes. Otherwise they should be merged in to master very soon.

Thanks for the response! Ok will check the same.