Stockfish: Improve lone-king fortress detection

Created on 15 Apr 2017  路  4Comments  路  Source: ddugovic/Stockfish

Most helpful comment

The problem with such changes is that many of these endgame functions are called extremely rarely, so the change in Elo probably is less than 1 Elo (and also heavily depending on adjudication conditions) and even in official fishtest it is unlikely that one is able to measure this. That is why there are almost no upstream changes to the endgame evaluation functions.

Testing changes to the endgame evaluation functions as simplifications does not work either, since almost any random change would pass due to the small change in Elo. So there would have to be an "opening" book with a very carefully hand-picked set of (close to) endgame positions in order to get a better Elo sensitivity. It is however very difficult to prove that a chosen set is representative and unbiased.

All 4 comments

I have submitted a test which appears to improve Stockfish zugzwang detection:
http://35.161.250.236:6543/tests/view/58f255fe6e23db2fa8081081

The problem with such changes is that many of these endgame functions are called extremely rarely, so the change in Elo probably is less than 1 Elo (and also heavily depending on adjudication conditions) and even in official fishtest it is unlikely that one is able to measure this. That is why there are almost no upstream changes to the endgame evaluation functions.

Testing changes to the endgame evaluation functions as simplifications does not work either, since almost any random change would pass due to the small change in Elo. So there would have to be an "opening" book with a very carefully hand-picked set of (close to) endgame positions in order to get a better Elo sensitivity. It is however very difficult to prove that a chosen set is representative and unbiased.

@ddugovic in official stockfish there was several (countless) propositions to measure endgame ELO, practical steps never followed.

The thread Current status of endgame knowledge is a mandatory reading: as any non measurable thing, endgame code is all about faith :)

"What can be said at all can be said clearly, and what we cannot talk about we must pass over in silence" L. Wittgenstein

Thanks; this all makes sense & now I have read that thread.

Sorry for causing so much concern: my purpose in creating this issue was to demonstrate how infeasible it is to solve every problem reported by a user, yet error reports are taken seriously.

Was this page helpful?
0 / 5 - 0 ratings

Related issues

ianfab picture ianfab  路  6Comments

Vinvin20 picture Vinvin20  路  12Comments

ianfab picture ianfab  路  9Comments

ddugovic picture ddugovic  路  10Comments

Vinvin20 picture Vinvin20  路  11Comments