Katib: Upgrade Goptuna to v0.8.0 which supports IPOP-CMA-ES and BIPOP-CMA-ES.

[c-bata]

/kind feature

Describe the solution you'd like

I've just released Goptuna v0.6.0. It includes IPOP-CMA-ES and BIPOP-CMA-ES supports. As the benchmark results of two-dimensional Rastrigin function shows, these algorithms outperforms on multimodal functions.

• Auger, A., Hansen, N.: A restart CMA evolution strategy with increasing population size. In: Proceedings of the 2005 IEEE Congress on Evolutionary Computation (CEC’2005), pp. 1769–1776 (2005a)
• Hansen N. Benchmarking a BI-Population CMA-ES on the BBOB-2009 Function Testbed. In the workshop Proceedings of the Genetic and Evolutionary Computation Conference, GECCO, pages 2389–2395. ACM, 2009.

TODOs

• [ ] Add Katib options to enable IPOP-CMA-ES and BIPOP-CMA-ES.
• [ ] Add Katib options to set TPE sampler options.
• [ ] Remove the use of deprecated APIs (Some study options are renamed).

Anything else you would like to add:
[Miscellaneous information that will assist in solving the issue.]

[issue-label-bot[bot]]

Issue-Label Bot is automatically applying the labels:

| Label | Probability |
| ------------- | ------------- |
| area/front-end | 0.59 |
| area/katib | 0.73 |

Please mark this comment with :thumbsup: or :thumbsdown: to give our bot feedback!
Links: app homepage, dashboard and code for this bot.

[c-bata]

/assign @c-bata

[andreyvelich]

@c-bata Thank you very much for contributing with this!

I think you can directly add changes for v1beta1 version, since v1alpha3 has been already released and we have plans to release v1beta1 later.

[gaocegege]

Cool! Thanks for the awesome work.

[stale[bot]]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[andreyvelich]

/lifecycle frozen

[c-bata]

Probably I will be able to open a pull request next month.

The latest version of Goptuna also supports Sobol's quasirandom sequence.
https://github.com/c-bata/goptuna/releases/tag/v0.8.0

[andreyvelich]

That's great, thank you for your help @c-bata!