Esmvaltool: MAGIC WP5 Ensemble Clustering (EnsClus) cluster analysis tool for ensembles of climate model simulations

[IreMav]

Namelist to call a cluster analysis tool based on the k-means algorithm for ensembles of climate model simulations.

Wiki for the stand-alone version:
https://github.com/IreMav/EnsClus/blob/master/README.md

Latest version for ESMValTool v2:
https://github.com/ESMValGroup/ESMValTool/tree/fix_ensclus

Namelist
https://github.com/ESMValGroup/ESMValTool/blob/fix_ensclus/esmvaltool/namelists/namelist_EnsClus_CMIP5.yml

Python script:
https://github.com/ESMValGroup/ESMValTool/blob/fix_ensclus/esmvaltool/diag_scripts/EnsClus.py

Auxiliary Python routines in:
https://github.com/ESMValGroup/ESMValTool/tree/fix_ensclus/esmvaltool/diag_scripts/aux/EnsClus

Current status: the script works but has a few open issues to be discussed.
1) The tool works when the input data are interpolated on a common grid.
2) The script esmvaltool/diag_scripts/EnsClus.py has to be copied in .../miniconda3/envs/esmvaltool/lib/python3.6/site-packages/ESMValTool-1.1.1.dev1720+g6c9ba273-py3.6.egg/esmvaltool/diag_scripts. Why?

[mattiarighi]

There is no need to manually copy the diag script to the miniconda3 path.
This is done automatically by the installation procedure, which is executed by calling

python setup.py install

See the installation guide of v2.0 for more details.

Note that the installation has to be repeated after any change in the ESMValTool source path (you can see that as a sort of _compiling_).

[mattiarighi]

Concerning the first point in your post, the interpolation to a common grid should be straightforward in v2.0, just using the regridding functionality of the preprocessor (see namelist_perfmetrics_CMIP5.yml for an example).

[IreMav]

Thank you for your quick reply.
I have solved the installation issue trying again thepython setup.py install command and test (I had to call it while the esmvaltool environment was activated).
I have solved the regridding issue as you suggested, by adding the following in the namelist: preprocessors: preproc: regrid: target_grid: 2.5x2.5.
Now it works and it is synchronized on GitHub in the fix_ensclus branch.

[jhardenberg]

Now that the REFACTORING_ensclus branch has been merged in https://github.com/ESMValGroup/ESMValTool/pull/736 has been merged we can close this issue.