Matomo: NoSQL support

[robocoder]

Using Mongodb, Hadoop, Tokudb, Piwik could scale to greater limits.

This ticket is an invitation to the community to comment and discuss the Nosql support of Piwik!

References:

• Piwik nosql faq

[mattab]

Reopening as there is a lot of interest from the community to build a Nosql version of Piwik!

[mattab]

two years ago we have discussed this topic in the past Nosql for Piwik for a GSoC proposal: https://github.com/piwik/piwik/wiki/GSoC-2013#project-gsoc1-multiple-database-support-implement-mongodb-adapter

[timofeytt]

Well, it doesn't have to be completely No SQL. You may look into ClickHouse - the column-oriented DBMS used by Yandex for its own web analytics. It even has SQL syntax, so it doesn't require a complete rewrite of Piwik.

[gebi]

Yes, clickhouse would be a really nice backend!

[gmenegatti]

We have just contacted Piwik's team in order to check the viability to integrate SlicingDice as a backend for Piwik. Let's see how it goes.

[faust64]

What about Cassandra?

[mattab]

FYI Clickhouse would be the more likely candidate we would look into eventually, as it's SQL compatible

[approached]

Benchmark looks good: https://clickhouse.yandex/benchmark.html#[%2210000000%22,[%22ClickHouse%22,%22MySQL%22],[%220%22]]

@mattab what kind of feature you are missing? https://clickhouse.yandex/docs/en/introduction/distinctive_features/#sql-support

[tsteur]

While it has SQL support you need to look into some details. Eg does it support delete/update and if supported, is it fast. Does it support eg 10 to 20 joins, does it support all kind of alter table statements etc.

[tsteur]

Closing this issue as a duplicate of https://github.com/matomo-org/matomo/issues/7526