Clickhouse: Can support table based synchronization for MaterializeMySQL?

Created on 24 Sep 2020  路  5Comments  路  Source: ClickHouse/ClickHouse

At present, synchronization is based on database in MaterializeMySQL engine. However, there are many tables under a database. there may be very few tables that need to be synchronized to CH for analysis. so, It is useless and waste of resources to synchronize unneeded tables. if can support table based synchronization for MaterializeMySQL, It will be more flexible and effective

comp-mysql feature

Most helpful comment

Yes, it's very useful.
There are two ways implement this:

  • [ ] Support MaterializeMySQL table engine(It will be implemented in #14541. I understand that this approach is not suitable for synchronizing MySQL ddl, because this may cause the behavior to be inconsistent with other table engines.)
  • [ ] Support filter tables in MaterializedMySQL database engine(In my todo list).

All 5 comments

Yes, it's very useful.
There are two ways implement this:

  • [ ] Support MaterializeMySQL table engine(It will be implemented in #14541. I understand that this approach is not suitable for synchronizing MySQL ddl, because this may cause the behavior to be inconsistent with other table engines.)
  • [ ] Support filter tables in MaterializedMySQL database engine(In my todo list).

can it support sync the views of mysql table, such as some columns,rows of a table?

@zhang2014
Good idea, thanks for your effort, and hope this function can be realized soon

@zhang2014
Have the function of support MaterializeMySQL table engine already began to do it?

15409

Was this page helpful?
0 / 5 - 0 ratings