Influxdb: TSI: Compact series file segment files to remove tombstoned series
TSI currently compacts and removed tombstones from series file lookup maps but does not shrink the segment files. The SeriesFileCompactor should do both.
- Tombstone aggregate tracking #9514
- Tombstone rewriting #9516
- Integration #9517
- Metrics on tombstones/compactions #9518
benbjohnson
All 6 comments
I'm re-opening this as this effort was never completed.
The main thing missing is compaction on series segment files. Currently they can grow unbounded with many new series created and many deletions. There is no way to reduce the size of the segments without a rebuild of the TSI indexes and Series File.
e-dard
on 17 Jan 2019
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
![stale[bot] picture](https://avatars3.githubusercontent.com/in/1724?v=4&s=40)
stale[bot]
on 23 Jul 2019
don't close.
e-dard
on 23 Jul 2019
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
stale[bot]
on 21 Oct 2019
@benbjohnson Here's Edd's branch: https://github.com/influxdata/influxdb/tree/er-series-compact
8none1
on 10 Jan 2020
This PR addresses the issue for the 1.8 release: https://github.com/influxdata/influxdb/pull/16542
8none1
on 21 Jan 2020
Related issues
jayannah
路
3Comments
Raniz85
路
3Comments
airyland
路
3Comments
binary0111
路
3Comments
jonira
路
4Comments
Most helpful comment
I'm re-opening this as this effort was never completed.
The main thing missing is compaction on series segment files. Currently they can grow unbounded with many new series created and many deletions. There is no way to reduce the size of the segments without a rebuild of the TSI indexes and Series File.