This part of this page explains that TSI PAYG keeps data in hot storage and in cold storage.
The data in cold storage is saved in a storage account using parquet files. Does this mean that the data is only available in parquet after the data has exceeded the 'hot storage ttl' ? Or is data immediately stored in cold storage ? (If that is the case, it means that we might consider to not create an 'archive endpoint/route' anymore on IoT Hub to archive the incoming data).
⚠Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.
@fgheysels Thank you for bringing this to our attention. It looks like you are seeking some clarification of the documentation. I will have the content team review this and make updates where appropriate.
Hi @fgheysels great question. When data is ingested into TSI it is written to both warm and cold stores, and is available for query from either. Please note that to specify that you want to route a query to cold you'll set the storeType param and also note that there is a billing meter for cold.
@fgheysels I went ahead and changed this to a product-question and since it appears this has been answered, I am going to close this issue. If there are further questions regarding this matter, please comment and we will gladly continue the discussion.
Most helpful comment
Hi @fgheysels great question. When data is ingested into TSI it is written to both warm and cold stores, and is available for query from either. Please note that to specify that you want to route a query to cold you'll set the storeType param and also note that there is a billing meter for cold.