Azure-docs: Sync between depth and color after extraction

[barakooda]

Hi there,
I have record 8 mkv files from 8 synced cameras with offset of 170 micro sec.

After extracting the mkv into color and depth
for example:
ffmpeg -i output.mkv -map 0:0 -vsync 0 color%04d.png
ffmpeg -i output.mkv -map 0:1 -vsync 0 depth%04d.png

Does it output the color and the depth synced ?
can i just use the corresponded files ?
or
i need to sync between them ?
if so , i will have to extract the tumestamp data too no ?

same questions for N mkvs case

---

Document Details

⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

• ID: 5a4c02b2-e5d8-7d29-fbe2-2066a1e0692c
• Version Independent ID: 65cd56a9-2bd1-23bd-dca6-7d7b9f47a63f
• Content: Use Azure Kinect Sensor SDK to record file format
• Content Source: articles/kinect-dk/record-file-format.md
• Product: kinect-dk
• GitHub Login: @xthexder
• Microsoft Alias: jawirth

[xthexder]

ffmpeg alone will not be enough to synchronize the color and depth images, since it's likely 1-2 frames are dropped at the beginning of the recording, especially with multiple cameras. You will need to read each frame's timestamp and compare instead of just using the frame index.

You can see some example code in the SDK (https://github.com/microsoft/Azure-Kinect-Sensor-SDK/tree/develop/examples/playback_external_sync) that will synchronize and sort frames by timestamp across multiple files. You should be able to use this code directly in your app, or output a frame index mapping so you can use the ffmpeg output in another program.

[ketan-chawda-msft]

@barakooda please review the response from @xthexder if that helps.

[barakooda]

@xthexder
I get this error :

error C2440: 'initializing': cannot convert from 'void ' to 'recording_t *'
recording_t files = malloc(sizeof(recording_t) * file_count);

fixed with explicitly casting pointer to recording_t .
recording_t files = (recording_t*) malloc(sizeof(recording_t) * file_count);

[tesych]

@barakooda as I understand correctly the issue is fixed? Is it ok to close this?

[tesych]

@AshokPeddakotla-MSFT please close this issue since the problem seems to be fixed.

[AshokPeddakotla-MSFT]

We will now proceed to close this thread. If there are further questions regarding this matter, please tag me in your reply. We will gladly continue the discussion and we will reopen the issue.

[Tcolbertjr]

This is not authorized me by me. Please leave mybsccountsbalinebbbornillnbebfiijPlease please leave my account alone or I’ll be going to the police Shon asked Ashon a SHON Norman has been harassing me and abusing his privileges and doing things with my account that I have not authorized please stop please stop or I will call for harassment and go to the police for you guys and it’s before all of you guys because this is not authorized by myself I am the account holder and I did not ask anybody to do anything with my account holding my pictures whenever you guys are doing is illegal and please stop

Sent from my iPhone

On Apr 8, 2020, at 2:45 PM, AshokPeddakotla-MSFT [e-mail] wrote:


Closed #49735.

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or unsubscribe.