Anki-android: Feature request: Record speech for comparison with audio on card

[hssm]

Originally reported on Google Code with ID 1319

Please explain your idea here.
When reviewing a foren language, some facts may include audio. I'd like to make a card
like this:

Q
1. The card's audio is played
2. Audio recording is activated (automatically or by pressing some button) so that
I can record my pronunciation of the phrase.

A
1. When pressing "Show answer", my recording is played back
2. The original audio is played back for comparison (maybe after a short delay)
3. I rate my answer according to the accuracy of the pronunciation.
4. Delete recorded audio.

The quality of the audio may not need to be very high for speech, I think.


Is this feature available on similar apps (Anki Desktop, AnkiMobile,
AnyMemo, etc) ? If yes, it could help to include a screenshot or link to a page explaining
the feature.

I think there is a plugin for pre-2 Anki, but I have never used it, so I don't know
whether it works as I have described, or will/can be ported to 2.x. 

This would be a nice feature for all platforms, though, so some discussion between
the projects would probably be necessary. I have not suggested this to the Anki project,
since ankidroid is what I use daily; let me know if I should.

Reported by [email protected] on 2012-08-13 20:21:48

[hssm]

Just to clarify:
I would create the cards in Anki desktop; only the ability to record and replay the
audio as described would be new to this project.

Reported by [email protected] on 2012-08-13 21:45:26

[hssm]

The signal processing part could be difficult, but great idea! :-)

Reported by nicolas.raoul on 2012-08-14 00:54:36

• Status changed: Accepted
• Labels added: Priority-Medium
• Labels removed: Priority-Undecided

[hssm]

> The signal processing part could be difficult,

I don't think it has to be: A comparison of the audio files by ankidroid isn't what
I meant; use of user's ears should suffice for most of us...

It's just that it's hard to hear whether what actually comes out of one's mouth matches
the audio played back from the card. It's much easier to hear if two recordings sound
approximately the same.  

Reported by [email protected] on 2012-08-14 01:47:55

[hssm]

I just noticed that Anki seems to have this feature:
In the "Studying/Editing and more" section of the manual there are descriptions of
"Record Own Voice" and "Replay Own Voice" that matches what I had in mind when I opened
this issue.

http://ankisrs.net/docs/manual.html#editing-and-more

Is there any chance that this could be implemented in ankidroid too?

Reported by fropeters on 2015-04-12 13:57:06

[koendv]

I patched Ankidroid to do just that. You can download an Ankidroid binary and a sample deck from the github

[dvopalecky]

I would use such feature for the following use case:
Having cards with Bible verses which have sometimes 50+ words.
Question: Verse reference. I press audio button and record the answer.
Answer: The answer is displayed and my recording is played back, so that I can check that I said the whole verse correctly word for word.

This feature is available in the http://www.remem.me/ app, but I would prefer to have it in AnkiDroid also.

I will probably check @koendv solution, but it would be nice to have it in the official version as well.

[mikehardy]

@koendv that's fascinating - you've got a good fork there. It's not too far off from master even now (I looked at the diff - looks like lots of localization stuff but the feature itself isn't too heavy - it's pretty self-contained).

Do you have any interest in trying to integrate with mainline? I could try to help shepherd it to a merge as long as we could figure out a way to do it well and Tim likes the idea.

The only thing that gives me pause is that the DSP jar is 11MB and right now AnkiDroid in total is around 8MB, so this would grow the app a lot (your release is 20.8MB total for the APK). It looks like the added libraries are about 5MB per CPU architecture, so if we used the new split-APK style the majority of the users would probably see about the same 8MB APK. I think it has potential, what do you think @timrae ?

[dvopalecky]

@koendv, I checked you solution for my use case on Bible verses.
Currently it's not usable for my use case because of two reasons:
1) There is a limit on the audio length that you can record while reviewing - probably about 10 seconds. Sometimes my cards have longer texts, so I would need the limit to be increased to 1 or maybe even 2 minutes.
2) The record button shows only if there's an audio in the card or maybe only in the question. I would need the ability to record my voice also on pure text cards. I don't need the intonation graph.

Would you be willing to do these updates?
Thanks a lot for your work.

[dgeranton]

I have proposed a patch to allow that activation of the audio record tools during card review.
Here is the branch : https://github.com/dgeranton/Anki-Android/tree/feature/reviewer_add_mic_tool_bar

[koendv]

Nice. But maintaining a patch on your own through various Anki versions is a lot of work. Try to get it into the official AnkiDroid source so it becomes part of the community effort.

[mikehardy]

@koendv @dgeranton did propose a PR, it's linked above the comment in the github web ui and I will consider it once back from travel 👍

[fabricem1]

@koendv I couldn't use install your binary. I get a message saying "App not installed".

[koendv]

OK. Maybe because you have a newer version of Anki already installed, and Android does not want to overwrite a newer version with an older one?

[github-actions[bot]]

Hello 👋, this issue has been opened for more than 2 months with no activity on it. If the issue is still here, please keep in mind that we need community support and help to fix it! Just comment something like _still searching for solutions_ and if you found one, please open a pull request! You have 7 days until this gets closed automatically

[mikehardy]

@dgeranton has implemented this in #5774 - will be out in the next 2.12alpha