Spleeter: Node/Electron version

[pietrop]

Description

This looks awesome, is there a way to use it as a node module? (eg via npm)
packaged in such a away to be able to use it in an electron app?

Additional information

Thinking of adding it as an option to autoEdit.io to clean audio before sending it to a Speech To Text Enginge.

[mmoussallam]

Hi @pietrop

There's no out of the box node module made on top of spleeter that I know of.

Theoretically it's feasible to build a javascript lib out of spleeter, you'd need to use the tensorflow.js port to load the models though.

An easier possibility would be to host a small webservice serving spleeter and requesting it through js I guess.

[ibinti]

Theoretically it's feasible to build a javascript lib out of spleeter

Could you kindly elaborate more? does this mean porting spleeter python code to js?

[faroit]

We are about to release a js framework with all the required pre and postprocessing soon. Stay tuned

[TheoBr]

@faroit I’ve just started working on a Spleeter “port” on top of TFJS for consumption in electron apps. Would love to contribute however I can - let me know if there’s interest in external contributions pre release!

[skratchdot]

Thanks for your great work on this! 🙏 I'm very interested in a TFJS version as well and am looking forward to this upcoming release!!!

[chenei]

@faroit any news?

[faroit]

@chenei we are updating the framework to support tf 2.2. ETA next two weeks.
@TheoBr we could could for sure get some help. We only implemented the pre- and postprocessing. So the spleeter spectrogram core model would need to be converted to tfjs (as we add open-unmix for now). The last time I tried it was not compatible out of the box and required manual layer patching.

[chenei]

@TheoBr
Hi,
Can I help u somehow?

[TheoBr]

@chenei I have not gotten started on any work related to Spleeter in Node :( Would love an update or even a WIP branch to work against if at all possible @faroit

[AdrianButnar]

@faroit any news?

[faroit]

@AdrianButnar @TheoBr sorry for the slow response. We managed to get the full open-unmix and spleeter models working. If any of you are js devs, we would love some feedback. Send me a mail please

[Syps]

@faroit thanks for your past update and work on TF.js version of spleeter! is there a timeline for when code and/or artifacts will be released?

[theblissprogrammer]

@faroit is this still a thing? Has support been dropped?

[faroit]

@theblissprogrammer @Syps @AdrianButnar @TheoBr sorry for the long delay. We have working models but we are currently working on speeding up inference and reduce memory usage.

See a W.I.P site here (currently only open-unmix works) https://sigsep.github.io/open-unmix-js/

We will open the repo very soon and can't wait to get some help from javascript gurus ;-)

[Mixerrog]

Just to let you know, I just tried a Open-Unmix vocal separation & the processing bar circle just spun for several minutes with no results.

Roger

 On Thursday, November 12, 2020, 08:05:23 AM CST, Fabian-Robert Stöter <[email protected]> wrote:

@theblissprogrammer @Syps @AdrianButnar @TheoBr sorry for the long delay. We have working models but we are currently working on speeding up inference and reduce memory usage.

See a W.I.P site here (currently only open-unmix works) https://sigsep.github.io/open-unmix-js/

We will open the repo very soon and can't wait to get some help from javascript gurus ;-)

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or unsubscribe.

[skratchdot]

Just to let you know, I just tried a Open-Unmix vocal separation & the processing bar circle just spun for several minutes with no results. Roger On Thursday, November 12, 2020, 08:05:23 AM CST, Fabian-Robert Stöter

same thing happened with the file i tried. it was a 4 minute mp3 and i let it spin for more than 20 minutes with no result.

i figured i'd give feedback as well (just in case it helps).

good luck with the speed/memory improvements and thanks for all your work @faroit!

[faroit]

@Mixerrog @skratchdot yes. RAM is an issue in long files. For now:

• use chrome
• try <30s files

Please wait until we open the repo for reports as this is out of scope for spleeter. ( Or just drop me a mail)

[hthieu1110]

Thanks you for this amazing project. Look forward for JS version :)