Faster-Whisper-XXL Pro

[Purfview]

Special non-public version for the donators who donated >= £40.

PayPal: https://www.paypal.com/donate?hosted_button_id=JF5BEQE3YQGH2
BuyMeaCoffee: https://buymeacoffee.com/purfview

Includes some new advanced features, here is the log:

r1.xxx.x

New voice extraction options [ --ff_vocal_extract ]:
mdx1_kim2 - Reworked "mdx_kim2" for better quality and to use much less RAM.
mdx2_kim2 - Different implementation of "mdx1_kim2", a little bit better quality.
mb-roformer - The best, SOTA quality, way better than anything.

--roformer_overlap - Lower value - bigger overlap. Bigger overlap - a bit higher quality, but a lot slower.
--roformer_vram - Set VRAM size to fit long audios. Useful if you have low RAM too.

r2.xxx.x

--realign - Very fast, simple realignment, should make the timestamps of .srt more accurate. Works at sentences level.
--realign_device - Device for "--realign" [automatic].

[Ryanccm-spec]

Not sure if appropriate to raise here, but is there another avenue to donate?

Paypal doesn't support donations from certain regions. Will there be a Patreon or similar?

[Purfview]

Someone asked me that before as PayPal doesn't work in Turkey or something.
I've seen people use buymeacoffee, I'll look at that.

[Purfview]

That was quick: https://buymeacoffee.com/purfview

[GOvEy1nw]

Ahh that's cool! Just donated via the coffee link :)

[Purfview]

Thank you. Sent you a message.

BTW, no need to notify me here, I get notifications when a donation is made.

[bbqrooster]

I am interested in getting Faster-Whisper-XXL Pro. What information should I include in the Paypal donation? What happens after the donation?

[Purfview]

What information should I include in the Paypal donation?

Add "Faster-Whisper-XXL Pro" into a message, add a notice if you want Linux build.

What happens after the donation?

After the donation wait for my email.

[bbqrooster]

Just donated through Paypal. Will wait for your email.

[bbqrooster]

When I run the Faster-Whisper-XXL Pro using the mb-roformer model, I got the warning message

"faster_whisper\roformer_attend.py:73: UserWarning: 1Torch was not compiled with flash attention. (Triggered internally at ..\aten\src\ATen\native\transformers\cuda\sdp_utils.cpp:263."

Is this an issue needed to be fixed? What do I need to do to correct it?

[Purfview]

Please open a new thread, thank you.

Questions: https://github.com/Purfview/whisper-standalone-win/discussions/new?category=q-a
Issues: https://github.com/Purfview/whisper-standalone-win/issues/new

[Rootduk]

Donated trough PayPal, not sure if it will work within my project but the work only spend on this repo deserves it to be donated. Will await your email and test if it fits my project. Thanks a lot for your effort!

[Purfview]

Thank you. What's your project about?

[Rootduk]

Just for hobby :). To recognize Dutch voice input from a player that will be converted to text and shall be used as input for the response from a (Dutch) AI text model and after all will be converted to audio again, pfiewww....

[1001ruchka]

Just for hobby :). To recognize Dutch voice input

I've translated several video from Dutch. It turned out that for Dutch it is very important to set the promt. Promt auto and default are not suitable. This is the command line I used:
faster-whisper-xxl.exe --language nl --model "large-v2" --compute_type=float16 --sentence -prompt "Vandaag ga ik jullie meenemen in het EMDR-protocol, woede, rok en wraak." --beep_off --print_progress --vad_method pyannote_v3 "video.mp4"
Promt is a line from the course.

[Purfview]

To recognize Dutch voice input from a player that will be converted to text and shall be used as input for the response from a (Dutch) AI text model

For that you would need to read stdout and check the detected language (use -v true), then kill the process if language is not Dutch.

and after all will be converted to audio again, pfiewww....

Converted audio to another language?

[xxxTony77xxx]

In the PRO version would it be possible to eliminate the automatic addition of "Subtitle M.K." lines??

[Purfview]

I often find the "Subtitle M.K." at the end of the srt I created, as the last line.
So there is no doubt that it is an automatic addition, there is nothing in the audio. It is effectively a signature.

It's no doubt a hallucination.

-l=tr -m=large-v2 --vad_method=pyannote_v3 -o=source --ff_vocal_extract=mdx2_kim2 --standard -pp

Try mb-roformer instead of mdx2_kim2 as it's much better.

[xxxTony77xxx]

Forgive me but why do you tell me that it is a hallucination? Why would I invent this thing??
I have been using your Whisper for years and this "Subtitle M.K." has always been there. Now it inserts it at the end of the srt, in the past I also found it in the middle, especially when there were long pauses between the dialogues.
Anyway it doesn't matter, I continue to look for them and delete them in every srt..

[Purfview]

Forgive me but why do you tell me that it is a hallucination? Why would I invent this thing??

It's the AI's hallucination, not yours. 😄
Read there -> https://en.wikipedia.org/wiki/Hallucination_(artificial_intelligence)

Try --ff_vocal_extract mb-roformer to reduce the chance of hallucinations. Report if it helped.

[xxxTony77xxx]

Honestly, I don't get along very well with "--ff_vocal_extract mb-roformer".
He has the bad habit of breaking a single character's line into multiple small lines.
I don't understand if the problem is him or the --standard. Any ideas?

[Purfview]

It doesn't break anything.
If you think that there is some problem then open new issue: https://github.com/Purfview/whisper-standalone-win/issues/new

[libero08]

I will try to donate for have fun with pro version. maybe if all ok i will send with byme next 30 minutes. Whis me luck.

[libero08]

Done!!! It was so easy!

[wennew82]

it's more usefull using the pro?
can somebody review Thanks

[patbrog2]

Sorry to ask, but what amount is considered as an acceptable donation. Apologies if question seems inappropriate, just being South African it's difficult to gauge these things. Anway thanx for a wonderful bit of software. Cheers

[Purfview]

Any amount is okay, some people donate just £1. Don’t look a gift horse in the mouth! 😄

I met a few "saffas" at a pub, seasonal workers. As I recall, they said the economic situation in South Africa is pretty rough, so if you’re not rich there, it’s better to hold onto your money. Here, £40 can buy you nearly three packs of cigarettes...

[patbrog2]

Thank you for your response

I donated some money, if insufficient to get access to the Pro version, I completely understand. Either way having access to a Faster- Whisper pro or free I consider a win-win situation. Thanx

[Joost1991]

I did a 40£ donation yesterday, but didn't receive an email yet. Could you have a look @Purfview?

[Purfview]

Thank you. I see it, for some reason I didn't receive an email notification about it, stay tuned.

[hyominli]

我已经捐了1英镑，您能给我吗

[Purfview]

不，是 40 英镑。

[hyominli]

Can this version make a sentence very short? I transcribe Japanese audio and often a sentence is twice as long as a normal subtitle.

[Purfview]

Can this version make a sentence very short?

Yes.

[akstaley]

Are updates/upgrades to future releases for the Pro version free after donation?

[Purfview]

Yes.

[wennew82]

Hi, may i know the advantages of using the pro?
is it will make the translation faster than using non pro?
what else? it's good to have some review so more people more interest with the pro, thanks

[Purfview]

If your audios have heavier background noise then Pro with new options can do better, and other things.
Look at the first post, everything is there.

And your financial support for the project enables me to dedicate time to developing it.

[wennew82]

"use much less RAM "
how different the RAM that will be use compare with non pro?

but how about the time ? is it will faster using the pro?

[Purfview]

"use much less RAM " how different the RAM that will be use compare with non pro?

For example, with non-pro you wouldn't be able to process longer than 90 mins audios on 12 GB VRAM, when Pro can do ~180 min on same memory.

but how about the time ? is it will faster using the pro?

No.

[BlackDamag3]

Can I use the Faster-Whisper-XXL Pro version with the subtitle editing program?

[Purfview]

Yes.

[JDTR75]

Hey @Purfview! Hope you're doing well. The Pro version supports 50XX Nvidia cards?

[lin88882001]

嘿 ！希望你一切顺利。专业版支持50XX Nvidia卡？

[linbojain]

How can I download after donation？

[Purfview]

Read email.