fix!: speech to text live transcription

[IgorSwat]

Description

Various improvements & adjustments in Speech-to-Text module. The list of changes includes:

• Adjusting native implementation to the new format of Whisper models (single file, bundled encode & decode methods)
• Refactoring native implementation in order to support multiple STT models in the future
• Fixing an impropriate behavior of Whisper streaming

Introduces a breaking change?

• Yes
• No

Type of change

• Bug fix (change which fixes an issue)
• New feature (change which adds functionality)
• Documentation update (improves or adds clarity to existing documentation)
• Other (chores, tests, code style improvements etc.)

Tested on

• iOS
• Android

Testing instructions

You can run the tests defined for Speech-to-Text module, as well as test it manually with the 'speech' demo app (SpeechToText screen).

Screenshots

Related issues

Checklist

• I have performed a self-review of my code
• I have commented my code, particularly in hard-to-understand areas
• I have updated the documentation accordingly
• My changes generate no new warnings

Additional notes

[msluszniak]

Some comments are not needed imo

[chmjkb]

Overall solid work, thanks 👏🏻
Left a couple of nits

[chmjkb]

Two more things:

1. I wasn't able to compile the app for Android (due to Norbert bumping minSdkVersion in RNET). You have to bump the minSdkVersion in the example app.
2. Once compiled, it doesn't ask for mic permissions (im using a Pixel 10) and silently fails.

[chmjkb]

I think you should change the TS side as you're returnign a different thing from C++, for example:

  public async encode(waveform: Float32Array): Promise<Float32Array> {
    return new Float32Array(await this.nativeModule.encode(waveform));
  }            

Also, why did you switch back to type in SpeechToTextModelConfig?

[msluszniak]

And rebase

[msluszniak]

@IgorSwat could you fix the lint and reference API, then I will run test and speech demo app.

[chmjkb]

Please update the docs (not the API reference) as they're outdated now.

[IgorSwat]

Hot take: can we just remove the API reference from the repo, please?

[msluszniak]

Hot take: can we just remove the API reference from the repo, please?

No, why would we do that?

[IgorSwat]

Hot take: can we just remove the API reference from the repo, please?

No, why would we do that?

Okay, nevermind, It passed after just 2 rebases. Could be worse :)

[msluszniak]

Okay, nevermind, It passed after just 2 rebases. Could be worse :)

It will always pass after rebase, I can guarantee you. So really it's not that bad, you can handle it once at the very end of the review process and it's just one command, but big benefit of having complete API. First try didn't work because signature of updated package Zod changed, and then you changed code so lines had mismatches ;)

[msluszniak]

Brilliant work on this one 🚀

[chmjkb]

One minor comment, overall great work 👏🏻

[chmjkb]

Also please get rid of the API reference files

[IgorSwat]

Also please get rid of the API reference files

Done.