SolvedTensorFlowTTS FS2 + MBMelgan Speech sounds much worse when exported to TFLite in Android

Hi,

I have trained a FS2 model and fine-tuned my MBMelgan model. Here is a sample of the speech produced in Python before exporting to TFLite: Normal FS2 and MBMelgan.

Once converted to TFLite and used in Android (based on TensorFlowTTS/examples/android/) the models sound much worse...

  1. Using my FS2 model + repo's pretrained multiband_melgan.v1_24k, both exported as TFLite. Speech

  2. Using my FS2 model + my MB MelGAN, both exported as TFLite. Speech

  • In 1 and 2 the speech sounds lower quality, the voice is less life-like and sounds less like my speaker. It's also much lower pitch, even though f0_ratio 1.0 is passed into both models.

  • When using my vocoder in (2) you can hear low-frequency crackling you do not hear before converting to TFLite.

Is it normal to expect the model to sound worse once exported to TFLite?

Why do you think my vocoder adds crackling noise but the repo's pre-trained one does not?

Thanks.

31 Answers

โœ”๏ธAccepted Answer

Hi @OscarVanL, this is what I also observed in German model I trained. Basically, I obtained good results after removing optimizations with:

converter.optimizations = []

Default optimizations do not disturb the performance of Tacotron 2 seriously, but the performance of Multi-band MelGAN quickly degrades with optimizations. So I applied them to the former but not to the latter.

Related Issues:

3
TensorFlowTTS FS2 + MBMelgan Speech sounds much worse when exported to TFLite in Android
Hi @OscarVanL this is what I also observed in German model I trained Basically Hi I have trained a F...
577
graphql subscriptions Cannot find name 'AsyncIterator' error in Typescript compilation process.
Thanks!! By adding: to tsconfig.json file fixed the issue for good. I have found a difficulty compil...
133
firebase js sdk The behavior for Date objects stored in Firestore is going to change AND YOUR APP MAY BREAK
@software770 This is how you do it in an angularfire2 service: After this i got rid of the console e...
101
firebase js sdk Firestore import - Bundle size is huge
Okay here we go Huge heads up: The release I am about to talk about is VERY experimental We have not...
101
ws read ECONNRESET error on disconnect (ws 3.3.3)
Issue is caused by lack of error listener on the socket and can be fixed like so: This isn't documen...
86
ws How else can I set custom headers?
@streamnsight You want something like this? I know there were heavy discussions in #227 but it is no...
64
ws wss: Error during WebSocket handshake: Unexpected response code: 200
A fix for me was setting these response headers: Host Connection and Upgrade For nginx case (socket....
63
Rocket.Chat AppArmor errors after Snap Update
So I have a workaround for this: nano /var/lib/snapd/apparmor/profiles/snap.rocketchat-server.rocket...
59
firebase js sdk FR: Firestore Web SDK React-Native/Expo support for Android devices
I think i've found the cause of this bug The problem is not in Firestore library itself but in the u...
37
darkflow No module named cy_yolo_findboxes
Have you built the cython module with when I run demo shows this darkflow/net/yolo/test.py line 6 ...
36
firebase js sdk Setting a timer for a long period of time, i.e. multiple minutes
Yeah I'm using real-time database and when I added firebase to my project I got This Thank you @boje...
35
openpose How hard would it be to port to mobile? (iOS/Android)
I'm trying to convert the .caffemodel to CoreML to see if I can run it on iOS 11 I will report more ...
34
feathers Feathers Auk Release
Thanks for everyone's patience with this 90% of Auk is already complete but a lot of the confusion i...
34
ws How to set initially cookies to a websocket client
code example Looking at the doc we can read cookies from a server with upgradeReq ...
32
ws Constantly crashing when sending. Error not opened
The second parameter for the send method is an error handler Do something like this where you're sen...
24
openpose Python API error: Cannot import name pyopenpose
My environment - UBUNTU 18.04 CUDA 9.2 CUDNN 7.2.1 Openpose current version 1.4 (Jan 2019) I did the...
24
ws Backport Security Fix to 6.2.1
I've released ws@6.2.2 and updated the security advisory I've searched for any related issues and av...
23
openpose CMake Error at CMakeLists.txt:929 (add_subdirectory):
Temporary workaround Clone pybind11 separately into the folder The configure generate and build all ...
23
openpose macOS - protobuf compilation errors
@soulslicer installing Caffe separately and setting BUILD_CAFFE to false in the cmake config seems t...
23
firebase js sdk Firestore offline persistence not working on react native
๐Ÿ˜ข @samtstern react-native-firebase isn't for everyone when enabling persistence I get an error on r...
22
feathers How to fetch associations
Yes Have a look at the example how to fetch related items Basically So I have developed an app with ...
21
Rocket.Chat Can't access RocketChat after setting iframe URL to localhost
Hi a quick way to resolve getting back to the admin console via iframe : Go to iframe browser consol...
20
laravel echo server Android Client
Hi @dipit2007 I have a little advance on this using the library https://github.com/socketio/socket.i...
19
Rocket.Chat Franz - invalid URL since 0.52.0
So . there is an update workaround without the need of older server: Install Franz and quit it (ot j...
19
laravel echo server POST http://localhost/broadcasting/auth 404 (Not Found) error
Inside your config/app.php uncomment line with I am trying to make my app connecting to pusher on a ...
18
ksql Support COUNT DISTINCT
I take this feature to mean that we should implement the DISTINCT keyword such that the following qu...
17
Rocket.Chat [BUG] Users can't send messages (>= 2.4.x)
Same issue here Worked around it by using the reset feature in /admin/Message Description: I updated...
17
zephyr WiFi support for ESP32
Update: Feature branch that has functional networking (WiFi) on ESP32 can be found here ...
16
goaccess Support structured log formats such as JSON
Native JSON support has been added Feel free to build from development to test this out It will be p...
15
Rocket.Chat Rocket.Chat stops working with 1000 active users
Thanks for all of your suggestions We could now prove that the UserPresenceMonitor was responsible f...
15
Rocket.Chat How can I move rocket chat to other server?
@karamata do a mongo export: tar it up copy it over to new host Your Rocket.Chat version: Rocket.Cha...
15
ws Compile with warnings
@syang webpack.config.js :: externals: [/node_modules/ 'bufferutil' 'utf-8-validate'] for example: ...
14
feathers Make Feathers server framework independent to work with Express, Koa and Hapi
I think we should make Feathers a library instead of a framework - that would make it more independe...
14
firebase js sdk @firebase/firestore: Firestore (6.0.4): INTERNAL UNHANDLED ERROR: configureNetworkMonitoring
I had the same problem Downgrading to 6.0.2 fixes the issue (I haven't tried 6.0.3) This issue may h...
14
firebase js sdk 4.13.0 & 4.13.1 JavaScript heap out of memory on prod build
As @mikelehen says I think Firebase is not the root cause I solved it by adding @angular-devkit/buil...
14
firebase js sdk 5.0.4 release breaks React Native (Android only)
I had this problem today I ran a diff on the source code between 5.0.3 and 5.0.4 and found that the ...
13
ws Websockets not working with HTTPS in an Apache Proxy (302 error?)
Hi there! curiously enough that fixed it ๐ŸŽ‰ That extra / was really messing around with the Apache p...
12
firebase js sdk FR: Make Firebase SDK compatible with Angular 10
OK I got word from the Angular CLI team that: The problem is that their browser version of the bundl...
11
firebase js sdk AngularFireAuth promise after signIn with redirect is never reached.
Hey @albertososa101 When you call firebase.auth().signInWithRedirect on /login [REQUIRED] Describe y...
11
darkflow New Dataset Training Error - "AttributeError: 'NoneType' object has no attribute 'shape'"
I have encountered this in the past There is a high chance some .xml or .jpg files are not named/con...
10
firebase js sdk Support Cloud Firestore Offline Persistence in Multiple Tabs
As of today experimental multi-tab is available for you to play with Hi ...
8
goaccess Web access returns 400 Invalid Request
@allinurl I just experienced this issue as well I believe it occurs when the total size of the reque...
8
firebase js sdk Angular ssr compilation issue
Okay I think I know what's going on here - the browser bundle of firestore is included in your serve...
8
darkflow Assertion error: over-read yolo.weights
@Dhruv-Mohan @kinhunt see updated README I uploaded some of the weights file. I tried to run ./flow ...
6
goaccess GoAccess debian repository install does not work on Stretch (libssl1.0.2)
same for Debian 10!! Debian 4.19.67-2+deb10u1 (2019-09-20) x86_64 GNU/Linux Hi Due to unmet dependen...
6
feathers RFC: Use Lerna with monorepo for core packages
Started spiking out the move to Lerna v3 and I think it's the way to go: Automatic linking makes cro...
6
feathers Is there a way to overide paginate from URL querystring or feathers client?
By default this is disabled for good reasons (when you have several thousand records disabling pagin...
6
firebase js sdk Importing firestore through npm package gives error message and wont load
@ralcar I'm having the same issues and couldn't get it working using javascript imports ...
5
Rocket.Chat Atlassian Crowd integration doesn't work after upgrading Atllasian Crowd from 3.7.1 to 4.0.0
@karl-in-office @flover97 @gabriellsh (@gammpamm @fbuchmeier Description: Our Rocket.Chat server wor...
5
Rocket.Chat Can't connect to custom deployed Rocket.Chat using mobile apps (iOS or Android)
Somehow mine started working only change was to delete and reinstall the mobile app.. For reference ...