-
Notifications
You must be signed in to change notification settings - Fork 3
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
upload speech to word example notebook set #50
base: main
Are you sure you want to change the base?
Conversation
This pull request is being automatically deployed with Vercel (learn more). 🔍 Inspect: https://vercel.com/cylynx/verifyml/2FokXGiD7caN9Yh14f75XHhx7mrJ |
The test results of your model card is automatically generated with VerifyML! 🎉 📜 Test Result Summary
🔍 Inspect: Breast Cancer Wisconsin (Diagnostic) Dataset |
Some questions about this data point from here:
On a slightly related note, single digits were converted from numbers to words in your notebook. Were there any larger numbers involved? e.g. did any participant read something like 'one hundred' then google's model returns '100' instead? |
I did a intersection count between the 2 set of words (e.g len(setA.intersectionsetB)). So in the example 'three' is spoken twice and the model got it right both times, but i will just count as 1 match. The assumption here is that im assuming the model will always correctly transcribe a 'three', which it is in this example but may not be true for all the cases. Also, spotted a mistake, the truth count in the above example should be 6 not 8, match count will still stand as 5. Its supposed to be a unique count, will change it. Also, there is no order in my counting logic. Say if the truth is 'i went to sleep' and prediction is 'sleep to went i', match count will be 4 out of 4 but such cases are close to impossible to happen. If the model transcribe it as 'i went two o sleep', it will be 3 out of 4. Empty string only exists in the prediction set and does not add into the match count. And yeah there are few participants who will say it in 'hundreds' or 'millions' but my digit converter convert word for word. So thats another naunce.... But most are given long chunks of digits to recite. |
The test results of your model card is automatically generated with VerifyML! 🎉 📜 Test Result Summary
🔍 Inspect: Breast Cancer Wisconsin (Diagnostic) Dataset |
Ok, was looking for the set intersection bit, LGTM! The |
As discussed, let's modify the overview section to mention that we are evaluating Google's text to speech model. Thanks. |
The test results of your model card is automatically generated with VerifyML! 🎉 📜 Test Result Summary
🔍 Inspect: Breast Cancer Wisconsin (Diagnostic) Dataset |
No description provided.