Does all NeMo ASR models support in Riva?

[mehadi92]

Does this models support in Riva

1. conformer model: STT En Fast Conformer-CTC Large | NVIDIA NGC 1
2. Transducer model: STT En Fast Conformer-Transducer Large | NVIDIA NGC 1

[VahidooX]

Currently all CTC models are supported in Riva while Transducer models not yet.

[titu1994]

Fast conformer CTC is not fully tested yet, but it might work

[mehadi92]

@titu1994 I have test stt_en_fastconformer_ctc_large model. when I deploy it in Riva it give only subword prediction like the bellow

python transcribe_file.py --input-file data/examples/en-US_sample.wav --server localhost:50052 --print-confidence
## is 
Confidence:   -0.6694
----
## ural 
Confidence:   -0.0005
----
## al 
Confidence:   -0.0001
----
## ing 
Confidence:   -0.0184
----
## ing 
Confidence:   -0.0000
----
## ing 
Confidence:   -0.0000
----

[mehadi92]

Also ask in the Riva forum they said it's not supported yet, fastconformer models riva support status cc: @VahidooX

[titu1994]

Hmm interesting. They will eventually support it, NeMo models are usually exported in stages