Skip to content

Live captions using Azure Speech to text #77

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
chriskooken opened this issue Mar 7, 2025 · 3 comments
Open

Live captions using Azure Speech to text #77

chriskooken opened this issue Mar 7, 2025 · 3 comments
Labels
enhancement New feature or request

Comments

@chriskooken
Copy link

Just throwing this in as an enhancement. We're using this to replace Azure Media services and things are working very well! One feature we are missing is the ability to do live captioning for the streams and embed the caption data into the HLS manifest. Is this a possibility? Could use the Microsoft speech to text APIs in Azure.
@josephnhtam josephnhtam added the enhancement New feature or request label Mar 8, 2025
@josephnhtam
Copy link
Owner

Thank you for your suggestion, @chriskooken
Live captions is completely possible and I will try to look into it.

@josephnhtam
Copy link
Owner

I've implemented a POC that successfully forwards transcoded audio from an RTMP stream to Azure AI Speech to generate live captions with real-time transcription. The results look good, therefore I may be able to likely add this feature in the near future.

@josephnhtam josephnhtam mentioned this issue Apr 26, 2025
Merged
@josephnhtam
Copy link
Owner

Initial support for subtitle transcription has been added to v0.30.0.
Please refer to the docs and sample.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@chriskooken @josephnhtam