I don't know much about the space other than RTMP being a popular format. The source of youtube-dl might be an interesting place to start: https://github.com/ytdl-org/youtube-dl/blob/master/youtube_d...
If you're thinking of creating a streaming business, you better have a good business model because it's notoriously hard to create a streaming business that brings in enough revenue to cover bandwidth costs.