9/12/2023 0 Comments Mac os x rdp server![]() ![]() With my prototype of H264 on XRDP I can watch 1440p YouTube videos with sound at ~10 MS latency. Most of that is built into OpenH264, FFMPEG, X264, libva (Intel), and Nvidia's libraries like cuda. We don't have to write these encoders/decoders, they are complex and take years of work and Ph.D.-level expertise to build. There are other derivatives such as H265, VP8, and VP9 as well, and I believe AV1 is coming out soon which promises to put all of what I listed to shame. This is also what YouTube, Netflix, OBS, and any other modern video streaming tech uses. This turns out to be WAY faster than JPEG, so much so it's why we have Nvidia's NVENC encoder and Intel's QuickSync decoder implemented in hardware, but hardware accelerated JPEG? That's nowhere to be found, the best XRDP has in that regard is assembly-written encoders/decoders, which are still fast, but not as blistering as H264. It sends a "key" (full) frame, and then for a long while after the fact it sends compressed diffs (and then occasionally another key frame to make sure things are in sync). The insight for H264 is it's a diff-ing protocol. The reason H264 is superior to JPEG is that while JPEG compression is super efficient, with every frame you are still sending a full frame. ![]() ![]() RemoteFX is full-frame JPEG compression (JPEG 2000 I believe), and it was a precursor to Microsoft's H264 acceleration. Protocol is a funny word with respect to this situation. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |