Support native viewing of videos created with this library (without large file sizes)

[timja]

Currently with this library neither quicktime or windows media player are able to open most of the encodings supported by this library.

You can open with VLC but ideally the default media players should work.

See more details at jenkinsci/acceptance-test-harness#1041 (comment)

With the current version of the montemedia library you can create videos in the following formats, that will open natively:

Windows: AVI with JPEG encoding.
macOS: QuickTime with JPEG encoding.
I know that these settings produce impractically huge files.

I am planning to do a proof-of-concept with the Foreign Function & Memory API that was released in JDK 21.
Maybe it is possible to encode videos using the native Windows and macOS APIs.

[wrandelshofer]

Yes, this is a problem in my projects too.

I am planning to use the MP4 H.264 codec from the JCodec library in a future version of this library.

[wrandelshofer]

I made some progress. I have integrated some code from JCodec into the main branch.
It turns out, that the JCodec H264Encoder is too slow for encoding a screen recording in realtime.
I am now investigating possible solutions.
For example,

• The screen recorder could write a temporary movie file with a lossless low-complexity codec (for examle RLE). After recording is completed, it could convert it to H.264.
• We could implement a low-complexity H.264 encoder by ourselves. And use that one instead JCodec's H264Encoder.