Git Product home page Git Product logo

qtndimonitorcapture's Introduction

QtNdiMonitorCapture

Shameless plug: Seriously, one way you can really help out this project is to subscribe to NightVsKnight's YouTube and/or Twitch channels. I will be showing off this project there from time to time, and getting new subscribers gives me a little morale boost to help me continue this project.

Qt6 based app that simulates NDI Tools' Studio Monitor and Screen Capture.

  • NDI's Studio Monitor is a NDI Receiver + Viewer.
  • NDI's Screen Capture is a Monitor Capture + NDI Sender.

QtNdiMonitorCapture does them both, so it can actually monitor its own output! :)
(Studio Monitor can also send NDI video output, but even if you were able to have it view its own output then you would probably just be viewing a black screen.)
NOTE: It is interesting to run Monitor mode to view its own Monitor Capture screen in full-screen and see the result of the lossy data transfer. If P216 pixel format was used to capture->transmit->receive->render then I suspect that would be much less lossy (I wonder how close to lossless).

Limitations

  • Currently only compiles and runs on Windows.
    Sorry! Feel free to help compile and test and implement on other platforms!
  • Missing features (not exhaustive):
    • Studio Monitor
      • Recording: Very low priority to me.
      • KVM: I tried to get this to work but the NDI KVM API keeps crashing whenever it is called. :/
        Another problem is that this requires NDI Advanced SDK, which may have an incompatible license.
      • Settings ...
        • Application ...
        • Audio ...
        • Video ...
        • Overlay ...
        • Output ...
        • PTZ Settings ...: Very low priority to me.
    • Screen Capture
      • Audio: Again, sorry, but this initial **Screen** Capture proof of concept was focused literally on the screen/video only;
        Audio is [sort of] simpler to capture & send than video, but the UX is more complicated to select which of the multiple audio input and output devices to capture from.
        I will get to this eventually, but it is lower priority proof of concept for now.
      • Frame Rate ...
      • Capture Settings ...
      • Audio Source ...
      • Webcam Video Source ... : Very low priority to me.
      • Webcam Audio Source ... : Very low priority to me.
      • Enable KVM Control: I tried to get this to work but the NDI KVM API keeps crashing whenever it is called. :/

Feel free to help add missing features or support for other platforms.
See #TODO.

Usage

Launch the app and right click on the view window to get a context menu showing all of the currently availble NDI Sources and select an NDI Source to view.

Monitor Capture Start will show a System Tray Icon that you can use to later stop the capture.

The app will not close while a capture is running.

To close the app while a capture is running either:

  1. first stop the capture and then close the app. -or-
  2. Right-click on the main window or the system tray icon and select Exit.

Command line options

Launch in Monitor mode (the default):

QtNdiMonitorCapture.exe
-or-
QtNdiMonitorCapture.exe --mode=monitor

Launch in Capture mode:

QtNdiMonitorCapture.exe --mode=capture

More are planned.

Build

Requirements:

  • Currently only compiles and runs on Windows
  • Visual Studio 2019 Community installed
  • Qt6 installed with the following components:
    • MSVC 2019 64-bit
    • Qt Multimedia
    • Qt Creator 9.0.2
    • Qt Installer Framework 4.5
  • NDI Advanced SDK to be installed.
    I could have just required the non-Advanced SDK, but I hope to one day add KVM support, which requires the Advanced SDK.

Steps:

Qt Creator 9.0.2 IDE

  1. Launch Qt Creator
  2. Open the QtNdiMonitorCapture.pro file
  3. Build and Run

PowerShell 7.3.3 Command-Line

  1. $env:Qt6_DIR = 'C:\Qt\6.4.2\msvc2019_64\'
  2. CI\windows-build.ps1 "CONFIG+=package"

TODO

Please help to whittle down this list!:

  • Check for memory leaks and fix any found, especially when:
    1. Stopping and starting Capture.
    2. Stopping and starting when switching between different NDI Sources.
  • Add support for any platform that Qt6 supports, especially:
    1. Raspberry Pi OS
    2. Jetson Nano Linux4Tegra
    3. Linux
    4. MacOS
  • Confirm and/or improve hardware acceleration options.
  • Confirm the app compiles and creates a distribution for all supported platforms.
  • Confirm the app launches on all supported platforms.
  • Confirm Monitor mode works on all supported platforms.
  • Implement Capture mode for all supported platforms.
  • Confirm multiple monitors works on all supported platforms.
  • Find a way to capture from more than one monitor...or all! :)
  • Add command-line to list NDI Sources and exit.
  • Add command-line to start viewing a specific NDI Source.
  • Add command-line to start capturing a specific Monitor (or Monitors).
  • Successfully port from QMake to CMake.
  • Add all of the Limitations of missing NDI Studio Monitor and Screen Capture features, including NDI|HX3 support. NDI|HX requires NDI Advanced SDK which may have an incompatible license. :/
  • Add support for sending to and receiving from NDI Groups.
  • Improve Capture performance, including adding Game Capture option [similar to OBS].
  • Improve Monitor performance.
  • Audit the code for all uses of pass-by-pointer (*) vs pass-by-reference (&) and decide the best one to use for each situation.
    For performance tuning, this should usually be the fastest one.
    I have worked in the Managed world too long and was a little lazy writing the code. :/
    Some Qt classes I even pass without either * or &, and I suspect that results in a copy operation that probably isn't very efficient. :)

NOTES:

  • Capture does try to use a double-buffering technique, but there is still some noticable sheering. :/
  • Monitor code uses 100% Qt6 classes and should be very portable to any platform that Qt6 supports.
    It would be exceptionally nice to implement a cross-platform P216 pixel format! :)
  • Capture code is [currently] Windows specific and could use a cross-platform abstraction, probably using OBS Studio as inspiration. https://github.com/obsproject/obs-studio/blob/master/libobs/obs-video.c

References

Monitor Capture is based off of WinRT sample code from:

OBS Studio and OBS-NDI:

Safe Queue:

Other Inspirations:

qtndimonitorcapture's People

Contributors

paulpv avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.