Здравствуйте! Отличная идея. Но чего-то не получается - все подряд идущие ноты сливает в одну, игнорирует очень короткие ноты.
Пример видео: https://www.youtube.com/watch?v=zatW6ZVR6DE
Midi там есть, так что можно сравнить.

opencv dep should be changed to python-opencv, as that one is missing and it includes opencv as a bonus.

Better yet, I have packaged both midiutil and this repo, one can just install from AUR now - https://aur.archlinux.org/packages/video2midi-git

it says

"Saved notes: 1150"
done...

but the midi files is nowhere

(windows 10)

Idk why it does this but after I create the midi, the sound of the midi is very distorted and very wrong, Idk if its the amount of keys, the hands or any detail in the video, but I hope anyone can help, here's the link for the video I'm trying to make a midi https://www.youtube.com/watch?v=e0r2vRkKqd4

heres what the midi sounds like after

When trying to process a small resolution, the GUI is unusable. Is there a way to run the app in full screen?

Исходник видео в маленьком разрешении. Можно как-то извратиться, скрыть менюшки и перетащить ноты в нужное место, но, точно попасть практически нереально.
Минут пять прицеливался, чтобы наложить ровно всю раскладку. Если бы пришлось индивидумально ноты таскать - вряд ли бы справился. https://i.imgur.com/mYNbQa1.png

Hi,
When I convert some songs, when I open the midi on "midieditor" the right hand notes appear as bulk notes on the beggining, can you help me please?
SCREENSHOT: https://i.snipboard.io/KQjgkh.jpg

SONG FROM THE SCREENSHOT: https://www.youtube.com/watch?v=ZCut6N52_qY

Thank you.

Thanks for the great tool. The default location for each black key can be tuned a little bit, like

    if (j == 1) or ( j == 6 ):
      keys_pos[i*12+j][0] = int(round( xx  + whitekey_width *0.4 ));
    if (j == 8 ):
      keys_pos[i*12+j][0] = int(round( xx  + whitekey_width *0.5 ));
    if ( j ==3 ) or ( j == 10 ):
      keys_pos[i*12+j][0] = int(round( xx  + whitekey_width *0.6 ));

Привет. Первый раз использую, и результат не очень вышел.

Вот фрагмент оригинального видео
https://disk.yandex.ru/i/W6HIfQbZzvC6-w

А вот этот же момент из получившегося миди
https://disk.yandex.ru/i/kdZAqZ6o8wTr8w

На слух слышно, что там постоянно сбивы какие-то между переходами BC и AG. Глянул в midi редакторе, а там одно нажатие на другое почти наслаиваются, то есть по таймингам не очень точно отслеживается, когда одну клавишу отпустили, и нажимают уже другую.

Это я что-то неправильно настроил, или просто Synthesia так отображает нажатия с задержкой, и соответственно твой софт так считывает? В общем, можно ли с этим что-нибудь сделать?

Оригинальный ролик:
https://youtu.be/lvppVNysQeY

So I've already adjusted the keys and everything but I just can't seem to make the output sound good, I've tried every setting, but none are working, I am trying to convert this video https://youtu.be/ZNpuxo1CC4E . but it sounds very wrong and distorted as results, with again, notes everywhere and stuff!

I'm on linux and after installing it with the command it can't be launched and i can't even find it on my computer

Hello whenever i recreate the midi the video playback glitches and when it finishes, the midi is very glitchy for some reason.

Here is the video showcasing it: https://www.youtube.com/watch?v=Vm1x1yw19uc
This is the video i am trying to get a midi of: https://www.youtube.com/watch?v=5HgExMvlERg

What the midi sounds like:

This is the start and end of the log if that helps idk

Everything was installed properly and it does this with every song i try to do.

Facing issues with oversized window. The resize window button does not help.
For instance, color map is always cropped.
System Windows 10, screen display resolution 1920x1080. I use fullhd screen notebook and a external display also fullhd. Even if I use only the notebook screen, the issue persists. Any ideas?

Hello, someone suggested your video to me because I love Virtual Piano more than anything and I need Sheets. These videos they showed me shows me that I need to download Video2midi in Github. I have now done this and went to the ornder Docs. Since I have Windows 10, I selected the folder Win_Install and did all the steps except the last, because there is an error. I tried it anyway then. I downloaded the Youtube video on MP4 then pressed V2m and then selected the video it was selected and neither the video nor the function opens. heres the Video what Ima sent you what is happening: https://youtu.be/a6tJ0NKQJ2k

There are some Synthesia videos on YouTube which does not have Synthesia's standard piano panel on the bottom (replaced with hands (like this one: https://www.youtube.com/watch?v=gQgb0cK0mcs).

It would be great if this program could have an option to read the notes from the upper side of the piano panel as well.

First off, I think this is a good tool, and is the only thing I could find to do the job I wanted, and for being a one-man project, it is near perfect. My main complaint is that the rhythm always turns out a little weird. This could be fixed by having the program count notes at proper intervals. For instance, I would set time to frame 1, note the bpm of the song, and then tell it the smallest interval in the song. This would likely be a quick edit that could be made to the song after the midi is generated. Although I'm not a midi expert, I feel this could fix some rhythm problems.

I don't know if the creator is still active, but I wanted to know... There are WAY more than 88 keys here, is there any adjustment to how many notes are present? I saw in your My Little Pony demo screenshot that you had way fewer notes. Also, it's perfectly aligned. Is there a way to change the spacing between notes in mass (a lot at a time)?

Can anyone help? After I type "cd C:/video2midi-masters" then type "python ./v2m.py or ./v2m on Anaconda Prompt it just says no file or directory, I'm confused cause I don't know much about coding, I watched a video on what to do after installing in rutube, but the error in the title just occurs, I'm sure I did something wrong so can anyone pls tell me how to fix this error?? Thank you

Hey, so... I was trying to figure out a setup with sparks, but didn't work in the end.

Some examples:

https://www.youtube.com/watch?v=6-VivlFg2Yk

1:46 to 1:47 the blue notes from the left hand, don't blink the keyboard, so for video2midi is just a long note.

I'm not sure how is possible to get this, so maybe is an issue that can be fixed in an upgrade.

Just here to confirm that the program works in MacOS as well. To install the dependencies, one can just use pip (as already documented for Linux in the Wiki):

pip install opencv-python pygame midiutil pyopengl

Tested on MacOS 10.14.6, Python 3.7.7 (installed via Homebrew), pip 20.0.2.

Maybe could there be a suggestion in the README to install the dependencies via pip for MacOS installations.

Hi, the youtube vidoes and the instructions look really good. Is it possible to run it on a colab environment ?

Hi,
Great code, it's really useful for me. I just found a small bug in the code:
If the prefs.rollcheck is set, it seemingly might happen that the end of a key-press is not registered and accordingly the note doesn't show in the resulting MIDI file.

To get the missing note I had to change the lines 1179-1188:

        if prefs.rollcheck_priority == 0:
          if not iswhitekey(i):
          # Priority on Black keys;
            if notes[i+1] >0: notes[i] = 0; 
            if notes[i-1] >0: notes[i] = 0; 
        else:
          if iswhitekey(i):
          # Priority on White keys;
            if notes[i+1] >0: notes[i] = 0; 
            if notes[i-1] >0: notes[i] = 0; 

to:

        if prefs.rollcheck_priority == 0:
          if not iswhitekey(i):
          # Priority on Black keys;
            if notes[i+1] >0 and notes_tmp[i] >0: notes[i] = 0; 
            if notes[i-1] >0 and notes_tmp[i] >0: notes[i] = 0; 
        else:
          if iswhitekey(i):
          # Priority on White keys;
            if notes[i+1] >0 and notes_tmp[i] >0: notes[i] = 0; 
            if notes[i-1] >0 and notes_tmp[i] >0: notes[i] = 0; 

Hi! video2midi hangs after line
cannot find setings file: /home/gnidorah/.v2m.ini
0.3.5 works fine

The size of app window is the same as the opened video size, the window is not resizable. When opening small videos, like 360p, that makes the app overlay controls very cluttered. Also it's almost impossible to precisely adjust keyboard postilion due to the resolution of adjustment. I had to manually adjust keys.

Manually overriding the window size by windows manager doesn't resolve the issue.

Hey, I have a few videos that don't have the preset colors, how do I add colors?

TRANSLATION/ПЕРЕВОД:

Привет, у меня есть несколько видео, в которых нет предустановленных цветов. Как мне добавить цвета?

Hello. Thank you for such a wonderful toolbox!
In general, it works great!

I tried to convert this video https://www.youtube.com/watch?v=HWu-a4zcXbw into midi.
At some moments, two notes are incorrectly recognized as one - I am attaching a picture wherein you can see your GUI interface and part of Synthesia window (please compare the green notes).
Any suggestions with settings?

Also, in the GUI interface, I have "note duration (sec): 10", although the ini file has "minimal_note_duration = 0.1".
I can change it in GUI, but in seconds resolution: 0,1,2,3 seconds etc
Thank you again.