Alpha Compositing about veejay HOT 31 CLOSED

Done:

• Black White Mask by Threshold
• Luma Key (mode=3) reverted
• Crop,Scale,Tilt
• Luma Key composite (8 modes)

Alpha generators/helpers:

• Show alpha as greyscale
• Fill Alpha Channel (with a value 0-255)
• Flatten image (to black)
• Select by color key (skip aA[0] , write-in result to aA[i])
• Overlay Magic alpha channels (combines alpha channel by magic overlay)
• Set from mixing source
• Travel Matte
• Feather Mask

Todo:

• Find all image effects that benefit from using alpha
• Find all video effects that benefit from using alpha
• Add "Alpha" parameters to FX that support processing alpha channels or set alpha operator mode per chain entry separately ?

from veejay.

All in YUV, no porter-duff

Sample 1 playing, overview in samplebank:

Applied LVD Crop with (show) Alpha parameter set to 1

LVD Crop, but with (show) Alpha parameter set to 0

Just showing the Alpha channel in greyscale

Key-out the background by color using "Alpha: Select by color key". The filter skips alpha values 0 in channel A and writes-in the result

On Sample 1, Apply Luma Key, with mode parameter set to value 3

On Sample 2, Apply LVD scale0tilt

from veejay.

@C0ntrol: You seemed to have edited my post and added yours into mine. ;-) Maybe an oversight. Just curious because the statement below are not mine afaict.

The trace does not contain any crashes, just the trapping of gtk warnings. If veejay crashes, it will print a short backtrace - That would be usefull in this case.

I'll see to more detailed explanation, since in the screenshot above I skipped some steps such as setting the mixing channel. From your description, I'm having a hard time to understand why exactly it didnt work, could you append your samplelist ?

from veejay.

Here is the samplelist.
http://hastebin.com/elucawovar.xml

The tail of the veejay was:
I: Set "Alpha: Select by color key" parameter 4 "Invert" to 1 on Entry 1 of Sample 3
D: Saved EDL 'sample_00001.edl' of sample 1
D: Saved sample 1 EDL 'sample_00001.edl'
E: No subtitle sequences present, nothing to save
D: Saved EDL 'sample_00002.edl' of sample 2
D: Saved sample 2 EDL 'sample_00002.edl'
E: No subtitle sequences present, nothing to save
D: Saved EDL 'sample_00003.edl' of sample 3
D: Saved sample 3 EDL 'sample_00003.edl'
E: No subtitle sequences present, nothing to save
E: No subtitle sequences present, nothing to save
I: Saved EDL to file /home/zenny/.veejay/recovery/recovery_editlist_p960.edl
W: Saved samplelist to /home/zenny/.veejay/recovery/recovery_samplelist_p960.sl
W: Saved Editlist to /home/zenny/.veejay/recovery/recovery_editlist_p960.edl
W: Please report this error to http://groups.google.com/group/veejay-discussion?hl=en
W: Send at least veejay's output and include the command(s) you have used to start it.
W: Also, please consider sending in the recovery files if any have been created.
W: If you compiled it yourself, please include information about your system.
Floating point exception (core dumped)

Hope this helps.

from veejay.

Thanks, it seems there is a FPE in Select by color key but I don't see it (yet), Can you list the parameter values that were used or attach /home/zenny/.veejay/recovery/recovery_samplelist_p960.sl ?

from veejay.

Here is the samplelist.
http://hastebin.com/elucawovar.xml

The file in question was what I pasted at http://hastebin.com/elucawovar.xml

I cannot attach here because it says: "Attaching documents requires write permission to this repository. Try again with a PNG, GIF, or JPG." Screenshot: http://picpaste.com/rnPdL3k8.png

from veejay.

OK, thanks

from veejay.

FPE not able to reproduce using mentioned samplelist, can you run veejay in gdb and do a "bt" command after the FPE has happened ?

from veejay.

I pasted gdb-bt in #31 (comment) which you might have mistakenly deleted, I guess!

However I am reposting again:
http://hastebin.com/ipoqepixis.coffee

from veejay.

from 2d582f2 , i can successfully reproduce the steps described here ... until the last one (On Sample 2, Apply LVD scale0tilt) : need to explore why LVD scale0tilt is not installed.

@ zeeny > just to be sure, do you

./autogen.sh 
./configure [--prefix=/usr/]
make clean
make -j2
[sudo] make install 

for both veejay-server / veejay-client / plugins/lvdcrop directories ?

@ zenny > do you use a specific / special / rare platform to build (os/cpu) ?

from veejay.

I do like,

./autogen.sh
./configure --enable-shared --enable-debug
make -j5
sudo make install clean

I do not do 'make clean' before 'make -j5' because every build I do were from a newly cloned source from master as I have the experience of some artifacts underlying causes veejay to crash which I reported to you. However, I uninstall everything (sudo make uninstall veejay-${server, client, utils) from the previous build directory before I install again to be clean. In addition, I mv $HOME/.veejay to $HOME/DOTveejay to avoid conficts, fyi.

@ zenny > do you use a specific / special / rare platform to build (os/cpu) ?

I do not think so. It is Lubuntu modified to run multimedia and multiseats.

Here are my build platform for the time being:

$ lsb_release -a
LSB Version: core-2.0-amd64:core-2.0-noarch:core-3.0-amd64:core-3.0-noarch:core-3.1-amd64:core-3.1-noarch:core-3.2-amd64:core-3.2-noarch:core-4.0-amd64:core-4.0-noarch:core-4.1-amd64:core-4.1-noarch:security-4.0-amd64:security-4.0-noarch:security-4.1-amd64:security-4.1-noarch
Distributor ID: Ubuntu
Description: Ubuntu 14.04.3 LTS
Release: 14.04
Codename: trusty

$ cat /proc/cpuinfo
processor : 0
vendor_id : AuthenticAMD
cpu family : 16
model : 4
model name : AMD Phenom(tm) II X4 965 Processor
stepping : 3
microcode : 0x10000c8
cpu MHz : 800.000
cache size : 512 KB
physical id : 0
siblings : 4
core id : 0
cpu cores : 4
apicid : 0
initial apicid : 0
fpu : yes
fpu_exception : yes
cpuid level : 5
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm 3dnowext 3dnow constant_tsc rep_good nopl nonstop_tsc extd_apicid pni monitor cx16 popcnt lahf_lm cmp_legacy svm extapic cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw ibs skinit wdt hw_pstate npt lbrv svm_lock nrip_save vmmcall
bogomips : 6845.95
TLB size : 1024 4K pages
clflush size : 64
cache_alignment : 64
address sizes : 48 bits physical, 48 bits virtual
power management: ts ttp tm stc 100mhzsteps hwpstate

processor : 1
vendor_id : AuthenticAMD
cpu family : 16
model : 4
model name : AMD Phenom(tm) II X4 965 Processor
stepping : 3
microcode : 0x10000c8
cpu MHz : 800.000
cache size : 512 KB
physical id : 0
siblings : 4
core id : 1
cpu cores : 4
apicid : 1
initial apicid : 1
fpu : yes
fpu_exception : yes
cpuid level : 5
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm 3dnowext 3dnow constant_tsc rep_good nopl nonstop_tsc extd_apicid pni monitor cx16 popcnt lahf_lm cmp_legacy svm extapic cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw ibs skinit wdt hw_pstate npt lbrv svm_lock nrip_save vmmcall
bogomips : 6845.95
TLB size : 1024 4K pages
clflush size : 64
cache_alignment : 64
address sizes : 48 bits physical, 48 bits virtual
power management: ts ttp tm stc 100mhzsteps hwpstate

processor : 2
vendor_id : AuthenticAMD
cpu family : 16
model : 4
model name : AMD Phenom(tm) II X4 965 Processor
stepping : 3
microcode : 0x10000c8
cpu MHz : 2200.000
cache size : 512 KB
physical id : 0
siblings : 4
core id : 3
cpu cores : 4
apicid : 2
initial apicid : 3
fpu : yes
fpu_exception : yes
cpuid level : 5
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm 3dnowext 3dnow constant_tsc rep_good nopl nonstop_tsc extd_apicid pni monitor cx16 popcnt lahf_lm cmp_legacy svm extapic cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw ibs skinit wdt hw_pstate npt lbrv svm_lock nrip_save vmmcall
bogomips : 6845.95
TLB size : 1024 4K pages
clflush size : 64
cache_alignment : 64
address sizes : 48 bits physical, 48 bits virtual
power management: ts ttp tm stc 100mhzsteps hwpstate

processor : 3
vendor_id : AuthenticAMD
cpu family : 16
model : 4
model name : AMD Phenom(tm) II X4 965 Processor
stepping : 3
microcode : 0x10000c8
cpu MHz : 800.000
cache size : 512 KB
physical id : 0
siblings : 4
core id : 2
cpu cores : 4
apicid : 3
initial apicid : 2
fpu : yes
fpu_exception : yes
cpuid level : 5
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm 3dnowext 3dnow constant_tsc rep_good nopl nonstop_tsc extd_apicid pni monitor cx16 popcnt lahf_lm cmp_legacy svm extapic cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw ibs skinit wdt hw_pstate npt lbrv svm_lock nrip_save vmmcall
bogomips : 6845.95
TLB size : 1024 4K pages
clflush size : 64
cache_alignment : 64
address sizes : 48 bits physical, 48 bits virtual
power management: ts ttp tm stc 100mhzsteps hwpstate

$ free -m
total used free shared buffers cached
Mem: 32174 5624 26550 44 507 1707
-/+ buffers/cache: 3408 28765
Swap: 16087 0 16087

from veejay.

./configure --enable-shared --enable-debug

why do you (still) need --enable-shared ? (that was useful "before" work done this summer about ffmpeg/avconv compatibility ...) any other reason ?

by the way what kind and version of ffmpeg / avconv (maybe both ... ) do you have ?

from veejay.

why do you (still) need --enable-shared ? (that was useful "before" work done this summer about ffmpeg/avconv compatibility ...) any other reason ?

Convention. But I don't think it has to do anything with the issue, I guess.

by the way what kind and version of ffmpeg / avconv (maybe both ... ) do you have ?

ffmpeg 2.8.1 and avconv 2.4.3

$ dpkg -l | grep ii | grep ffmpeg
ii chromium-codecs-ffmpeg-extra 45.0.2454.101-0ubuntu0.14.04.1.1099 amd64 Extra ffmpeg codecs for the Chromium Browser
ii ffmpeg 7:2.8.1+git1trusty amd64 Multimedia player, server, encoder and transcoder
ii ffmpegthumbnailer 2.0.8-2 amd64 fast and lightweight video thumbnailer
ii gstreamer0.10-ffmpeg:amd64 0.10.13-5ubuntu1trusty2 amd64 FFmpeg plugin for GStreamer
ii libavcodec-ffmpeg-dev:amd64 7:2.4.3-1ubuntu1trusty6 amd64 FFmpeg library with de/encoders for audio/video codecs - development files
ii libavcodec-ffmpeg56:amd64 7:2.4.3-1ubuntu1trusty6 amd64 FFmpeg library with de/encoders for audio/video codecs - runtime files
ii libavdevice-ffmpeg-dev:amd64 7:2.4.3-1ubuntu1trusty6 amd64 FFmpeg library for handling input and output devices - development files
ii libavdevice-ffmpeg56:amd64 7:2.4.3-1ubuntu1trusty6 amd64 FFmpeg library for handling input and output devices - runtime files
ii libavfilter-ffmpeg-dev:amd64 7:2.4.3-1ubuntu1trusty6 amd64 FFmpeg library containing media filters - development files
ii libavfilter-ffmpeg5:amd64 7:2.4.3-1ubuntu1trusty6 amd64 FFmpeg library containing media filters - runtime files
ii libavformat-ffmpeg-dev:amd64 7:2.4.3-1ubuntu1trusty6 amd64 FFmpeg library with (de)muxers for multimedia containers - development files
ii libavformat-ffmpeg56:amd64 7:2.4.3-1ubuntu1trusty6 amd64 FFmpeg library with (de)muxers for multimedia containers - runtime files
ii libavresample-ffmpeg-dev:amd64 7:2.4.3-1ubuntu1trusty6 amd64 FFmpeg compatibility library for resampling - development files
ii libavresample-ffmpeg2:amd64 7:2.4.3-1ubuntu1trusty6 amd64 FFmpeg compatibility library for resampling - runtime files
ii libavutil-ffmpeg-dev:amd64 7:2.4.3-1ubuntu1trusty6 amd64 FFmpeg library with functions for simplifying programming - development files
ii libavutil-ffmpeg54:amd64 7:2.4.3-1ubuntu1trusty6 amd64 FFmpeg library with functions for simplifying programming - runtime files
ii libffmpegthumbnailer4 2.0.8-2 amd64 shared library for ffmpegthumbnailer
ii libffms2-3:amd64 2.19-2 amd64 Cross platform ffmpeg wrapper library
ii libpostproc-ffmpeg-dev:amd64 7:2.4.3-1ubuntu1trusty6 amd64 FFmpeg library for post processing - development files
ii libpostproc-ffmpeg53:amd64 7:2.4.3-1ubuntu1trusty6 amd64 FFmpeg library for post processing - runtime files
ii libswresample-ffmpeg-dev:amd64 7:2.4.3-1ubuntu1trusty6 amd64 FFmpeg library for audio resampling, rematrixing etc. - development files
ii libswresample-ffmpeg1:amd64 7:2.4.3-1ubuntu1trusty6 amd64 FFmpeg library for audio resampling, rematrixing etc. - runtime files
ii libswscale-ffmpeg-dev:amd64 7:2.4.3-1ubuntu1trusty6 amd64 FFmpeg library for image scaling and various conversions - development files
ii libswscale-ffmpeg3:amd64 7:2.4.3-1ubuntu1trusty6 amd64 FFmpeg library for image scaling and various conversions - runtime files
ii libxine2-ffmpeg 1.2.4-2ubuntu1 amd64 MPEG-related plugins for libxine2

from veejay.

ffmpeg 2.8.1 and avconv 2.4.3

i think you only have ffmpeg installed ... (and 2.4.3 sound like a rare/outdated version)

what answer :
avconv --version
and
dpkg -l |grep ii |grep libav-tools

http://packages.ubuntu.com/trusty/libav-tools

from veejay.

@zenny The gdb trace you pasted is from reloaded, the FPE fault is in veejay so I'd need trace of that instead ...

from veejay.

@d-j-a-y Zenny is on Ubuntu, which comes with fork of ffmpeg

from veejay.

Zenny is on Ubuntu, which comes with fork of ffmpeg

Nop ... since something like ubuntu 12.10 avconv have take the place of ffmpeg ...
http://askubuntu.com/questions/432542/is-ffmpeg-missing-from-the-official-repositories-in-14-04

from veejay.

@d-j-a-y : I use ppa from https://launchpad.net/~mc3man/+archive/ubuntu/trusty-media for ffmpeg.

$ dpkg -l | grep ii | grep libav-tools
ii libav-tools 7:1.2.6-1~trusty1 all Multimedia player, server, encoder and transcoder (transitional package)

from veejay.

The gdb trace you pasted is from reloaded, the FPE fault is in veejay so I'd need trace of that instead ...

@contr0l: 'gdb veejay -v -n' dies itself. See http://hastebin.com/yuyisorawo.vhdl

from veejay.

@zenny : gdb veejay -v failed also for me .... but gdb veejay do the job ... any reason to bypass .gdbinit ?

from veejay.

you can do

gdb /path/to/veejay
(gdb) r -v -n -d

from veejay.

In latest revision:

• added 'Alpha Clear' for every frame period (alpha feedback/bleed gives pretty good visual results for life performances but you can turn it off now)
• added 'Luma Key composite'

Listing the sources (using Zenny's example)

We are are going to keyout the lady on the green background in Sample 3 and put her in the scene played in Sample 2

Using Chroma Key (in Alpha list) to select and key-out the green color

Once I'm happy with the Mask, I flip the switch (P5) so it outputs to the Alpha channel instead

Let's take a look at the Alpha channel by making it visible

Looks good, lets remove it

Play Sample 2 and put the Luma Key composite on it. In this view, mind the parameter settings and the mixing source

I did not crop the video as you can see

from veejay.

Hi,

Some artifacts at the center (like the black bar in the last picture you posted) and the rough edges around the keyed talent (seen in the second last picture you posted) are something are yet not acceptable for production, fyi.

@C0ntrol: On the other hand even the png files cannot be uploaded here as it reports "Something went really wrong, and we can’t process that file. Try again." And no matter how many times I tried, it just pointed out to a file like "![Uploading artifacts-black-bar-and-rough_edges.png…]"***

Could be permissions issue, I guess, as it never happens in other github repos.

***http://picpaste.com/ypczquDB.png

from veejay.

I added you as a collaborator now, please try again

from veejay.

The rough edges in the keyed talent are partly due to doing this in 1 minute but there are anti aliasing effects that can be seen in the mask (4th picture). On-going

from veejay.

small steps, adding level correction operator and matte coker, still some problems with green spill. shot also shows some transparency where the elbow reflects green light

not in repository yet, 13 fps for 1280x720

22FPS for 1280x720, fast enough

from veejay.

Chroma Key (RGB) ignores alpha-in currently

from veejay.

Transition Map usage:

1. Add 'Set from Mixing source' and select greyscale image as mixing source
2. Add 'Transition Map' and select clip as mixing source
3. Pull sliders to transition (or animate in FX anim)

from veejay.

Added alpha blend to manual chain fader, optimized Transition Mask

from veejay.

Chain Fade usage:

• Alpha toggle button is enabled
• FX entry 3 contains "Alpha: Set from Mixing source" and mixes with Sample 1
  
  

from veejay.

Issue is outdated, create new issue and review all Alpha related functionality

from veejay.