How to create a control signal from image analysis? (Trigger on layer brigthness)

1

Is there a way to create a control signal from ISF or image analysis, when for example a layer goes above a certain brightness? How do i create “data” from the visual content of layers, output control data from ISFs?

Background:

My goal is to make collision detect triggers (bangs, midi events) whenever the non-alpha parts of two animated layers interact. I can make an ISF that watches the two layers, and “heatmaps” from black to white whenever and wherever the layers interact.

I have found the Pixel Color Sampler.vuo plugin that kinda works. It watches a single pixel and outputs that value as data which I can then use to trigger external events. My ISF can report the collision detection to this pixel. So I got it working, but without collision location. Its an inelegant solution that feels kinda overly complex, and also for FPS optimisation and project loading I like to avoid running any processing through VUO.

I was wondering if there is a simpler, smarter way using only internal tools?

(I have a faint memory of someone asking something similar a while ago, but couldn’t re-find the thread/answer)

2

Currently there’s no way to have ISF files generate data-source outputs; they are strictly image producing.

That is something that has been discussed as something for the ISF v3 spec, but you can work with vuo.

https://doc.vuo.org/2.2.0/manual/editing-an-isf-node.xhtml

ISF shaders can be placed in “~/Library/Application Support/Vuo/Modules/” (they may need to create this folder manually) and they’ll show up in Vuo as custom nodes

(you can also use Vuo’s built in ISF editor as described above)

1 Like