The app TouchOSC does something like this. Resizeable template shapes can be placed anywhere on screen with color/label/size editing, and can be mapped to:
- Control Change
- Note
- Program Change
- Poly Pressure
- Channel Pressure
- Pitchbend
- Start
- Stop
- Continue
- System Exclusive
There's even a scripting section for each individual module. When I saw this, I immediately thought of SunVox and how this would be a great way to make the endless modularity more accessible. And users could share these too! You could control entire pieces of hardware through modules like Patch Base. A man can dream