Haptic feedback - the next step in the evolution of midi controllers

[sznattila]

Hi all,

Here are my 2 cents for what is next in the evolution of midi controllers.
Now we have polyphonic expression - the greatest leap in midi so far.
And to really move this in the next phase I think what is missing is the one thing that we don’t have from the world of acoustic instruments is haptic feedback where the touched area of the surface would vibrate based on the frequency of the sound.
Acoustic instruments vibrate based on the frequency of the sound and harmonics that is being produced when they are played.
This would really be an amazing feature.
And in terms of vibration it would be amazing if they would somehow would be “modulated” based on the x-y-z and aftertouch information. And not just the touch surface but the whole body of the midi controller. Somewhat like acoustic instruments do.
I know it is somewhat a fantasy and probably it would be a very tedious job to create but it would be a really great feature. Probably expensive too

[FranklyFlawless]

See also:

Okay, well the last subject I mentioned during the end of the December monthly Zoom meeting was about the Airborne Ultrasound Tactile Display:

• Midair Haptics by Airborne Ultrasound Tactile Display (AUTD) | Shinoda & Makino Lab

In terms of technology assistance, the idea is to utilize midair haptics to determine finger placement above the playing surface during note scans. The proprietary variant is called Ultraleap:

• Haptics | Ultraleap

One of many issues I am facing is playing without looking at my hands, so I have been developing an ergonomic keyboard playing position framework in order to consistently perform improvisations without visual dependency. The biggest hurdle at the moment is note scanning, so my current strategy is always keeping a finger from one hand on the playing surface as a point of reference. It is challenged by difficult-to-access (simultaneous) intervals dependent on the finger and hand used as well as lack of rest notes during the performances themselves due to this approach.

[sznattila]

That looks promising.
I wonder if any technology of smartphones haptic feedback systems would be easier to implement though.
Because haptic reaction is only needed when the sound is produced when the surface is touched.

[sznattila]

Also another field of controllers would be interesting to give haptic feedback is electronic wind instruments…

[FranklyFlawless]

I am more interested in accurately identifying present and future notes on the grid at all times rather than direct haptic feedback.

[Dirk Diggler]

I believe haptics might be useful when trying to play on a glass screen or phone/tablet.
To me haptic frequency would be wholly confusing in actual use.

Are you thinking like a haptic LFO for frequency? Slow for low notes, fast for higher?

Please keep haptics away from my Linnstrument, thank you.

[John the Savage]

I'll second that. Haptics... No thank you.

Cheers!

[SteveElbows]

I've got a 'never say never' attitude to this, but the underlying mechanisms and subtlety of results will need to be way better than currently mature tech allows before I will show an interest.