Plus you need about the same amount coming back in.a 512 sample buffer size, can have for instance a 12ms output latency,
That's 24ms latency, which would be VERY good with a buffer size of 512.
I reckon it's more likely to be double that for most people - and that is pretty difficult to play along with.
It's fine if you hold down one key (or chord) but not if you need to play short notes in time.
