Bass won't play in time. Not a latency issue.

[Jumbomonkey]

The P bass won't play in time. Even after compensating with 80 to 100ms for the latency. It's not even consistent with itself, it plays out of time. How to fix this? Plugin is totally unusable.

*(Plugin has 50ms delay. My system another 50ms hence 100ms.)

The instrument is behind time on the 3rd note quite often, behind the beat. Even when it starts clean, it sounds like a beginner bass player who cannot play in time. So this is not a latency issue.