I don't have a problem with that. And you can use samples if that's how you like to work. But if you do, then seek permission. Quite often you won't even get charged. A simple credit on the sleeve is all it can take - is that going to be so arduous?Using samples gives you intertextuality and reference. You can get a range of different vocal characters. You can get a range of different instrumental characters, come to that. The fraction of a second will have the 'sound' of a whole other recording setup - we're only used to hearing the sound of one studio at a time, so this gives you a slight jar. I might not have the time or money to buy and record a gong, a trumpet and a harpsichord just because I want to use a 0.1 second sample of each. I might like the sound of the old vinyl recording. Something in the sound of the sample might inspire me, rather than vice versa. Using a sample rather than trying to recreate it gives me more time to work on other elements of the composition.
And finally, there are a whole lot of things that we do because we're idle. We buy bread rather than baking our own. We have cars with power steering, or bikes with well pumped up tyres. We put our bags down if we're standing around for any period of time. Noone has produced a compelling moral argument against any of these, just as noone has produced a compelling moral argument against using extremely short samples, so I'll continue to do that too.
We're talking commercial here - if all you're doing is your own music for your own amusement, then sample all you like. If you're doing it commercially, I'd say you're an idiot to use uncleared samples if there's any chance it's recognisable. If it's not recogniseable than go ahead - but you still take a risk, because if you do become rich and famous and someone you work with spills the beans...you can rest assured someone out there will want their pound of flesh, and credit to them for chasing uncleared theft of their work.
If you're all for freedom of using others' sounds, then you can put it into practice when your material is out there and you can let anyone sample it. But whatever you feel about your own freedom, it is still irrelevant to you using others work.
And as for the contextual references of different studio sound etc - don't you even consider the fact that the band you sampled from has paid their own money for that studio time, and your sampling has ripped that off? Labels don't "give" studio time to any band. That band pays for it, whether out of advances or royalties, and it is all recoupable by the lable. Ripping it off is reaping benefit from someone else's wallet.
I'm not going to get off my high horsey. Sampling without clearance is either theft of music and/or theft of paid studio time. If you want the reference of the sound of a $10,000/hour studio - some other poor f**ker paid that to get that sound. The label didn't pay it - the artist did. "But I'm not using their music, I'm just using their sound..." It IS their music and they paid for their sound. You didn't.

