I know exactly where you're coming from, but it's also worth remembering this: if you're playing in a band with a tight rhythm section, then it's like playing to a click. If your song needs a drum track, I'd say go with a click unless you already have a drum track recorded, in which case play to that.
Another thing to consider - if you find playing to a click a bit soul-less, dial up a drum groove and play along to that instead. You'll get better feel and movement.
Two great points Tone
A good drummer should, for most genres, be metronomic. Their primary job is keeping time. One of my pet peeves at the studio is a drummer who follows the band. NO! The drummer leads. If the guitars falls behind the beat, the guitarist should realise and catch up. Assuming, of course, that the drummer has good timing.
And great point about programming a groove as click track.
I often provide drummers with a pattern as such:
-side stick on 1 2 3 4
-soft ride on 1 to signify bar start
-for some songs a hihat on every beat and off beat to push it along - esp usueful on slower songs
A gentle groove encourages the drummer to get into the head space to groove as well!
"Quantisation" to sound more human with programmed drums doesn't (well shouldn't!) throw off the timing. It simply moves a few hits subtle inside of the beat, to add a humanity. This is fine. But unintended rallentandos and tempo changes are just ropey playing.
Aside from the world of drums:
If you KNOW that your track is going to remain stripped down, and you want a loose feel, go clickless. I did this on a track recently.
But, often I use a click just in case I decide to build a track up later. A click shouldn't kill the feel. It is however a new thing to get used to for some people. I have been amazed at how bad some otherwise stunning musicians have been in my studio when I turn the click track on. They can play wonderful complex phrases, yet ask them to do it in perfect timing and they throw the instrument down and growl!
I blame
running before they can walk syndrome. Same reason a lot of guitarists can fretboard wank the scales but can't do an effective "down down down-up down-up" strum pattern, with the automated arm one should acquire during musical juvenilia. They just skipped that part and ran ahead!
Musings over