Used CDs from Amazon, unless I just don't like the album a particular song is on. It's cheaper, you get the liner notes and (more importantly) the sound quality is going to be better.
For those "one hit" song albums, I usually just download from Amazon. Like Cmonster mentioned, you don't have to use the downloader app they recommend, but it helps if you are intent on downloading an entire album.