What rammis said.
In addition, I think that if you stick with a "classic" turntable paired with a recommended "classic" cartridge, and follow the manufacturers instructions for both, you probably won't go wrong. (After all, if the same things worked well back then, they should now!)
For some such classic cartridges, OEM replacement styli are available. But with the vinyl craze, they are getting rarer. Luckily there are still a few companies around selling replacement styli that are essentially as good (and exact) as the originals.
A few weeks ago I took stock of all of the cartridges that I still own. I assumed that, with the exception one that currently on the Stanton 681EEE with my Yamaha P-850 turntable which I know to have low hours on it, all of the others are likely worn out, because I don't trust that they are not. (I suppose I could have them inspected to find out.)
That includes the Shure M91E that I have on a Pioneer PL-510 that I want to start using in an all-analogue (vinyl and cassette) "vintage" stereo system I'm assembling (for shits and giggles - not sonics!) And rather than looking for a replacement stylus, I decided to bring either an audio-technical AT130E or an Audio Dynamics ADC XLM Mk II Improved back into service instead. After some thought, and after looking for sources of replacement styli for each, I decided on the ADC, and the new stylus is sitting beside me waiting to get installed and mounted.
But to Dent's question, assuming (after some research) that the match between tonearm and cartridge is ok, then any of the cartridges that I've mentioned should sound quite good, and not break the bank, assuming you can find them, and replacement styli for them.
Jeff