You'll need speakers, a receiver, and a (maybe) phono preamp. Some receivers already have a built-in phono preamp, but not all. Any turntable that doesn't require a phono preamp (Crosley, other low end stuff) is probably not worth using.
I assembled the majority of my setup from yard sales and my parents' basement, so I might not be the best person to ask about new gear, but I will throw in a plug for the U-Turn Orbit
turntable. Great price, and easily competitive with much more expensive models.