There are dozens of vinyl shops in Tokyo.
The biggest is Recofan. One shop is located in Shibuya.
Also in Shibuya, check out Next Records, Technique and Hi-Fi Record Store. Many have listening booths.
you didn’t say what genre you’re looking for. These shops have wide selections. Some shops specialize.