During my trips I often felt that I needed to save some money and so visited places with no entrance fee. It was also very useful to know about what's free in Japan, so I'd like to share my own experience.
Restrooms. Restrooms are free and located in many public places, such as train stations (and in some trains too), shopping centres and large stores, restaurants, public parks, museums and so on. Public toilets are generally very clean, so in that sense traveling in Japan ought to be comfortable.
Water. Free water can be found in many public drinking fountains at stations, parks, onsen or public baths (inside) while both free hot water and water with or without ice is always served in restaurants even before ordering. Sometimes green tea is offered. Sauces and condiments are also free of charge.
Information. At large stations like Tokyo, Ueno, Sendai, I found many leaflets and brochures with useful information and maps of cities and transport.
Temples and Shrines. There are many large temples and shrines that are free to enter, such as Senso-ji, Meiji Jingu, Gotokuji, Sengakuji, Nezu Jinja in Tokyo, Yasaka Jinja and Fushimi Inari Taisha in Kyoto, Sumiyoshi Taisha in Osaka, Itsukushima Shrine on Miyajima, Suwa Taisha in Nagano Prefecture, Yamadera and most of the Shinto shrines. Some temples, however, like in Nikko and Kyoto charge a fee.
Castles. Castle grounds usually have no entrance fee, but for entering the castle itself purchasing a ticket is required. Spacious grounds with gardens that free can be found at Matsumoto, Osaka and Hiroshima Castles, and many others, of course.
Public Parks. Public parks in Japan are free to enter. I visited Ueno, Koganei and Yoyogi parks, the Imperial Eastern Gardens, Higashi Park and Tsutsujigaoka Park in Sendai, Nara Park and many more.
Free observation decks. Tokyo Metropolitan Government Building and Sendai AER building offer free observation decks. These are some of my favourite places to visit.
Attractions. Some parks with attractions have no entrance fee, only charging for the rides themselves. I especially liked Cosmo World in Yokohama and Tokyo Dome City Park with its beautiful musical fountain.
Arts. There are many free museums and galleries - Maruzen Gallery in Tokyo's Oazo Building, Tanabatakan in Sendai, the Umen Noodle and Kokeshi Doll Mini-Museum at JR Shiroish-Zao Station, Sendai International Center Station.
Brewery tours. Many factories producing drinks give free tours with degustation opportunities such as SUNTORY, KIRIN, ASAHI.
Festivals. All wonderful festivals are for free!
A lot of amusement parks have great atmosphere and present interesting photographic subjects and they’re free to walk through.
My city has an à la carte amusement park - pay for only the rides you want. And it’s beautiful.