The rule for a US licence
Japan recognizes International Driving Permits issued under the 1949 Geneva Convention only. Permits issued under the 1968 Vienna Convention are not valid in Japan even when the issuing country is a party to the 1949 Convention as well.
For US license holders this is straightforward: the United States is a 1949 Geneva Convention country, and AAA and AATA are the only two organizations authorized by the State Department to issue IDPs. A permit from either is the correct type.
Your IDP is valid for one year from its date of issue, and you may drive on it for up to one year from the date you enter Japan - whichever expires first.
Beware of online sellers offering "international driver's licenses". Those documents are not recognized in Japan and are not issued under any convention.
Live in Japan?
A licence issued in Japan is what you drive on at home - an IDP translates a foreign licence, so it does not apply to you here. If your licence is from somewhere else, check that licence country: the rule depends on where the licence was issued, not only on where you are driving.
What it costs to get this wrong
The US Embassy states that people found driving in Japan without a legal license are subject to fines, arrest and possible deportation. Driving without a valid license is a criminal offence under the Road Traffic Act, not a simple ticket.
At the rental counter
Japanese rental companies check for the IDP as a matter of routine and will not release a vehicle without one.
What the permit covers
An International Driving Permit is a translation of your licence into a standard multilingual booklet, issued under the 1949 and 1968 road traffic conventions. It is not a licence, and it is never valid on its own: you carry it with your own licence, and police expect to see both.
It is issued against the vehicle classes already on your home licence, and it never adds one. If your licence does not cover motorcycles, an IDP does not let you ride a scooter in Japan; if it does not cover a heavier vehicle, the permit will not cover a camper or a minibus either. The permit restates what you already hold, in a form the local authorities can read.
Driving in more than one country?
Check every destination on your trip at once - Japan is already filled in.
Check your tripOther destinations
Informational only, not legal advice. Requirements change and vary by length of stay, rental company, and vehicle class. Always confirm with the destination's embassy or your automobile association before you drive.