Yes and no.
In Georgia the possession of the stamp is an affirmative defense to avoid prosecution, but legally you don't HAVE to show it to anyone other than the ATF. Essentially, if arrested by state law enforcement for suspicion of possession of unregistered silencer you can show the stamp...