This article suggests that the federal government can use its taxing power to make it more expensive to build personal arsenals. Specifically, I argue for an incremental excise tax, which would be imposed on each successive gun after the initial purchase, which would be tax-free. I believe this approach would offer two advantages. First, given the current constitutional landscape, such a tax would be much harder to challenge than a restriction on gun ownership, which directly implicates the Second Amendment. Second, an incremental tax would distribute the costs of arsenals in proportion to the public safety risk created by each individual gun owner. A tax could be implemented with the adoption of universal background checks without limiting an individual’s choice to own multiple weapons.