Millions of international tourists are avoiding the U.S. this summer, and Americans are starting to feel the loss.