The timing of the president's golf activities has drawn criticism as Americans watch their retirement savings decline following his tariff announcement.