The retaliatory levies will affect $20 billion worth of annual U.S. exports to Canada.