Border officials said last year that there were around 33,000 foreign nationals with arrest warrants still at large in Canada, including many with criminal histories.