The Kim lookalike was questioned by Hanoi police on Friday and informed he would be put on a plane back to Hong Kong where he lives.
The impersonator was told by Vietnamese immigration officials his visa was "invalid", but said he received no further explanation.
"The real reason is I was born with a face looking like Kim Jong Un, that's the real crime," he told reporters Monday, getting into a van headed for the airport with three Vietnamese men, not in uniform and who did not identify themselves.
White will be permitted to stay in the city but has been asked to stop appearing in costume in public.
The Trump doppelganger has been stopped on his Hanoi walkabouts by locals and tourists eager to snap a selfie with "The Donald". Howard X said he thought he was being deported because the real Kim "has no sense of humour".
His plane ticket back to Hong Kong would also be cheaper for Vietnamese authorities than a flight for White back to his native Canada, he added.
"Satire is a powerful weapon against any dictatorship. They are scared of a couple of guys that look like the real thing," said Howard X, wearing a signature Mao-style black suit and thick black glasses.
Vietnam is hastily preparing for this week's Kim-Trump summit, deploying security personnel across the city, where hotels and government buildings are getting last-minute facelifts ahead of the meeting.
The communist capital has billed itself the "City of Peace" ahead of the talks and is carefully corralling press events to avoid any embarrassing PR moments with the world watching the one-party state.
Business Standard has always strived hard to provide up-to-date information and commentary on developments that are of interest to you and have wider political and economic implications for the country and the world. Your encouragement and constant feedback on how to improve our offering have only made our resolve and commitment to these ideals stronger. Even during these difficult times arising out of Covid-19, we continue to remain committed to keeping you informed and updated with credible news, authoritative views and incisive commentary on topical issues of relevance.
We, however, have a request.
As we battle the economic impact of the pandemic, we need your support even more, so that we can continue to offer you more quality content. Our subscription model has seen an encouraging response from many of you, who have subscribed to our online content. More subscription to our online content can only help us achieve the goals of offering you even better and more relevant content. We believe in free, fair and credible journalism. Your support through more subscriptions can help us practise the journalism to which we are committed.
Support quality journalism and subscribe to Business Standard.