Australian minister says temporary visa holders who flout coronavirus restrictions could be deported.