Manitoba Premier Brian Pallister apologized on Tuesday for his recent and widely condemned remarks on Canadian history, but said his heart was in the right place.