There's no scouring of the shire and Saruman is not in it at all. I would say those are pretty significant deviations.
The scouring of the shire would have been too much for a movie which I can understand. Not having Saruman in it at all was troubling though.