The issue seems to be that the installer cannot close other programs.
Mine did exactly what you’re describing about 8 times, each time saying ‘Rolling back changes.’ Which is exactly what the installer says if you cancel closing of other programs.
In my case the offending programs are Firefox and Cortana. (Windows 10)