I wouldn't be too sure that Rishi wanted to raise taxes, his issue was cutting taxes and increasing spending. Johnson - because he's a fat, spineless idiot who stands for nothing - wanted to do both.
You might find that Rishi's preference was to cut taxes and spending, which is what should have happened. They are Conservatives, after all.