Yes, I did think it would be nice to stay in the Castle district, but wondered whether having to either climb back up there or get the Funicular every time one went exploring might have limited one.
We compromised and stayed in the Art'otel next to the Danube opposite the Houses of Parliament. Lovely location, nice hotel and ridiculously reasonable.