I understand there used to be a bit of bother with the army lads years ago but they stopped them going out in the piss long before I moved here. There is never any trouble with them.
Castle Park is fine. Same as any other city park after dark- nobody in there but youths drinking and taking drugs. That's what parks are for