In Faversham itself, rather than Whitstable?
Not really. The only decent places to eat in Favo are pubs, sadly. For fish, I'd go for the Three Mariners, which has a bit of a maritime theme going on, down to the food itself. Nice pub.
You can take a walk out onto the marshes afterwards and rape someone/get raped, depending on your preference.