do you mean hard to remember when reading or when writing, or both?

Ha, never mind writing - every time I see 最 I think "yeah, that sure is a character I've seen before", but I can never remember which. (Though it's usually possible to work it out from context.)