The most annoying thing for me was Molly Hooper (the coroner). Her sole reason for existence seemed to be as someone Sherlock could callously dismiss and then end up dating Moriarty, ha ha.

And yes, Moriarty had nowhere near the presence of his literary counterpart.