From Wikipedia: His problems are often caused by his own neuroses and an obstinate faith in his own understanding of ethics and etiquette. At the same time, he usually has good intentions and often finds himself a victim of circumstance and of the sensitive, easily-offended natures of those he encounters.

Cheryl Hines has a line in the 'Trick or Treat' episode that sums it up very nicely: "Not everyone knows about all your rules, Larry!"