Want some examples:

1) Give me a day, one single day without UI crash report dialog.

2) Do not change nautilus functionality without letting one easy way to restore behavior as one used to -- for instance, within a given window, when typing "foo" instead of selecting foo in the current dir, it launches "find" app which takes ages on heavy machines

3) Why can't I no more edit (or even view) network settings of a network connected printer from the default printer applet.

and so on and so forth...

Sorry if I came off a little aggressive. No 1 is my pet peeve, but I'm not sure if I can uninstall apport without messing up other parts of my system.

Yes, you can simply disable by

gksudo gedit /etc/default/apport

Change enabled from "0" to a "1" so it looks like this:

enabled=1

After reboot it will be gone, if you can't wait type in the terminal:

sudo service apport stop