The BackSpace key (on every keyboard I've used) generates ASCII code 8. C-h sends the same code. In Emacs by default C-h invokes help-command. This is intended to be easy to remember since the first letter of "help" is "h". The easiest solution to this problem is to use C-h (and BackSpace) for help and DEL (the Delete key) for deleting the previous character.
For many people this solution may be problematic:
stty erase '^?'
into a Delete key like this:
xmodmap -e "keysym BackSpace = Delete"
the BackSpace key to be changed from a setup menu.
and Delete keys inside Emacs:
(swap-keys ?\C-h ?\C-?)
See section How do I "swap" two keys? for the implementation of swap-keys.
instead:
(global-set-key "\C-h" 'delete-backward-char) (global-set-key "\C-xh" 'help-command) ; override mark-whole-buffer
Other popular key bindings for help are M-? and "C-x ?".
WARNING: Don't try to bind DEL to help-command, because there are many modes that have local bindings of DEL that will interfere.