So, after playing around with the software that lets me phone control my computer I got to thinking about using bluetooth for remote controls. With a bluetooth remote control you could have one that did much more complex sets of commands. You also could have learning remotes that just would connect to a device and download their command set instead of having to train it.
Now I just need to convince all the A/V makers to do this.