Originally there was a 4th button, "menu". Android had a standard grid-shaped menu that apps could implement, that would pop up from the bottom of the screen.

Also "recents" wasn't its own button, it was reached by long-pressing "home". The other button was "search".