Part of the problem is that if something is physical, people expects it to be lend-able. E.g. Books, CDs, DVDs, etc. (you can also think of things you can borrow in the library) People don't expect their digital downloads to be lend-able (e.g. iTunes songs, Kindle books, etc.) In that sense, Microsoft has to play the game carefully. I think it will still work if games on XB1 sells at <$35 compared to $60 on PS4.
On the note of internet connection, as much as Microsoft thinks that everyone should have an internet connection at home today, it is still something that you should not expect everyone to have. Many XBOXes are sold globally and internet broadband connectivity may not come easily.
Besides the issue of lending of games, I do agree on the vision that the console will be a center piece of the living room. It is much more than just games.