As others have pointed out, it is not just graphics. You don't need to write your own networking, your own editor, scripting engine. It really saves a lot of time
You need to write you own version of all that stuff and effectively just use UE as the graphics engine.