The problem here is that you ultimately will get a class of advisors/administrators in the civil service or from third party lobbyists that will serve as a backbone of experience for these groups of people, and they will be needed simply because they lack the experience and knowledge required to make correct decisions.
That in itself will likely devolve into an oligarchic structure.