OSQP solves only continuous QPs. For integer variables you need an MIQP solver.
We wrote a Python branch-and-bound wrapper around OSQP to solve MIQPs: https://github.com/oxfordcontrol/miosqp
However, there are more advanced MIQP algorithms out there such as GUROBI or CPLEX.