You use tie in rods of rebar to bind one slab to another, not the aggregate because the aggregate does sh*t all for structural strength. It's more for the compressive strength.
Tbh you can make a form or concrete out of perlite and cement. It's light af, great for ship hulls when reinforced with steel. Still concrete,just doesn't need any sand.