There would first be 1 broadcasted on-chain transaction setting up the channel, with X of my bitcoin and Y of your bitcoin being locked up. This prevents double spend. Then, you and I pass n signed transactions between each other updating our balances Xt & Yt for each t, t+1, ...t+n. At any time, either one of us can broadcast the final transaction with the most up to date balance and unlock the coins.