I am new to rowing. However rowing is primarily a legs activity. You should only minimally be using your arms.
Slow down. A good pace is 2min/500m. Any faster and you will feel spent.
You can do intervals to build endurance: 30s fast work/90-120s slow and repeat 5 or more times. If that’s too much try 15s/60-90s. Build up from there.