I will suggest studying some general Assembly language concepts, memory locations, how to set-up RAM timings and bring offchip RAM into an address space, etc.
This stuff is used daily in the world of microcontrollers, I'm a huge fan of the Parallax propeller, in which the Spin interpreter in ROM launches Assembly routines on individual cores in about the simplest fashion possible...
Some things you may find interesting: https://github.com/dwelch67/raspberrypi
https://github.com/rsta2/circle
Think of the latter 2 as "HAL plus some primitives" rather than RTOS...