I just got this book Build a Large Language Model (From Scratch) by Sebastian Raschka (Author) Might help you dive into the internals.