If Prince William didnt want to be king, and handed it to Harry would Harrys children be in line to the throne

FULL QUESTION: If Prince Charles died before taking the throne and William didnt want it and handed it to Harry before they both had children, would Harry's children then be in line to the throne, or would it be handed back to William's side if he subsequently had children thereafter?