The oath of office is supposed to be at Noon. He's currently giving his address even though he's still not the president.
Obama on the other hand was sworn in late because of the affirmative action singers that took too long. He also botched the oath and had to repeat it later. I wonder if they'll tell Biden to repeat it because he said it before he was allowed to take power.