"If I have to have him arrested I will to get this dealt with today. Stop messing around. I'm concerned this is time wasting."
The court was adjourned a number of times to allow the peer's legal team to take advice on how to proceed.
At one stage they left the court to tour the building and observe the possible route Lord Janner would eventually take to reach the courtroom.
On Thursday his lawyers lost a High Court attempt to avoid him coming to court at all after arguing that his health was too poor for him to attend.
Doctors had told a magistrate last week that the impact of the dementia meant he often did not know where he was.
The peer has long denied any wrongdoing in relation to the allegations which date back to the 1960s, 1970s, and 1980s.
His family say he is entirely innocent.
