Prime Minister Anthony Albanese has been labelled the weakest leader since the early 2000s as Labor prepare to go into damage control following a new poll.