Usar "of that" ou "that"?

Hello.

Yesterday I was reading when I found the following sentence:

" The wildest imaginings that dark rumour had ever suggested to him fell altogether short of the real dread of that place."

My doubt is if it would be wrong or not to use "of" after "imaginings" and, if it is wrong, why?

Thanks in advance.