"I was probably too young and it was annoying to him," Anderson recalled of his on-set dynamic with the late actor, who died ...