Cannot make contact with former coworkers, is that legal?

I mentioned to the temp agency that the supervisor I had was taken by surprise when I mentioned I was let go, I was scolded for making “inappropriate” contact – did the temp agency do anything shady there?