Unless your pan is really well seasoned, I'd not use soap on it unless I had to. I use soap and water on mine (really well seasoned) , but not every time I clean them, in fact I try not to use it unless they are gunky.
Try scrubbing it with very hot water instead. Skip the soap unless it is really gunky. Make sure you dry thoroughly. I put it on the stove and heat it to make sure it is 100% dry.