When is it acceptable to walk out before a job interview?

I have been waiting for 20 minutes for the interviewer and I'm just about ready to walk out. For future reference, how long do you normally wait before leaving? -Edit: The next person to be interviewed has arrived and I'm still waiting