Asterisk's estimated hold time simply wasn't accurate enough. The problem seems to be when
Asterisk is used to long periods of next to no waiting time - something you can't really fault
Asterisk for since it's not psychic.
The system determines the wait time is a rolling average of the time to answer