I have noticed the complete opposite. Most people who do speed based programs run close to their best early on (assuming adequate form), while people who have done no speed work routinely drop tons of time simply via a training effect generated by getting the meets in.