The only danger with tempo is doing it too fast.
If you do it slow, then it will be easily handled by your slow-twitch muscles and thus shouldn’t have a negative impact on your speed.
However, if you do it too fast, then your fast twitch muscles might need to be recruited to help out and this could potentially cause fiber down-conversion over the long term.