Don't think you did it right. In order for it to work, you have to bypass the temp switch with your manual switch, so it sends 12V to the fan instead of the temp switch.
I think the way you did it will only work once the temp switch gets hot, which kinda defeats the point..