This problem plagued me for a couple years, off and on. I had the trickle charger/maintainer on all night, but the bike would crank and crank with no start in the morning. I'd leave the charger on all day while at work, and the bike would fire off quickly when I got home in the afternoon. F'ing hair pulling nightmare.
After going through my 2-brush starter (smooth turning starter used fewer cranking amperage), fixing my charging issues, including soldering some connections, and putting in the bigger battery, the bike starts fine, morning or afternoon. These CDI boxes are weird when it comes to voltage requirements.