Delayed Healing / Non Union common?

So got my fib fracture checked at 5 weeks after break / 4 weeks cast - I know it hadn't been long enough, but I was super bummed out the doctor said it wasn't healing / only just starting to heal and "different bodies heal at different times, ... some don't heal at all! We'll have to wait and see! You need to be patient!" when originally he said I was likely to switch to a smaller cast or walking boot at that point. Still NWB, new leg cast, but forced into a neutral position (unlike last one).

His words freaked me out and I had a whole day of moping and laying depressed and convinced I'd be hobbled forever. (I know, drama queen. I was feeling lonely and emotional and trapped). Now I've done more research and feel a bit calmer on the timeline.

Curious: How many weeks in a cast have others had for distal fib fractures (no surgery)? Did you experience delayed union or non union, and do you know why? I (41f) am not a smoker but am/was quite a drinker (working on that now, basically limiting to weekends), started taking calcium and bone health supplements and vitamins religiously, but did accidentally live off ibuprofen for the first 2 weeks. Anyone similar experiences or delays?

5 weeks ago and just the other day photo with cast included.