'Fitzroy' was an Anglo-Norman name meaning son of the king, but was usually used for bastards.

I know Griffin said it something about it on Wonderful, but it seems like this might be a bit of a hint into his characters backstory.