You'd have to get information direct from the devs to answer that accurately, I'm afraid.
My guess is that they'd have seemingly random matches at the beginning, almost like placement matches, just to get a quick estimate at where the player should be, based on performance and margin of victory. That's why the acceleration doesn't kick in for a few games. Beyond that, it's all speculation as to how Glory and skill interact with the matchmaker. I think that it's connection-based within a certain Glory range of your current rank (and I think that this range is being tightened with the update) and the hidden skill rating just affects how many points you gain or lose at the end of a match, so you are brought to the correct rank ASAP.
If you have a high skill rating and low glory, then it's just unfortunate if teams also at low glory but also with low skill face you while you're on the climb, so the acceleration should make those matches happen as rarely as possible.