Modern buildings may have good insulation and be well sealed, but they often have minimal thermal mass.
Your garden office has almost no thermal mass. That means it will warm up quickly in cold periods. However when it is hot, there will be no thermal mass material to absorb heat and refuce temperature. As soon as the sun gets in through the window the heat will rise quickly.
Maybe during the day when you have the windows open, the flow of air makes it feel cooler. Once its shut up there is no air movement, apart from convection so the warmest air ends up high up, at head level.
Your garden office has almost no thermal mass. That means it will warm up quickly in cold periods. However when it is hot, there will be no thermal mass material to absorb heat and refuce temperature. As soon as the sun gets in through the window the heat will rise quickly.
Maybe during the day when you have the windows open, the flow of air makes it feel cooler. Once its shut up there is no air movement, apart from convection so the warmest air ends up high up, at head level.