It can't be really fixed, not without making the building less realistic, for example using fake glass or affecting fps.
If there are multiple glass surface (which is normal for an all glass building), transparent objects must be sorted at each frame depending on their relative position against each other and compared to the eye point. However, for the sorting to be effective, each glass part should be small, otherwise their center position wouldn't be very precise and, even in that case, some flickering will happen anyway.
But to achieve this, the glass façade should be break up into many individual elements, which of course is very bad for performance, both because many separate elements are inherently worse for performance, but mostly because the very thing that would prevent flickering, the sorting, will affect fps quite a bit, since it must be performed at every frame.