Starting some office drama
You spend much more time with your colleague than people you love, that is your family and friends. They can be so disturbing sometimes yet you have to have a constant smile and to be friendly with them though they are annoying.
So this line if used in a joking way could be very great to get rid of your frustration while leaving your colleague in a dilemma that you were serious or you were joking.