Robustness of cosmic birefringence measurement against Galactic foreground emission and instrumental systematics