One of the main challenges in establishing a robust visible light communication (VLC) link is to prevent optical interference produced by other light sources from corrupting the signal. Previous solutions aiming to solve this issue assume that the signal and optical noise are present in nonoverlapping frequency bands. Our design incorporates an innovative transceiver architecture for establishing a frequency-independent interference-tolerant VLC link. The transmitter exploits the polarization property of light to transmit differential signals over adjacent channels, and the receiver utilizes differential amplification in conjunction with polarization to reject any common-mode optical noise. Thus, we can reliably establish an interference tolerant VLC link for medium data rate applications.