It is not unusual to see other team baseball caps in other major league cities, I assume it happened frequently when the Red Sox had few or no black players.
In the 1980s when the Cardinals were the running Redbirds, with many black players, like Ozzie Smith, Willie McGee and Vince Coleman, I saw more Cardinal caps in Philly than Phillies hats