The Archbishop of Paris had a palace squeezed between Notre Dame and the southern branch of the Seine, which has since been removed. During the French Revolution, however, it was used as a hospital.
The American connection is that after Rochambeau was released from his incarceration in the Conciergerie during the French Revolution, he was treated in this hospital.
OK, I know it’s a pretty tenuous connection, but it would sort of be a shame not to work Notre Dame into this tour somehow — this is my best shot 🙂