Solitude is home to the famous Bards College. This one encountered many bards who spoke of this college and recommended visiting it. It appears that all bards, in Skyrim at least, had been educated at this college.
Like all buildings in Solitude, the Bards College is made of thick stone. It is a tall building and one can see far from the top.