Much more successful was the menagerie of animals James kept here for his entertainment, exotic birds, camels, even an elephant, who was given a daily ration of a gallon of wine. It wasn't until 100 years later, in 1708, that a house was built on the exact spot where the Palace now stands. 1708 Today, all that remains of that house is the name of its owner, the Duke of Buckingham. Soldier, politician, intrepid seafarer, but also so disliked at court for his arrogance, he was nicknamed "Lord All pride".