As well as outlining plans for the first stage of the project, council chiefs outlined their long term masterplan to improve the county town.
This includes Exchange Street becoming a boulevard, with extra pedestrian crossings to reconnect the canal-side with the town centre.
The back of the old county offices and the old Trading Standards offices would also be demolished to create a new view of Judges Lodgings.
It is hoped that in the future that area will be redeveloped to create a cultural quarter, including new places to enjoy the arts.
Martin Tett, leader of Bucks County Council praised the plan.
He said: “This will mean the Judges Lodgings will be out in the open, that will make a centrepiece to reinvigorate the High Street.”
There are also plans to improve the public spaces in Exchange Street/ Walton Street, in a bid to make it a more inviting area of the town.
Hale Leys and Long Lionel are set to be reconfigured and refurbished to improve the offer for pedestrians, while Hampden House would be redeveloped to provide possible residential and retail facilities and an improved car park.
Councillor Neil Blake, leader of AVDC, stressed that these were longer-term goals.
“Confidence in Aylesbury is certainly growing, but we need to keep our feet firmly on the ground and make sure our plans are realistic to deliver. That’s why we are concentrating on the first phase rather than the whole site.”