[spoiler="About new European space exploration"]As a (not-so-)brief comment on non-commercial space research in Europe: It'll need backing from a nation-state. ESA will work fine if it's backed by billions from France, Germany and UK (and pennies from a host of other nations). Alone, no European nation does possess the money to blow off into something that doesn't provide immediate returns, such as manned missions to deep space. If NASA needs to wrestle with the Congress, ESA depends on a good number of independent parliaments, most of which will be quite happy to get extra populist points from the voters by axing unnecessary costs. Example: Galileo "is a stupid idea that primarily serves French interests" (according to a German CEO working in the industry). That's 20 billion euros that could be fed to somewhere else. I doubt developing a manned spacecraft is anywhere that cheap. If a major supporter withdraws their billions, you'd possibly see the whole program fail on the drawing board. As such, the only way ESA could hope to develop a manned spacecraft would be to buy old plans from NASA/Roskosmos and modernize the design. (Admitted, I'm not working in that industry, but I assume that my pessimism is warranted - and as such, in the near future men will travel into space on board vessels built in the private sector, China, India or Russia.)[/spoiler]
[spoiler]I think that Bigelow Aerospace and commercial LEO manned transport (SpaceX, DreamChaser, & Boeing) will allow some of smaller nations to have actual manned space science programs. Sending a group of two or three scientist for 4 months every few years to conduct science experiments is more affordable when you only have to pay for those 4 months. When the company supplying the facility starts to have customer/renters rotating through on a regular basis the cost of the orbiting lab is amortized across those customers. The individual national publics do not see a $100B orbiting lab paid for with their money, but rather see money going to support science utilizing a commercial facility needed for the research. The company gets to treat all of its customers relatively the same, be they a national entity, another company, or an individual.
The "trick" to opening up manned space science to smaller nations is to make it affordable for them to have send astronauts/scientists/explorers interesting places. I have no illusions that the Finns, the Poles, or the Dutch (as an examples) do not want to fund a a full-up manned program if it is just for Frenchmen, Germans, and Italians to go. However, they may be willing to spend some money ($20m-$50m) to send an native astronaut up to a commercial station for a period of time.
I think this will be happening by the end of the decade, if not before.
By 2030, I think a small commercial outpost on the Moon will host a rotating population of scientist from a multitude of nations. There may be those who have a more permanent presence based on desire/funding availability, but anyone willing to pay for the 3-4 day trip there, a few weeks on the surface, and the 3-4 day trip back will be able to go there.
Lastly, the people calling the shots on these outpost/vehicles will not be the US or Russian governments, but the company providing the service. The contracts will be very clear and hopefully little in the way of political issues on the service providers end.[/spoiler]
And that is the real struggle - what product does an orbiting city provide to the Earth? Answering that simple question makes the future so close, but so far away happen. The technology exist and has for decades, it is a lack of will and/or need.
In essence, that'd require a consumer or military application where some of the components must be manufactured in zero-G (grown crystals or something like that).
The only way I see that happening is if governments and companies invest in studying what the free fall environment provides. Another area that many advocate is the development of Space Based Solar Power (SBSP). One of the biggest challenges of SBSP is collecting the required components in orbit. It either requires a lot of launches or a program to capture an asteroid or mine the Moon.
The shuttle had some great achievements, but it was an unreliable craft.
May the next generation not cost so many lives.
This is a touchy subject. Measured risk must be taken, it is something we all do everyday. It may be that more lives are lost in the next generation of vehicles, but not because the vehicles will be less safe or safer than the Shuttle. It will be because we, humanity, take a greater risk. The first Astronauts & Cosmonauts were test pilots for a reason, they faced death everyday and understood the risk.
The mistake is tricking ourselves into thinking it will not be dangerous, that we can somehow make ourselves safe from the dangers that abound.