Friday, 13 March 2015

Hololens Speculation: What Kind of Applications Can We Build?

I'm so excited about Hololens. Its creative potential is huge. There are a wide variety of applications we can develop for it.

I believe the demos shown so far are barely scratching the surface of what we can do with the Hololens. Once the imagination of the development community warms up, and its abilities are clear, we're going to see world changing ideas. Industries will be turned upside down, lives will be changed, and millionaires will be made.

Of course, I'm speculating on what it can and can't do based on the minimal demos we've seen so far, but, providing they turn out to be accurate, there is plenty to go with already. I'm going to make some assumptions on its abilities, but with this, highlight some of the many directions we can take in creating for the interface of the future.

Presence Sharing

One of the most interesting uses for the Hololens is allowing others to share your experience, and interact with it. This opens up many prospects for communication and collaboration in virtually every industry.

Think about how cool GoPro cameras are and what we're able to do with them. Now imagine seeing the video live and being able to interact with it.

This particular feature also has plenty of promise for gaming, with users interacting with the same reality, or the same game area.

Reality Overlays

Probably the main purpose of Hololens is its ability to overlay the imagined onto the real. We have seen some examples of this, and there is so much more to come. Interfaces will probably make up the bulk of these overlays, and there is plenty of scope for variety in how these work. But the possibilities go much further than just interfaces.

We've seen game characters and levels merge with the real world. What about augmenting our environment with photo-realistic people, new fixtures and furniture, or movie scenes? Or changing our atmosphere with movement, light, and sound? Virtual Reality might do this better. But having the real world still in view gives a certain edge to the atmosphere.

Gesture Controlled Augmentations

The use of gesture controlled interfaces might have been around for a while, but it takes on a new potency in the realm of artificial reality. Rather than interacting with things on a screen, you'll now be able to "physically" interact with "objects" in your world.

And while the recognisable gestures are still quite simple, this will only get more complex with time. As the Kinect technology gets better at recognising more fingers and more intricate movements, it will allow for more advanced control in much the same way as musical instruments or crafts.

Reality Recognition

Let's not forget that the Hololens cameras can be used to process the real world and the things in it. Measuring distances, identifying objects, detecting movement and more can all lend to the interaction.

How far can we take this real world processing? Imagine, tailoring your experience based on what the Hololens sees, such as popping up an information snippet of a visible landmark, finding your friends in a crowd, or identifying danger.


Like gesture controls, voice finds new opportunities in this context. It's part of the experience, narrating what you see, talking over the internet, recognising commands, sometimes recording. What else?


There are probably several more Hololens abilities that I've missed, so please leave a comment if you can think of any. Each of the items above has the potential for some groundbreaking new applications. Combine two or more concepts and the possibilities increase exponentially.

We just need to start thinking differently about what we can do. Rather than extrapolating our current computers and software to this new paradigm (which we should still do), we should try to think about what new possibilities all these new capabilities afford us, separately as well as combined.

I didn't want to get too deep into these possibilities, I really just wanted to highlight them, to get people thinking about how they might use each of them.

It'll probably take a few years for the world to realise what Augmented Reality can do for it. But all ideas are built on other ideas.

We're just getting started.

Monday, 18 August 2014

R18 certificates are not an excuse for being a bad member of society

I've been a gamer for 3 decades, seeing the games industry mature from dots on a screen into a prolific mainstream industry. I'm not afraid of controversy in games. I'm not a prude and I want to make it abundantly clear: I'm not advocating banning anything. 

I've seen many disturbing titles, far worse than Grand Theft Auto. But this was when games were a cult market, and the technology was so basic, it was easy to dismiss the phenomenon.

Now, games have matured. They can do more and they reach more people. Like movies and other entertainment, they have the power to influence society. With this influence comes some level of responsibility. It's not an obligation - games are art and should be able to push boundaries - but rape in a video game is not art. It's gratuitous indulgence in a sickness, a sickness that hides behind freedom of expression.

If we're going to get philosophical about it (and I guarantee the proponents will) you could ask “where does it end? Should we ban all violence in games?"

There wouldn't be many games left. Maybe we should address the high level of violence in gaming. At least it's a conversation we should be able to have without all the "freedom of speech" bullshit. For now, we can at least draw the line at what is acceptable behaviour.

Would we allow child abuse in a video game? The creators would be locked up just for suggesting it and rightly so.

So why do we allow rape? It's even banned in porn, and used sparingly in movies and books when the story requires it. Gaming, putting the player in control, has a different context. Because of this it plays a different role in popular culture and should be assessed differently.

Killing might not be particularly healthy content, but at least it can be justified to a certain extent in games, and is; demons, war, self defence, etc. Many games (Batman: Arkham series, Deus ex) actively avoid it. It's rarely gratuitous - a game where you could shoot up a school should offend even the most hardcore gamers.

What kind of moral integrity do you have if you're actively campaigning to include abuse in entertainment? What does it say about our culture when people lobby in favour of sexual violence?

This isn't about the freedom of adults. It's about the freedom of assholes.

Despite what proponents might say, there is a link between gaming and real life - it's called culture. Entertainment shapes it and it shapes what people find acceptable. Abusing the vulnerable is not something we want in our culture.

Yes, the world is a violent place. Our popular culture doesn't need to hide us from this. But it really doesn't need to encourage it.

Wednesday, 19 December 2012

Guns Might Be the Least of Our Worries

Whatever side of the gun debate you sit, it's important to remember why this is such a potent issue.

It's not so much that guns kill, it's that they empower. Weapons have always elevated humans above other species and their peers, but none quite so much as the gun. And the ability to instantly kill without fail has been a game changer in our social order.

This empowerment goes a long way in shaping our entire civilisation. In some countries, it is used to completely control the population in fear, in others, the same idea but a more subtle effect, we are forced to pay taxes and obey the law for threat of arrest at gunpoint.

Guns tip the balance of power because of the ability they afford us. That it's the ability to kill is in no way insignificant, but the ability could be anything.

They are an enabling technology.

Enabling technology elevates individuals and shifts society's order. In the past, this has been fairly limited to weapons; guns, nuclear missiles, military hardware. But access to life sustaining knowledge and technology such as drugs and agriculture have also driven global politics and had significant impact on the lives of many.

Now, as we hit the knee of technology's exponential curve, we are likely to encounter an increasing number of new enabling technologies. What will this mean for society?

Given their empowering nature, we would do well to be vigilant about who has access to certain technologies. Elites will likely work to prevent or restrict general population access (after dropping the ball with the internet) as much as possible. They will also attempt to commandeer certain technologies for their own purposes, surveillance, resource acquisition, health (immortality?) benefits or other, not-thought-of powers. This already happens, but its effects will become much more significant.

Imagine soldiers upgraded to be bullet proof, or have the ability to heal themselves. Arial drones are already causing havoc for the United States. It won't be long before we have robots everywhere, monitoring us, or even preventing us from performing certain actions - which might be unjustly deemed crimes. What if a bird was not a bird but a bomb? What if a tiny fly flew into your ear and injected you with an RFID chip? These technologies are extremely close - and most are already here.

There is of course the threat of these technologies falling into the hands of terrorists, murderers and psychopaths. We can go a certain way to preventing this with controls (like gun control), but what's stopping a criminal getting hold of a black market 3D printed gun? When the empowering nature of the technology can itself enable the undermining of such controls - what good are they?

Albert Einstein said: It has become appallingly obvious that our technology has exceeded our humanity.”

As the creation of enabling technology escalates, it seems our humanity is simultaneously declining.

Thursday, 31 May 2012

The Ethical Implications of Dismantling the Planet Mercury

George Dvorsky's article about How to Build a Dyson Sphere was absolutely fascinating and I feel the concept deserves much further exploration.

"By enveloping the sun with a massive array of solar panels, humanity would graduate to a Type 2 Kardashev civilization capable of utilising nearly 100% of the sun's energy output. A Dyson sphere would provide us with more energy than we would ever know what to do with"

Now, this is the kind of ridiculous, overambitious idea that that really captures my imagination. It would be a hyper structure, like the Hoover dam but on steroids, where we would create unfathomable devastation, calling on the skills and labour of thousands, enduring the harshest that nature can throw at us in order to tame it - all in the name of energy. Where the Hoover dam transformed a country, this would transform our entire solar system. But it's not without cost. And that's what I want to discuss.

In order to get the materials to build this monolith of human achievement, we're going to have to make some sacrifices. Namely, the planet Mercury.

But what are the ethical implications of dismantling an entire planet for our own purposes?

One might argue that it's an otherwise useless planet, a burning chunk of iron and rock with no desirable real estate or even aesthetic value. But does that make it Ok to take it apart for spares?

What will future generations think about dismantling the planet Mercury? They will probably be a lot more conscious about the implications of such vast resource exploitation, given that they will be growing up in a world full of pollution and big empty holes where coal and precious metals used to be.

In today's world, these kinds of concerns are rarely considered, or if they are, they are still ignored if there is money to be made or amenities are required. But the people of the future will have their say, either way. This will bring the debate into the the public arena, allowing countless others to raise topics and concerns that may never have been thought about - issues that could have untold implications on the project.


Mercury of course raises another issue that may throw a spanner in the works, that of legal rights. Who owns Mercury? Does anyone? Even if someone did own it - this might not stop someone who has the facilities to get there from taking it from someone who can't. 

We could put it to a democratic vote, involving the whole world, but could you imagine the political nightmare a worldwide vote would be? Coordinating the political process across different cultures, legal systems, technology levels, ideologies, and population sizes would be a logistical task comparable to dismantling a planet.

How Decisions are Made in the Real World

At the end of the day whether or not something is ethical has very little bearing on whether it goes ahead. What matters is the decision making mechanism of the time.

Right now, our decisions are based on finances. What is wrong or right is always superseded by the potential to make money, save money, or the liability to cost money. If it would be profitable to dismantle the planet Mercury, all it takes is someone with enough power to get the idea into their head and it will happen. I'm not sure that currently, there is any business or government in the world with enough money or resources to put this idea into practise yet, but that may change in the future.

Perhaps by the time a Dyson sphere becomes feasible, society will be running on a different modus operandi. Perhaps there will be a different currency other than money, something else that holds value but is traded in a similar way. If this currency was directly related to the Dyson sphere, for example, if it was energy, then this might also drive the Dyson sphere's production and supersede any moral concerns about dismantling planets. If the currency was something else, such as art or community help, then production might not be pursued as the need for the Dyson sphere wouldn't be reconciled by the needs of the people. But the project will always remain a possibility as long as energy holds value, and it probably always will, the question would be how much.

Practical Implications

As well as the ethical and legal implications, we would also have to consider the practical ones, as these may also have ethical implications of their own. For example, what about the effect on the gravity of the whole solar system? If something went wrong, the Earth could end up falling into the sun or flying off into space - these are pretty serious ethical concerns! Of course there would need to be some extremely accurate calculations before we attempted to commence resource extraction of this scale.

A Responsibility

After all the negative ethical dilemmas brought about when deciding whether or not to dismantle Mercury, It could very well be argued that it is actually our responsibility to uplift humanity, to alleviate suffering. That it's humanity's purpose to advance our technology, our civilisation, our place in the universe. To do this, we need to use all the resources we have available to us. It would be unethical not to.

The question would then be, what will be the return on this mother of all investments?

Monday, 21 May 2012

Corrolation, Causation, and Prediction in a World of Data

 As image memes gain popularity on social networks and forums, they are fast securing their place as a defining cultural aspect of the early tweenies...(unlike the word "tweenies", thankfully).

Most of these images are humourous, as this is great for virality, many are profound, some just witty nuggets of wisdom.

And then there is the propaganda. Intended to illicit an emotional response to a political idea, propaganda memes are used to affirm or reaffirm a political bias or dogma. They are often aimed at a very particular niche. If you have any particular political or activist persuasion, you will no doubt have seens endless streams of these one-sided affirmations.

At best, they are intellectual masturbation. At worst, it's pseudo-scientific social engineering.

The worst form of this that I have seen is data correlation inferences. Just because something happened on a certain date does not mean it caused something else that happened around the same time. It is completely irrational to infer causation from a correlation, and most people are subconciously aware of this, they will just choose to ignore it if the correlation fits in with their beliefs. So this form of non-sequitur is becoming an increasingly utilised mechanism for these pieces.

It is a shame that this kind of irrationality is being entertained, not least because data correlations can be valuable analysis tools. Correlations can be useful indicators for understanding social dynamics, as long as it is acknowledged that this evidence is purely circumstantial.

Alone, correlations are not proof , but they can reveal vital clues about possible causation.

They can also be powerful in assisting predictions. The more we know, the more correlations we will uncover, and the more we can use the circumstantial correlations of the past to make reasonable conjectures about the future.

As Twitter and Google and other web-enabled data collectors increase both the range and volume of their publically available data, the more correlations become available to anyone with the inclination to look for them. Using tools like PowerPivot, our prediction capabilities become ever more reliable, and with them, the possibilities of social engineering reach new and increasingly influential heights.