Lifeboat Foundation: Safeguarding Humanity
Toggle light / dark theme

Blog

Tag: Harry J. Bentham

From CLUBOF.INFO

The increasing detail at which human brains can be scanned is bringing the possibility of mind-reading appliances closer and closer. Such appliances, when complete, will be non-invasive and capable of responding to our thoughts as easily as they respond to keys on a keyboard. Indeed, as emphasized in the Lifeboat Foundation’s 2013 publication, The Human Race to the Future, there may soon be appliances that are operated by thought alone, and such technology may even replace our keyboards.
It is not premature to be concerned about possible negative outcomes from this, however positive the improvement in people’s lifestyles would be. In mind-reading appliances, there are two possible dangers that become immediately obvious.

Danger 1: “Thought police”

Brain-machine interfaces have many possibilities that deserve to be explored by science. However, there are also potentially dystopian threats presented by this technology. Even technologies like personal computers, which were seen as liberating to the individual and not aligned with powerful governments, have also become windows that regimes can use to spy on their citizens.

If hardware eventually allows words to appear on screens simply because of a thought, and the appliances are still vulnerable to hacking or government pressure, does this mean minds can be read without consent? It is very likely that any technology sensitive enough to respond to our thoughts could be programmed by a regime to intercept our thoughts. Even if our hardware was not originally designed to intercept thoughts on behalf of the authorities, the hardware would already meet the requirements for any program written to intercept thoughts for policing and political repression.

The potential negative consequences of mind-reading technology are equivalent to those of “uploading”, the futuristic concept of transferring one’s mind to computers as popularized by Singularitarians, usually following the ideas of Ray Kurzweil. There is a real threat that a technological singularity, as depicted in Kurzweil’s The Singularity is Near, could strengthen a flawed social system by giving the authorities the intrusive ability to monitor what it sees as deviant or threatening thought.

Danger 2: Accidents

It may be that manual or verbal control, still depicted in science fiction as gifts that will be with us for many centuries and taken with humanity’s distant descendants to the stars, are just more practical than mind-reading. Even when limited to practical uses like controlling a vehicle or appliance, mind-reading may simply be destined to take away convenience rather than create convenience for the vast majority of its customers.

Even if driving a car by thought can be made safe, the use of aircraft or weapons systems via mind-reading would certainly be more problematic. When the stakes are high, most of us already agree that it is best not to entrust the responsibility to one person’s thoughts. By not using the body and voice when performing a task, and by not allowing others to intervene in your actions, the chances of an accident are probably always going to be raised. Although we like to think of our own brains as reliable and would probably be eager to try out mind-reading control over our vehicles, we do not think of others peoples’ brains that way, and would be troubled by the lack of any window for intervention in the other person’s actions.

Possible accidents when piloting a complex machine like a helicopter or manning a dangerous weapon may be averted by an experienced hand preventing someone from taking the wrong action. Considering this, old-fashioned manual controls may already be destined to be superior to any mind-reading controls and more attuned to the challenges faced by humans. We evolved to talk and physically handle challenges. Given this fact, removing all the remaining physical challenges of performing a task may only complicate your ability to perform effectively, or result in a higher tendency to err or take rash actions by subverting the ability of others to challenge you as you act.

Recommendation: we should avoid strengthening an undesirable social system

I hope that these objections to mind-reading may be proven invalid, with time. It is certainly likely that some people, such as those with physical disabilities, are going to rely on improvements in mind-reading technology to restore their lives. However, there has been, and continues to be, a very definite danger that a flawed social system and government are going to seek out technologies that can make them more and invulnerable, and this is one such technology. Any potential avenue of invulnerability of governments against their critics is unacceptable and should be challenged, just as the present excess in surveillance has been challenged.

It is important to keep reiterating that it is not the technology itself that is the source of a threat to humanity, but the myopic actions of the likely operators of that technology. Given the experience of government mass espionage, which began without the knowledge or consent of the public, concerns about other unannounced programs exploiting communication technology for “total information awareness” (TIA) are justified.

By Harry J. Bentham - More articles by Harry J. Bentham

Originally published on April 22 in Dissident Voice

Interested in this subject? Subscribe to receive free CLUBOF.INFO articles by Email

By Harry J. Bentham

Originally published at h+ Magazine

Who is more “luddite”: the individual or the state?

In a recent TED talk, an individual – the robot body of National Security Agency whistleblower Edward Snowden speaking in Vancouver – said he beat the state. He argued that, while the internet enabled states with unprecedented powers to spy, it has also provided individuals with the ability to singlehandedly “win” against the state by exposing such abuse to the public. Snowden’s statement highlights the way in which the internet, along with other emerging technologies that promise similar decentralization and power to the individual, could be called a double-edged sword.

The capacity of democratized technology to either free people or control them often seems balanced in such a way that new technologies can be validly heralded as liberators or as enslavers, depending on one’s own personal experience with them. However, in spite of this duality, the overwhelming direction does seem to go towards empowering the individual rather than the state. After all, as Snowden so succinctly put it, he did “win”. We know the era of powerful states and monolithic corporations dictating the capabilities of the individual is coming to an end, as what could be called a libertarian or DIY culture is taking hold instead. As Kevin Kelly has put it, technology possesses its own will, and a specific preference for greater freedom.

The fear that advanced technology plays only into the hands of elites to the disadvantage of most of the world is quite common among progressives, as has been described by the IEET’s James Hughes. In reality, the alarmists who signal dangers and negative political outcomes from emerging technologies are missing a big piece of the puzzle. This piece is already forcing itself on us increasingly in the headlines, showing that our era’s defining technologies actually have far more potential to empower and liberate the masses of people now than ever before in history.

Further, the liberation is much more likely to ensue if technologies can advance in a maximally unregulated and un-policed manner. A democratic explosion of liberating technology is possible in the lives of the voiceless and worst-off people in the world, and several emerging technologies could feature significantly in that explosion.

To understand this possibility, it is important to direct our attention to two different kinds of disparity in the world. The first is the inequality that makes the citizens of a country voiceless and powerless in the face of the power of a strong state and massive corporations. The second is the inequality between the weak states or regions and the strong states or regions of the world-economy.

Both of the two arenas suggested above appear to be related. Strong states and corporations benefit exclusively from the system, and find the justification for their power in a global division of labor that says a cherished few can produce things of more value than the other countries. This division of labor exploits the weaker peripheral majority of the world as unrewarded instruments in the global production process, while the high-tech sophisticated work that is maximally profitable remains in the rich minority spaces of strong states and firms. With the club of powerful states and firms essential to the functioning of the world-system, trends that weaken the traditional power of the nation-state or cause rewards to be more equitably distributed are direct threats to the survival of the current global mode of production.

Already, the state is threatened by its inability to control the world of information, which German Chancellor Angela Merkel was mocked for calling “neuland” or “virgin territory.” As idiosyncratic as her choice of words may have seemed, it reflects the attitude of many heads of state. Former French President Nicolas Sarkozy had already used almost exactly the same meaning when describing the internet. The ongoing digitization of politics may appear to be unrelated to the world-economy, but it is relevant, because it betrays the worsening ability of powerful states to stay in control of decisive technologies in the long term, as we shall see.

Many progressives and critics of modern society see advanced and emerging technologies as inherently benefiting only powerful and elitist goals. However, as James Hughes argues in Citizen Cyborg, much of this view is simply not rational and leans towards a primitivist stance on modern industrial developments. It also adheres to an old-fashioned way of thinking that was true in a time when all the decisive technologies were unwieldy and had to be rigidly controlled or sanctioned by governments and powerful monopolistic firms to even be operated with any efficacy.

In attempting to rein in technology now, states and corporations will increasingly find themselves having to appeal to emotional or outright fabricated security concerns to maintain their profits. As patents and other forms of protection are increasingly circumvented by the geeks, pirates, cyber-idealists, Assanges and Snowdens being created by the internet culture, the only defense for statist and corporate interests will be to call these troublesome individuals security threats. By saying a radical new technology could become a threat, e.g. it could be used by terrorists, it could be hacked, there could be an accident, etc. powerful regimes and firms give themselves a convenient mandate to keep their technologies in their own hands, behind their walls, and prevent them from getting out to empower the public or weaker regimes such as those in the Global South. Regimes in the Global South must be weak for the present world-economy to function, so painting an empowered Global South as a deadly and irresponsible threat is probably going to be increasingly necessary for the Global North to maintain its privileges. By appealing to this narrative, the dominant states and firms will become true “luddites”: they are going to smash (discredit) the technologies they don’t like, so they get to keep their job (dominating the profitable production processes).

Increased numbers of progressives do overwhelmingly recognize the powerful potential of the internet to empower the public and traditionally weaker sections of global society. In fact, the internet has made a huge impact on the history of protest and the history of dissent, making it indispensable to progressive causes and the alternate media endorsed by progressives. However, progressive support for other areas of the democratization of technology and freedom of world-liberating technologies from regulation and authoritarian policing is very thin (just consider their responses to GM technology).

Reservations held by progressives about emerging technologies are not very consistent with the view of the internet as a useful political instrument. Many lack the understanding that the internet is not a fluke in technology, but part of a larger trend. Progressives would do best to learn the trend set by the internet, and adopt an anarchic view of technology as something that is becoming overwhelmingly liberating and increasingly easy for the common people to conquer and use for themselves.

A number of emerging technologies have high democratic value, being set to liberate and empower people more rapidly than ever in history. From personal computers to 3D printers, nanotechnologyand perhaps the salient breakthroughs of synthetic biology, the one thing all the big advancements in emerging technologies today have in common is that they do not have any great need to be monopolized by governments and corporations. Possibly the most important observation of their democratic potential is that these devices all seem to have the potential to copy themselves. Synthetic organisms may be the first man-made products to have this ability, while other man-made things do not. They may not need to be supplied or replaced by any authority or special provider. In theory, such devices could be leaked once and become rapidly available everywhere, just as information can be rapidly pirated and circulated on the internet every day.

The global division of labor, and by extension the massive inequality in terms of rewards in the present world-system, would face an existential threat from the leaking of decisive emerging technologies. World inequality, if it is a product of a large division of labor, would not survive the leaking and decentralization of a generation of advanced self-replicating, redundant manufacturing technologies into the poorer parts of the world-economy.

The last line of defense available to states and massive corporations, to protect against their privileged economic and political positions being damaged by the circulation of self-sustaining technologies, would be for them to rant about security and try to whip up paranoia. If they do so, then the security concerns about emerging technologies will come to be seen by many as the discourse to create authoritarian controls over who can and who can’t have something. At that time, there would be no doubt that the true luddites interfering in the inevitable course of technology are the rich and powerful – not the poor and disenfranchised.

To sum up, there is a trend of techno-liberation set to break a number of emerging technologies free. Many remain the apparent trademarks of powerful companies at present, but still they carry powerful democratic potential even as they remain locked in the Pandora’s Box of security arguments and fears. People who care about subverting global inequality should not be deterred by such rhetoric.

They should covet emerging technologies, such as synthetic organisms, as a gift and a perfect means of liberation for the poorer parts of the world-economy. This should be pursued without hesitation, in the hope that yet more democratic opportunities like the internet will surface and become available to the world’s marginal and oppressed people.

Originally published at h+ Magazine

Ray Kurzweil’s well-received book, The Singularity is Near, is perhaps the best known book related to transhumanism and presents a view of inevitable technological evolution that closely resembles the claim in the later (2010) book What Technology Wants by Wired co-founder Kevin Kelly.

Kurzweil describes six epochs in the history of information. Each significant form of information is superseded by another in a series of stepping stones, exposing a universal will at work within technology towards extropy (this is seen by Kevin Kelly as intelligence and complexity attaining their maximum state possible). The first epoch is physics and chemistry, and is succeeded by biology, brains, technology, the merger of technology and human intelligence and finally the epoch in which the universe “wakes up”. The final epoch achieves what could be called godhood for the universe’s surviving intelligences (p. 15).

Artificial intelligence, which Kurzweil predicts to compete with and soon after overtake the human brain, will mean reverse-engineering the human brain as a direct offshoot of developing higher resolution when scanning the brain (much as genome synthesis was the offshoot of being able to sequence a complete genome) (p. 25–29, 111–198). This is a source of particular excitement to many, because of Kurzweil and Google’s genuine efforts to make it a reality.

An interest in abundance and a read of J. Craig Venter’s Life at the Speed of Light will make Chapter 5 of Kurzweil’s book of particular interest, as it discusses genetics and its relationship to the singularity. Genetics, nanotechnology and robotics are seen as overlapping revolutions that are set to characterize the first half of the Twenty-First Century (p.205). Kurzweil addresses the full understanding of genetics, e.g. knowing exactly how to program and hack our DNA as in J. Craig Venter’s synthetic biology revolution (p. 205–212).

Kurzweil predicts “radical life-extension” on top of the elimination of disease and expansion of human potential through the genetics advancements of teams like J. Craig Venter’s. J. Craig Venter covered life extension and human enhancement in his 2013 book, but also drew special attention to the ongoing engineering of beneficial microbes for purposes of making renewable resources and cleaning the environment. Another prospect for abundance noted by Kurzweil is the idea of cloning meat and other protein sources in a factory (this being an offshoot of medical cloning advances). Far from simply offering life extension to the privileged few, Kurzweil notes that such a development may have the potential to solve world hunger.

To cover the nanotechnology revolution, Kurzweil visits nanotechnology father K. Eric Drexler’s assessments of the pros and cons in this field. In some ways, Kurzweil could be faulted for expecting too much from nanotechnology, since his treatment of the subject contrasts sharply with Drexler’s characterization of it as simply being “atomically precise manufacturing” (APM) and primarily having industrial ramifications. In Radical Abundance, Drexler specifically discourages the view echoed by Kurzweil of “nanobots” swimming in our body in the near future and delivering miracle cures, seeing such expectations as the product of sci-fi stories and media hype.

On the subject of artificial intelligence, there can be no doubt that Kurzweil is ahead of all of us because of his personal background. In his estimate, artificial intelligence reverse-engineered from the human brain will immediately “exceed human intelligence” for a number of reasons even if we only design it to be on par with our intelligence. For example, computers are able to “pool their resources in ways that humans cannot” (p. 259–298). In addition, Kurzweil forecasts:

The advent of strong AI is the most important transformation this century will see. Indeed, it is comparable in importance to the advent of biology itself. It will mean the creation of biology that has finally mastered its own intelligence and discovered means to overcome its limitations. (p. 296)

From our viewpoint in 2014, some of Kurzweil’s predictions could be criticized for being too optimistic. For example, “computers arriving at the beginning of the next decade will become essentially invisible, woven into our clothing, embedded in our furniture and environment”, as well as providing unlimited Wi-Fi everywhere (p. 312). While no doubt some places and instruments exist that might fit this description, they are certainly not in widespread use at this time, nor is there any particular need among society for this to become widespread (except perhaps the Wi-Fi).

Another likely over-optimistic prediction is the view that “full-immersion virtual reality” will be ready for our use by the late 2020s and it will be “indistinguishable from reality” (p. 341). In Kurzweil’s prediction, by 2029 nanobots in our bodies will be able to hack our nervous systems and trick us into believing a false reality every bit as convincing as the life we knew. We are in 2014. There is no full-immersion virtual reality system based on nanotechnology set to be on the market in 2020. A few dedicated gamers have the Oculus Rift (of which there will no doubt be a constant stream of successors ever reducing weight, trying to look “sexier”, and expanding the resolution and frame-rate over at least one decade), while there is no sign whatsoever of the nanotechnology-based neural interface technology predicted by Kurzweil. If nanotech-based full-immersion virtual reality is going to be possible in the 2020s at all, there ought to at least be some rudimentary prototype already in development, but (unless it is a secret military project) time is running out for the prediction to come true.

Part of the book addresses the exciting possibilities of advanced, futuristic warfare. The idea of soldiers who operate robotic platforms, aided by swarms of drones and focused on disrupting the enemy ability to communicate is truly compelling – all the more so because of the unique inside view that Kurzweil had of DARPA. Kurzweil sees a form of warfare in which commanders engage one another in virtual and physical battlefields from opposite sides of the globe, experiencing conflicts in which cyber-attack and communication disruption are every bit as crippling to armies as physical destruction (p. 330–335). Then again, this trend (like the idea of building missile-defense shields) may ultimately lead to complacency and false assumptions that our security is “complete”, while that foreign suppliers like Russia and China are also modernizing and have many systems that are thought to be on par with the US. A lot of US military success may be down to picking on vulnerable countries, rather than perfecting a safe and clean form of warfare (most of Saddam’s deadliest weapons were destroyed or used up in the First Gulf War, which alone could account for the US having so few casualties in the 2003 war.)

Although saying that the singularity will eliminate the distinction between work and play by making information so easily accessible in our lives, Kurzweil predicts that information will gain more value, making intellectual property more important to protect (p. 339–340). This sentiment is hard to agree with at a time when piracy and (illegally) streaming video without paying is already increasingly a fact of everyone’s life. If all thought and play is going to qualify as a creative act as a result of our eventual integration with machines, it only becomes ever harder to believe that such creative acts are going to need monetary incentives.

The book discusses at length how to balance the risks and benefits of emerging technologies. Of particular resilience is Kurzweil’s view that relinquishing or restraining developments can itself expose us to existential risks (e.g. asteroids). I myself would take this argument further. Failing to create abundance when one has the ability to do so is negligent, and even more morally questionable than triggering a nanotech or biotech disaster that must be overcome in the course of helping people.

Kurzweil goes through what seems like an exhaustive list of criticisms, arming singularitarians with an effective defense of their position. Of interest to me, as a result of penning a response to it myself, was how Kurzweil rebuts the “Criticism from the Rich-Poor Divide” by arguing that poverty is overwhelmingly being reduced and benefits of digital technology for the poor are undeniable. Indeed, among the world’s poor, there is no doubt that digital technology is good and that it empowers people. Anyone who argues this revolution is bad for the poor are just plainly ignoring the opinions of the actual poor people they claim to be defending. There has been no credible connection between digital technology and the supply of disproportionate benefits to wealthy elites. If anything, digital technology has made the world more equal and can even be regarded as part of a global liberation struggle.

Unfortunately, there is a major argument absent from the book. Kurzweil’s book precedes the revelations of mass surveillance by NSA whistleblower Edward Snowden. As a result, it fails to answer the most important criticism of an imminent singularity I can think of. I would have to call this the “Argument from Civil and Political Rights”. It takes into account the fact that greedy and cruel nation-states (the US being the most dangerous) tend to seek the monopoly of power in the current world order, including technological power. By bridging the gap between ourselves and computers before we create a more benevolent political and social order with less hegemony and less cruelty, we will simply be turning every fiber of our existence over to state agencies and giving up our liberty.

Suppose PRISM or some program like it exists, and my mind can be read by it. In that case, my uploaded existence would be no different from a Gitmo detainee. In fact, just interfacing with such a system for a moment would be equivalent to being sent to Gitmo, if the US government and its agencies exist. It does not matter how benevolent the operators even are. The fact that I am vulnerable to the operators means I am being subjected to a constant and ongoing violation of my civil rights. I could be subjected to any form of cruelty or oppression, and the perpetrator would never be stopped or held accountable.

It gets worse. With reality and virtual reality becoming indistinguishable (as predicted in this book), a new sort of sadist may even emerge that does not know the difference between the two or does not care. History has shown that such sadists are most likely to be the ones who have had more experience with and thus have obtained more power over the system. It is this political or social concern that should be deterring people from uploading themselves right now. If we were uploaded, what followed could never evolve beyond being a constant reflection of the flawed social order at the time when the upload occurred. Do we want to immortalize an abusive and cruel superpower, corporate lobbyists, secret police, or a prison? Are these things actually worth saving for all eternity and disseminating across the universe when we reach the singularity?

Despite the questions I have tried to raise in this review, I am still convinced by the broad idea of the singularity, and Kurzweil articulates it well. The idea, as promoted by Max More and quoted by Kurzweil (p. 373) that our view of our role in the universe should be like Nietzche’s “rope over an abyss” trying to reach for a greater existence, with technology playing a key role, helps encourage us to take noble risks. However, I believe the noble risks are not risks taken out of desperation to extend our lives and escape death, or risks taken to make ourselves look nice or something else petty. Noble risks are taken to ensure our future or the future of humanity, often at the expense of the present.

I would discourage people from trying to hasten the singularity because of a personal fear of their own death, as this would probably lead to irrational behavior (as occurs with the traditions that promote transcending death by supernatural means). Complications from society and unforeseen abuses, especially by our deeply paranoid and controlling states that are far too primitive to react responsibly to the singularity, are likely to slow everything down.

###

Editors note: concerns about virtual imprisonment or torture are not entirely unfounded, see for example this older article as well as this recent development.