Here’s one way to evolve an artificial intelligence

This picture illustrates an idea for how to evolve an AI system. It is derived from the sensor-brain-actuator-world model.

Machine learning algorithms have been doing some impressive things. Simply by crawling through massive oceans of data and finding correlations, some AI systems are able to make unexpected predictions and reveal insights.

Neural nets and evolutionary algorithms constitute a natural pairing of technologies for designing AI systems. But evolutionary algorithms require selection criteria that can be difficult to design. One solution is to use millions of human observers as a Darwinian fitness force to guide an AI towards an optimal state.

Clarifications

Since there is so much discussion (and confusion) on AI these days I want make some clarifications.

  • This has nothing to do with consciousness or self. This AI is disembodied.
  • The raw data input is (not) curated. It has no added interpretation.
  • Any kind of data can be input. The AI will ignore most of it at first.
  • The AI presents its innards to humans. I am calling these “simulations”.
  • The AI algorithm uses some unspecified form of machine learning.
  • The important innovation here is the ability to generate “simulations”.

Mothering

The humanist in me says we need to act as the collective Mother for our brain children by providing continual reinforcement for good behavior and discouraging bad behavior. As a world view emerges in the AI, and as an implicit code of morals comes into focus, the AI will “mature”. Widely-expressed fears of AI run amok could be partially alleviated by imposing a Mothering filter on the AI as it comes of age.

Can Anything Evolve without Selection?

I suppose it is possible for an AI to arrive at every possible good idea, insight, and judgement just by digesting the constant data spew from humanity. But without an implicit learning process (such as back-propagation and other feedback mechanisms used in training AI), the AI cannot truly learn in an ecosystem of continual feedback.

Abstract Simulations 

Abstraction in Modernist painting is about generalizing the visual world into forms and colors that substitute detail for overall impressions. Art historians have charted the transition form realism to abstraction – a kind of freeing-up and opening-up of vision.

Imagine now a new path leading from abstraction to realism. And it doesn’t just apply to images: it also applies to audible signals, texts, movements, and patterns of behavior.

Imagine an AI that is set up like the illustration above coming alive for the first time. The inner-life of newborn infant is chaotic, formless, and devoid of meaning, with the exception of reactions to a mother’s smile, her scent, and her breasts.

A newborn AI would produce meaningless simulations. As the first few humans log in to give feedback, they will encounter mostly formless blobs. But eventually, some patterns may emerge – with just enough variation for the human judges to start making selective choices: “this blob is more interesting than that blob”.

As the young but continual stream of raw data accumulates, the AI will start to build impressions and common themes, like what Deep Dream does as it collects images and finds common themes and starts riffing on those themes.

http://theghostdiaries.com/10-most-nightmarish-images-from-googles-deepdream/

The important thing about this process is that it can self-correct if it starts to veer in an unproductive direction – initially with the guidance of humans and eventually on its own. It also maintains a memory of bad decisions, and failed experiments – which are all a part of growing up.

Takeaway

If this idea is interesting to you, just Google “evolving AI” and you will find many many links on the subject.

As far as my modest proposal: the takeaway I’d like to leave you with is this:

Every brain on earth builds inner-simulations of the world and plays parts of those simulations constantly as a matter of course. The simple animals have extremely simple models of reality. We humans have insanely complex models – which often get us into trouble. Trial simulations generated by an evolving AI would start pretty dumb, but with more sensory exposure, and human guidance, who knows what would emerge!

It would be irresponsible to launch AI programs without mothering. The evolved brains of most complex mammals naturally expect this. Our AI brain children are naturally derived from a mammalian brain. Mothering will allow us to evolve AI systems that don’t turn into evil monsters.

Advertisements

Having sex with robots to save the planet

Long long ago, there was an accident in a warm puddle. A particular molecule – through some chance interaction with the soup of surrounding molecules – ended up with a copy of itself. Since the surrounding soup was similar to the original, the copy was more likely to replicate itself. And so it did. The rest is history. We call it evolution.

It is possible that similar accidents happened elsewhere around the same time – not just in one single puddle. One could also say that variations of this accident are still happening – only now at a massive scale.

Every act of every living thing can be seen as an elaboration of this original act. Self-replication is the original impetus of all life. We share a common ancestor with amoebas – who replicate asexually. The invention of sexual reproduction boosted genetic creativity. More recently in the scope of Earth’s history, creativity escaped the confines of genetics. We humans are the primary hosts of this creative engine.

Human beings have contrived all of the resulting aspects of survival to an art-form. This includes – not just the act of sex – but also the act of preparing food (cuisine), the act of making sounds and speaking (music and singing), and the act of altering the environment to create new structure (visual art). The abstractions and representations of the world that the brain generates via the body are derivations and deviations from the original acts of survival. It’s a form of self-replication.

The emergence of abstractions, mental models, and representations is increasing in complexity. This is an inevitable one-way blossoming accelerated by the emergence of the animal brain. The human experience is conflicted; we are oriented toward achieving escape velocity from Original Nature, but we also long for Original Nature. How can we resolve this conflict?

The original act of self-replication has powerful repercussions – billions of years after the original accident – it has taken on many forms. It is the reason we humans have strange phenomena like orgasm. And selfies.

Warming

We are at a crossroads in the history of life on Earth. The current era of global warming is almost certainly the result of the overpopulation and hyperactivity of humans, who have released – and continue to release – too much carbon into the atmosphere. One effective solution to global warming would be to reduce the primary agents of the fever…to reduce human population.

And so, converting that original act of replication into works of art is not just creative and exciting: it may be necessary. Humans must transcend the Earthly act of self-replication in order to preserve the health of the planet.

The future of sex will be…let’s just say…interesting. Every cell in our body contains the blueprint of a desire to replicate. Nature and society are structured around the elaborate machinery that has emerged to ensure self-replication – of human bodies and culture. This desire has made its mark on every aspect of society – even if we don’t recognize it as such. We cannot escape it. And so we need to virtualize it, because self-replication of human beings (physically) has become a threat to the planet that sustains us. It’s our duty to Mother Earth.

I am a living organism and so I have to contend with this crazy desire to replicate. Note: I am childless. I have never replicated my genes and have no intention to do so at this stage in my life. But I am passionate about replicating ideas, art, words, and software.

Now, what about the title of this blog post? Will people eventually start having sex with robots? It will certainly be more subtle than that. In fact, it has been said that by the time we get to that point, WE will be the robots.

Is this the kind of future I want? Strangely, yes. Because I will have long returned to the Earth – my molecules will have been handed down through generations of living things. I will be a part of Earth’s physiology. My tribe will be bigger than humanity.

One of my molecules may even end up in a warm puddle somewhere.

Thoughts on the Evolution of Communication

My dog and I engage in a lot of signaling. But it is not always deliberate, and it is not always conscious, and it is not always a two-way process.

In the morning, Otto licks my bald head. He can probably smell what I have been dreaming. I hold him and we have a nice cuddle. Just one of our many routines. He looks at me and I look at him. He is always checking me out. In the process of getting to know each other over several years we have come to read each other’s signals – our body language, interactions, responses, vocalizations…and smells.

image from http://projectdolittle.com/

Semiosis emerges in the process. If there is a coupling of signals – a mutually-reinforcing signaling loop – two-way communication emerges. It is not always conscious – for either of us. Sometimes, a mutually-reinforcing signaling process which I was previously unaware of becomes apparent to me. When this happens, I become an active agent in that semiosis.

Otto is so intensely attentive to me – my routines (and deviations from them). He probably tunes-in to many more of my signals than I do to his. But then again, I am a human: I generate a lot of signal. Does he see this as “communication?” It is not clear: his brain is a dog brain, and mine is a human brain. We don’t share the same word for this experience (he only knows a few English words, and “communication” isn’t one of them).

I can be sure of one thing: we share a lot of signaling. And, as members of two highly-social species, we both like that.

I would conclude from this that communication among organisms in general (the biosemiosis that has emerged on Earth over the last few billion years) came about pretty much the same way that Otto and I established our own little world of emergent semiosis. As life evolved, trillions of coupled signaling channels reinforced each other over time and became more elaborate. Eventually, this signaling became conscious and intentional.

And so here we are: human communication has reached a level of sophistication such that I can type these words – and you can read them. And we can share the experience – across time and space.

Science writers who say machines have feelings…lack intelligence.

I saw an article by Peter Dockrill with the headline, “Artificial intelligence should be protected by human rights, says Oxford mathematician”.

The subtitle is: “Machines Have Feelings Too”.

Regarding the potential dangers of robots and computers, Peter asks: “But do robots need protection from us too?” Peter is apparently a “science and humor writer”. I think he should stick with just one genre.

Just more click-bait.

There are too many articles on the internet with headlines like this. They are usually covered with obnoxious, eye-jabbing ads, flitting in front of my face like giant colorful moths. It’s a carnival – through and through.

I could easily include any number of articles about the “terrifying” future of AI, “emotional machines”, “robot ethics”, and other cartoon-like dilutions of otherwise thoughtful well-crafted science fiction.

Good science fiction is better than bad science journalism.

Screen Shot 2016-07-09 at 10.30.04 PM

Here’s Ben Goldacre:

Screen Shot 2016-06-24 at 9.30.15 PM

Now, back to this silly subject of machines having feelings:

Some of my previous articles express my thoughts on the future of AI, such as:

No Rafi. The Brain is not a Computer

The Singularity is Just One in a Series

Why Nick Bostrom is Wrong About the Dangers of Artificial Intelligence

Intelligence is NOT One-Dimensional

homunculusbI think we should be working to fix our own emotional mess, instead of trying to make vague, naive predictions about machines having feelings. Machines will – eventually – have something analogous to animal motivation and human states of mind, but by then the human world will look so different that the current conversation will be laughable.

Right now, I am in favor of keeping the “feelings” on the human side of the equation.

We’re still too emotionally messed up to be worrying about how to tend to our machines’ feelings. Let’s fix our own feelings first before giving them to our machines. We still have that choice.

And now, more stupidity from Meghan Neal:

“Computers are already faster than us, more efficient, and can do our jobs better.”

Wow Meghan, you sure do like computers, don’t you?

I personally have more hope, respect, and optimism for our species.

In this article, Meghan makes sweeping statements about machines with feelings, including how “feeling” computers are being used to improve education.

The “feeling” robots she is referring to are machines with a gimmick – they are brain-dead automatons with faces attached to them. Many savvy futurists suggest that true AI will not result from humans trying to make machines act like humans.  That’s anthropomorphism. Programming pre-defined body language in an unthinking robot makes for interesting and insightful experimentation in human-machine interaction. But please! Don’t tell me that these machines have “feelings”.

Screen Shot 2016-07-09 at 3.44.18 PMThis article says: “When Nao is sad, he hunches his shoulders forward and looks down. When he’s happy, he raises his arms, angling for a hug. When frightened, Nao cowers, and he stays like that until he is soothed with some gentle strokes on his head.”

 

Pardon me while I projectile vomit.

Any time you are trying to compare human intelligence with computers, consider what Marvin once said:

Screen Shot 2016-06-24 at 10.38.04 PM

The Information EVOLUTION

I remember several decades ago learning that we were at the beginning of an information revolution. The idea, as I understood it, was that many things are moving towards a digital economy; even wars will become information-based.

The information revolution takes over where the industrial revolution left off.

I am seeing an even bigger picture emerging – it is consistent with the evolution of the universe and Earth’s biosphere.

Screen Shot 2016-06-16 at 10.20.47 AM

At the moment, I can hear a bird of prey (I think it’s a falcon) that comes around this neighborhood every year about this time and makes its call from the tree tops. When I think about the amount of effort that birds make to produce mating calls, and other kinds of communication, I am reminded of how much importance information plays in the biological world. The variety and vigor of bird song is amazing. From an evolutionary point of view, one has to assume that there is great selective pressure to create such energy in organized sound.

money+gorilla+teeth+omg+weird+primatesThis is just a speck of dust in comparison to the evolution of communication in our own species, for whom information is a major driver in our activities. Our faces have evolved to give and receive a very high bandwidth of information between each other (Compare the faces of primates to those of less complex animals and notice the degree to which the face is optimized for giving and receiving information).

Our brains have grown to massive proportions (relatively-speaking) to account for the role that information plays in the way our species survives on the planet.

Now: onto the future of information…

Beaming New Parts to the Space Station

Screen Shot 2016-06-16 at 10.29.58 AM

Guess which is more expensive:

  1. Sending a rocket to the space station with a new part to repair an old one.
  2. Beaming up the instructions to build the part on an on-board 3D printer.

You guessed it.

And this is where some people see society going in general. 3D printing will revolutionize society in a big way. Less moving atoms, More moving bits.

To what degree will the manipulation of bits become more important than the manipulation of atoms?

Not Just a Revolution: Evolution

My sense is that the information revolution is not merely one in a series of human eras: it is the overall trend of life on Earth. We humans are the agents of the latest push in this overall trend.

Some futurists predict that nanotechnology will make it possible to infuse information processing into materials, giving rise to programmable matter. Ray Kurzweil predicts that the deep nano-mingling of matter and information will be the basis for a super-intelligence that can spread throughout the universe.

Okay, whatever.

For now, let’s ride this information wave and try to use the weightlessness of bits to make life better for all people (and all life-forms) on Earth – not just a powerful few.

The Singularity is Just One in a Series

I’m reading Kurzweil’s The Singularity is Near.

It occurs to me that the transition that the human race is about to experience is similar to other major transitions that are often described as epochs – paradigm-shifts – in which a new structure emerges over a previous structure. There are six key epochs that Kurzweil describes. (The first four are not unlike epochal stages described by Terrance Deacon and others.)

  1. Physics and Chemistry
  2. Biology and DNA
  3. Brains
  4. Technology
  5. Human Intelligence Merges with Human Technology
  6. Cosmic Intelligence

When a new epoch comes into being, the agents of that new epoch don’t necessarily eradicate, overcome, usurp, reduce, or impede the agents of the previous epoch. Every epoch stands on the shoulders of the last epoch.This is one reason not to fear the Singularity…as if it is going to destroy us or render us un-human. In fact, epoch number 5 may allow us to become more human (a characterization that we could only truly make after the fact – not from our current vantage point).

I like to think of “human” as a verb: as a shift from animal to post-human, because it characterizes our nature of always striving for something more.

animal to posthuman

There are debates raging on whether the Singularity is good or bad for humanity. One way to avoid endless debate is to do the existential act: to make an attempt at determining the fate of humanity, rather than sit passively and make predictions.  As Alan Kay famously said, “the best way to predict the future is to invent it”. We should try to guide the direction of the next epoch as much as we can while we are still the ones in charge.

In a previous article I wrote that criticizes some predictions by Nick Bostrom, I compare our upcoming epochal shift to a shift that happened in the past, when multi-cellular beings evolved. Consider:

Maybe Our AI Will Evolve to Protect Us And the Planet

tree-of-lifeBillions of years ago, single cells decided to come together in order to make bodies, so they could do more using teamwork. Some of these cells were probably worried about the bodies “taking over”. And oh did they! But, these bodies also did their little cells a favor: they kept them alive and provided them with nutrition. Win-win baby!

I am not a full-fledged Singularitarian. I prefer to stay agnostic as long as I can. Its not just a human story. Our Singularity is just the one that is happening to us at the moment.

Similarly, the emergence of previous epochs may have been experienced as Singularities to those that came before.

When Earth Discovered Water

When Earth discovered water, life became possible.

header-earth-from-space

“Discover”? I was going to use the word “invent”. Then I remembered that water can be found on other planets, comets, asteroids…and the Moon. Water is not unique to Earth. It may be more accurate to say that Earth invented a way to preserve and manage its water by evolving the biosphere. The biosphere harnesses, protects, filters, and enlivens the water that covers most of the planet.

Mars did not succeed in preserving its water.

The Gaia Hypothesis blows open the perspective of what life is. The evolution of the self-adaptive, self-regulating spherical ecosystem that we call Earth is more than just a collection of interacting organisms. It also relies on the dynamics of storms, oceans, tectonic plates, and the balance of gases in the atmosphere.

8

I began thinking about this as I was pouring boiling water into a coffee press. A beautiful stream, sparkling and transparent, visible only by virtue of the fact that it reflects the darks and lights of the surrounding environment.

What an amazing fluid. A true friend of gravity and heat, forming a collaboration resulting in a network of clouds, rain, snow, glaciers, streams, rivers and oceans.

There’s a deep reason why we can generate so much poetry about water.

“Planetary scientists are quick to stress that it’s not just water that’s indispensable for life, but liquid water. The distinction is key”

Water made life on Earth possible. Some people go as far as to say that water is alive.

Screen Shot 2016-05-16 at 12.32.00 PM

On the Origins of Earth’s Water

http://www.iflscience.com/physics/origin-earths-water-discovered-0

Did life on Earth begin with replicating molecules? Depends on how you define life. The backdrop for these replicating molecules was already rich and dynamic, with an interplay of water (in all its forms), gravity, atmospheric and ocean chemistry, electric storms…

…and the rhythms of day and night, winter and summer, which forms a backbeat. That backbeat drives the polyrhythmic dance that pulls water through its many forms – and brings us into being.

early-earth-moon-system-closeup