Google is ringing in 2014 with a spending spree, first dropping $3.2 billion to acquire Nest Technologies and now spending a reported $400 million (or more) on the UK-based artificial intelligence outfit DeepMind.
It’s no secret that Google has an interest in artificial intelligence; after all, technologies derived from AI research help fuel Google’s core search and advertising businesses. AI also plays a key role in Google’s mobile services, its autonomous cars, and its growing stable of robotics technologies. And with the addition of futurist Ray Kurzweil to its ranks in 2012, Google also has the grandfather of “strong AI” on board, a man who forecasts that intelligent machines may exist by midcentury.
If all this sounds troubling, don’t worry: Google’s acquisition of DeepMind isn’t about fusing a mechanical brain with faster-than-human robots and giving birth to the misanthropic Skynet computer network from the Terminator franchise. But it does raise key questions: What exactly is artificial intelligence, and what does Google hope to accomplish by buying companies like DeepMind?
In general terms, AI refers to machines doing intellectual tasks at a level comparable to humans. That means reasoning, planning, learning, and using language to communicate at a high level. It also probably includes sensing and interacting with the physical world, although those might not be a requirement, depending on who you ask.
AI research is almost as old as computers, going back to the 1950s. Early efforts (sometimes called symbolic or “top-down” AI) were basically collections of rules. The idea was that with enough explicit rules (like IF person(bieber) IS arrested(drunk driving) THEN respond(LOL!)), systems could make decisions and act autonomously – it was just a question of writing enough rules and waiting for computing hardware powerful enough to handle it all. Top-down AI works well when a defined “knowledge base” can be constructed. For instance, in the 1970s, Stanford’s “Mycin” expert system diagnosed blood-borne infections better than many human internists, and in the 1980s the University of Pittsburgh’s “Caduceus” extended the idea to over 1,000 different diseases. In other words, AI in real life isn’t new.
But top-down AI can’t cope with stuff outside its rules-and-knowledge sets. Dealing with the unknown – like an autonomous car navigating the constantly changing conditions on the street – requires an inconceivably large number of rules. So researchers developed behavioral or “bottom-up” AI. Instead of writing thousands (or millions or billions) of rules, researchers built systems with simple behaviors (like “move left” or “read the next word”) and showed those systems which actions worked in different contexts – typically by “rewarding” them with points. Some bottom-up AI technologies are based on real-world neuroscience; for instance, neural networks simulate synaptic connections akin to a biological brain. As they’re trained, bottom-up systems develop behaviors – learn – to cope with unforeseen circumstances in ways top-down AI never managed. Real-world technologies developed in part from bottom-up AI include things like the Roomba vacuum, Siri’s speech recognition, and Facebook’s face recognition. Again, AI in the real world.
Google’s acquisition of DeepMind is partly about “deep learning,” or ways of teaching bottom-up AI systems about complex concepts. Teaching bottom-up systems means throwing data at them and rewarding correct interpretation or behavior – this is called “supervised” training, because the data is already labelled with the correct answers. Of course, most data in the real world (pictures, video feeds, sounds, etc.) is not labelled – or not labelled well. Very basically, deep learning pre-trains bottom-up AI systems on unlabeled (or semi-labelled) data, leaving the systems free to draw their own conclusions. The pre-trained systems then get feedback on their performance from systems that received supervised training – and they catch on very fast, thanks to their previous experience. Layer these systems on top of each other, and you get programs that can quickly cope with unknown and unlabeled data – just the kind of thing Google deals with by the thousands of gigabytes, twenty-four hours a day, seven days a week. Artificial intelligence researchers with connections to DeepMind have indicated the company’s research has recently produced significant advances in this type of machine learning.
“In my opinion, reinforcement learning and deep learning are not enough to give us ‘thinking machines.’”
What does Google see in DeepMind’s deep learning technology and (perhaps) applications that’s worth hundreds of millions of dollars? Nobody is saying – and both Google and DeepMind representatives declined to comment. But Google has many operations that could benefit:
Google will have to walk a fine line: Any of these applications could exponentially increase Google “creep factor” as leverage our personal data. Curiously, Google’s acquisition of DeepMind reportedly includes oversight by an internal ethics board.
So what the effort to create an artificial intelligence on par with human intellect? Sadly for fans of robot overlords, the DeepMind acquisition is at best peripheral to that effort, and probably unrelated.
“I’m glad to hear the news about Google’s acquisition of DeepMind, since it will attract more attention to this field,” noted Pei Wang, an artificial general intelligence researcher at Temple University. “However, in my opinion, reinforcement learning and deep learning are not enough to give us ‘thinking machines.'”
Google is still a long way from achieving the processing scale of a human brain, let alone understanding how it works.
More significantly, a “node” in a neural network – even one trained by deep learning – doesn’t correspond to a biological neuron. We still only have general ideas of how neurons work. If we want to build human-level intelligence by emulating biological processes, that means modeling physical and chemical details of neurons – and that’ll take even more computing power. Efforts have been made: In 2005, a 27-processor cluster took 50 days to simulate one second of the activity of 100 billion neurons; since then, the biggest brain simulation effort has probably been IBM’s 24,576-node effort to simulate a cat brain – although it did not model individual neurons.
In other words, Google is still a long way from achieving the processing scale of a human brain, let alone understanding how it works. Even with DeepMind.
Related Posts
OnePlus 15T leak spills details on a curious camera situation
According to the Chinese tipster Digital Chat Station (via Weibo), a "small-screen phone powered by the Snapdragon 8E5 is ready," translated from simplified Chinese. This phone, believed to be the OnePlus 15T, could feature a dual-camera setup "with a 50MP main sensor and a 50MP telephoto lens."
WhatsApp has begun testing a long-overdue group chat feature
The Meta-owned messaging platform is testing a new feature called "group chat history sharing" (via a WABetaInfo report). As the name suggests, the feature lets a WhatsApp user (likely the admin) share the chat history (up to 100 messages sent within 14 days) with someone while adding them to a group.
Google Photos introduces a fun new way to turn yourself into a meme
According to a recent post on Google's support forums, Me Meme is a generative AI feature that lets you star in trending memes using a template and a photo of yourself. It's rolling out in Google Photos for Android in the US, and you can try it out by tapping the "Create" button and selecting the new "Me meme" option.