Skip to main content

Google Builds An AI That Can Learn And Master Video Games


Google has built an artificial intelligence system that can learn – and become amazing at – video games all on its own, given no commands but a simple instruction to play titles. The project, detailed by Bloomberg, is the result of research from the London-based DeepMind AI startup Google acquired in a deal last year, and involves 49 games from the Atari 2600 that likely provided the first video game experience for many of those reading this.

While this is an amazing announcement for so many reasons, the most impressive part might be that the AI not only matched wits with human players in most cases, but actually went above and beyond the best scores of expert meat-based players in 29 of the 49 games it learned, and bested existing computer based players in a whopping 43.

Google and DeepMind aren’t looking to just put their initials atop the best score screens of arcades everywhere with this project – the long-term goal is to create the building blocks for optimal problem solving given a set of criteria, which is obviously useful in any place Google might hope to use AI in the future, including in self-driving cars. Google is calling this the “first time anyone has built a single learning system that can learn directly from experience,” according to Bloomberg, which has potential in a virtually limitless number of applications.

It’s still an early step, however, and Google expects it’ll be decades before it achieves its goal of building general-purpose machines that have their own intelligence and can respond to a range of situations. Still, it’s a system that doesn’t require the kind of arduous training and hand-holding to learn what it’s supposed to do, which is a big leap even from things like IBM’s Watson super computer.

Next up for the arcade AI is mastering the Doom-era 3D virtual worlds, which should help the AI edge closer to mastering similar tasks in the real world, like driving a car. And there’s one more detail here that may keep you up at night: Google trained the AI to get better at the Atari games it mastered using a virtual take on operant conditioning – ‘rewarding’ the computer for successful behavior the way you might a dog

Comments

Popular posts from this blog

How To Hide Text In Microsoft Word 2007, Reveal It & Protect It

Sometimes what we hide is more important than what we reveal. Especially, documents with sensitive information, some things are supposed to be ‘for some eyes only’. Such scenarios are quite common, even for the more un-secretive among us. You want to show someone a letter composed in MS Word, but want to keep some of the content private; or it’s an official letter with some part of it having critical data. As important as these two are, the most common use could involve a normal printing job. Many a time we have to print different versions of a document, one copy for one set of eyes and others for other sets. Rather than creating multiple copies and therefore multiple printing jobs, what if we could just do it from the same document?  That too, without the hassle of repeated cut and paste. We can, with a simple feature in MS Word – it’s just called Hidden and let me show you how to use it to hide text in Microsoft Word 2007. It’s a simple single click process. Open the document

Clip & Convert Your Video Faster With Quicktime X & The New Handbrake 64-bit [Mac]

Recently a friend of mine asked for my help to find a video of a good presentation to be shown to one of his classes. He also requested for it to be iPod friendly as he would also distribute the video to his students. Three things came to my mind: Steve Jobs, Quicktime and Handbrake . Mr. Jobs is well known for his great presentations which are often used as references. I have several Apple Keynotes videos. For my friend, I decided to choose the one that introduced MacBook Air – the one that never fails to deliver the wow effect to the non-techie audience. It’s a part of January 2008 Macworld Keynote. First step: The Cutting To get only a specific part of the Keynote, I clipped the 1+ hour video into about 20 minutes using Quicktime X (which comes with Snow Leopard). I opened the movie using Quicktime X and chose Trim from the Edit menu ( Command + T ). Then I chose the start and end of my clip by moving both edges of the trimming bar to the desired position. To increase th

Ex-Skypers Launch Virtual Whiteboard Deekit

Although seriously long in the tooth and being disrupted by a plethora of startups, for many years Skype has existed as an almost ubiquitous app in any remote team’s toolkit. So it seems apt that a new startup founded by a team of ex-Skype employees is set to tackle another aspect of online collaboration. Deekit, which exits private beta today, is a virtual and collaborative whiteboard to help remote teams work smarter. The Tallinn, Estonia-based startup is headed up by founder and CEO, Kaili Kleemeier, who was previously a Head of Operations at Skype. She and three colleagues quit the Internet calling giant in 2012 and spent a year researching ideas in the remote team space. They ended up focusing on creating a new virtual whiteboard, born out of Kleemeier’s experience collaborating with technical teams remotely, specifically helping Skype deal with incident management. “Working with remote teams has been a challenge in many ways – cultural differences, language differences, a