Category Archives: Research Review

AGI 2010

The third Conference on Artificial General Intelligence will be taking place in Lugano, Switzerland from Friday the 5th to Monday the 8th of March (the picture on the front page of my website is of Lugano). The keynote speaker is … Continue reading

Posted in Research Review | Tagged | Leave a comment

1973 Lighthill debate

Some of you might know about the Lighthill report from 1973 which was deeply critical of progress in AI. This report was the main factor behind cutting the funding of AI research in the UK, and seems to have contributed … Continue reading

Posted in Research Review | Tagged , , | 11 Comments

Halloween lecture online

My Halloween lecture has been uploaded to youtube. The basic outline is: * what is intelligence? * Solomonoff induction * Hutter’s AIXI * Monte Carlo AIXI (here’s the missing video of it playing pac-man) * universal intelligence measure * what … Continue reading

Posted in Research Review | Tagged , , , , , | 4 Comments

Monte Carlo AIXI

While I was visiting Marcus Hutter at ANU a month or so ago, I got talking to one of his students, Joel Veness, who’s working on making computable approximations to AIXI. Joel has a background in writing Go algorithms so … Continue reading

Posted in Research Review | Tagged , , | 12 Comments

Reinforcement learning in the brain

Model-free reinforcement learning (RL) algorithms are computationally cheap as each state-action pair keeps a cached estimate of its value that can easily be looked up in order to make a decision. Their weakness is that they are not easy to … Continue reading

Posted in Research Review | Tagged , | 3 Comments

The unreasonable effectiveness of data

We recently had a visitor to the Gatsby Unit talk about his work in reinforcement learning, in particular the use of planning and forward models to speed up the learning of difficult tasks.  The substance of his talk was good, … Continue reading

Posted in Research Review | Tagged , , | 5 Comments

What’s up with go?

The Computational Intelligence of MoGo Revealed in Taiwan’s Computer Go Tournaments C.S. Lee, M.H. Wang, G. Chaslot, J.B. Hoock et. al., IEEE Trans. Comp. Intelligence and AI in games, 2009 Go, the Asian board game, has long been considered to … Continue reading

Posted in Research Review | Tagged , | 3 Comments