The third Conference on Artificial General Intelligence will be taking place in Lugano, Switzerland from Friday the 5th to Monday the 8th of March (the picture on the front page of my website is of Lugano). The keynote speaker is the famous reinforcement learning researcher Rich Sutton, and it seems that the inventor of [...]
Some of you might know about the Lighthill report from 1973 which was deeply critical of progress in AI. This report was the main factor behind cutting the funding of AI research in the UK, and seems to have contributed to the more global cuts around this time known as the “AI winter”. [...]
My Halloween lecture has been uploaded to youtube. The basic outline is:
* what is intelligence?
* Solomonoff induction
* Hutter’s AIXI
* Monte Carlo AIXI (here’s the missing video of it playing pac-man)
* universal intelligence measure
* what neuroscience can teach us about AGI design
* early 2020’s: the Halloween scenario
You can get the slides here. I [...]
While I was visiting Marcus Hutter at ANU a month or so ago, I got talking to one of his students, Joel Veness, who’s working on making computable approximations to AIXI. Joel has a background in writing Go algorithms so is perhaps perfect for the job. I saw recently that the Monte Carlo [...]
Model-free reinforcement learning (RL) algorithms are computationally cheap as each state-action pair keeps a cached estimate of its value that can easily be looked up in order to make a decision. Their weakness is that they are not easy to update when the agent’s goals, or the state of the world, changes in some [...]
We recently had a visitor to the Gatsby Unit talk about his work in reinforcement learning, in particular the use of planning and forward models to speed up the learning of difficult tasks. The substance of his talk was good, but that’s not what I want to talk about: it was the motivation he gave [...]
“The Computational Intelligence of MoGo Revealed in Taiwan’s Computer Go Tournaments” C.S. Lee, M.H. Wang, G. Chaslot, J.B. Hoock et. al., IEEE Trans. Comp. Intelligence and AI in games, 2009
Go, the Asian board game, has long been considered to be a profound challenge for artificial intelligence. John McCarthy described it as the “new drosophila of [...]