If Roadrunner is a bit beyond your budget, simulating neural networks with GPUs might be an option:
The next generation of Nvidia GPUs will support enhancements such as double precision floating point in order to make them more suitable for general purpose highly parallel computation. There will also be cards with no graphics interface and greater maximum RAM designed specifically for low cost supercomputing applications.