Comments on: If the singularity happens… please send me an email

By: Robin Brandt

Robin Brandt — Wed, 11 Apr 2007 22:02:47 +0000

DonÂ´t you dear! Please join forces with SIAI, Eliezer, Ben and the others! AGI is serious business and I think we really need all critical brain mass to work together now, donÂ´t let human social factors come in between!

By: mathemajician

mathemajician — Sat, 13 Jan 2007 05:13:51 +0000

Currently it looks like I’ll be doing a post doc in Switzerland using artificial intelligence to study financial models. That’s a half time job. With the rest of my time I’ll be doing some commercial applied machine learning work. Part of the reason for deciding on this mix was that I wanted to stay in Switzerland because I had a Swiss girlfriend. However we’ve now broken up so…

I didn’t think it would be easy going from academic AI to industry after 35 years of age. And acadmic AI does bug me a bit. Everything has to be so “serious” all the time. You can’t just cut loose and try something radical without risking your job. You spend half your time trying to convince people that what you’re wanting to do is not radical and yet still new.

Perhaps in the end the only way will be for me to try to start my own AGI company…?

By: Ben Goertzel

Ben Goertzel — Wed, 03 Jan 2007 15:49:50 +0000

On the “academia versus industry” theme — I note that the computer science academic job market is fairly robust, even if not in the particular domain of “formal AGI theory” that is the province of your thesis research. And, you are a diverse guy with interests and expertise beyond your thesis area. So, one option would be for you to get a postdoc, then spend this time period getting a few publications in other, more practical areas of computer science, as well as doing further research in formal AGI theory. This would position you well to get academic CS positions. For instance bioinformatics is quite “hot” these days in academia and is not a terribly difficult area to break into if you are an interdisciplinary thinker.

Another comment is that it is relatively easy to move from academia into industry at any stage, if you have any practical CS skills at all (which I know you do). OTOH it is not very easy to move from industry back into academia, unless during your period in industry you have bothered to keep churning out publications.

If you want to keep working on AGI I would say it makes sense for you to play the academic game a bit, generate a more diverse publication record, and get an academic CS job — or else go for some oddball job (no insult intended!!) like the SingInst one.

OTOH, if you want to turn your math and CS expertise into a pile of money, and are willing to work very hard in a not-so-entertaining environment for a significant number of years in order to achieve this, quantitative finance is definitely a realistic option…

– Ben G

By: Brian Atkins

Brian Atkins — Fri, 17 Nov 2006 19:05:39 +0000

Good point Mitchell. We are indeed looking for another mathy person to do some hard mental crunching on all this. Actually if our current fundraising attempts succeed we will be looking for several people. This includes attempts to “break things” and to develop proofs showing how things will fail.

I think Eliezer’s current thinking on the issue is “let the FAI figure it out”. Give it a goal to figure out what humanity really would want, especially after it grows up further, and implement that. What it decides it wants to implement may very well allow for further changes in the future as cultures change, or it could provide a system where cultures can live under complete different rules. Who knows at this point.

By: mathemajician

mathemajician — Fri, 17 Nov 2006 11:30:04 +0000

The thing is, I’m rather skeptical about all this.

My biggest problem, as I commented in my “FAI is bunk” post, is that I just can’t get my head around what “friendly” means post singularity. What I suspect is that our concept of “friendly” is actually part of our primate brain and our culture. If we were from a different culture our sense of ethics would be different. If we were from a different species it could be very very different. Thus ethics might be as meaningful on a universal scale as, say, the concept of “good food”. Worms are nice to eat if you’re a bird, not if you’re a human. Similarly, it’s ok to eat your children if you come from certain species of lizard, but not if you’re a human. However, if ethics aren’t universal, exactly what are we trying to achieve? Are we trying to project human ethics into a future full of profoundly inhuman entities? Even our most fundamental ethical concepts like death and pain may be meaningless to them.

By: mitchell porter

mitchell porter — Thu, 09 Nov 2006 03:57:19 +0000

There’s a job going over at Eliezer’s Singularity Institute, you know. The work is as conceptually intense as you could possibly hope for, but it would require enormous commitment – “give me Singularity or give me death”. I guess you have seven months to think it over.