Andrej Karpathy

Andrej Karpathy

628,606 Twitter followers

Follow

YouTuber, Blogger, Influencer :D. Previously Director of AI at Tesla, OpenAI, CS231n, PhD @ Stanford. I like to train large deep neural nets 🧠🤖💥

Posts

Andrej Karpathy

- Drafted a blog post - Used an LLM to meticulously improve the argument over 4 hours. - Wow, feeling great, it’s so convincing! - Fun idea let’s ask it to argue the opposite. - LLM demolishes the entire argument and convinces me that the opposite is in fact true. - lol The LLMs may elicit an opinion when asked but are extremely competent in arguing almost any direction. This is actually super useful as a tool for forming your own opinions, just make sure to ask different directions and be careful with the sycophancy.

Andrej Karpathy

One common issue with personalization in all LLMs is how distracting memory seems to be for the models. A single question from 2 months ago about some topic can keep coming up as some kind of a deep interest of mine with undue mentions in perpetuity. Some kind of trying too hard.

Andrej Karpathy

Thank you Sarah, my pleasure to come on the pod! And happy to do some more Q&A in the replies.

Caught up with @karpathy for a new @NoPriorsPod: on the phase shift in engineering, AI psychosis, claws, AutoResearch, the opportunity for a SETI-at-Home like movement in AI, the model landscape, and second order effects 02:55 - What Capability Limits Remain? 06:15 - What

Andrej Karpathy

Expectation: the age of the IDE is over Reality: we’re going to need a bigger IDE (imo). It just looks very different because humans now move upwards and program at a higher level - the basic unit of interest is not one file but one agent. It’s still programming.

Andrej Karpathy

tmux grids are awesome, but i feel a need to have a proper "agent command center" IDE for teams of them, which I could maximize per monitor. E.g. I want to see/hide toggle them, see if any are idle, pop open related tools (e.g. terminal), stats (usage), etc.

Andrej Karpathy

Neural architecture search as it existed then is such a weak version of this that it's in its own category of totally useless by comparison. This is an *actual* LLM writing arbitrary code, learning from previous experiments, with access to the internet. It's not even close.

Andrej Karpathy

oh yeah i should have linked autoresearch probably github.com/karpathy/autoresear...… (you don't "use it" directly, it's just a recipe/idea - give it to your agent and apply to what you care about.) and the tweet about it that went mini-viral over the weekend with more context x.com/karpathy/status/20303712...…

Andrej Karpathy

Codex is a know issue :( It basically don't work with autoresearch sadly, in the way it's set up atm: github.com/karpathy/autoresear...… I pung a friend at OpenAI to see if something can be done, e.g. need a /loop equivalent or something like that. More generally, I really dislike the -p + ralph loop pattern of running agents "headless". I want nice, interactive sessions running in tmux so that I can see what they are doing, pitch in, etc.

Loading..