Predictive Models

Link to sign up Getting here: Enter the lobby at 100 University Ave (right next to St Andrew subway station), and message Giles Edkins on the meetup app or call him on 647-823-4865 to be let up to room 6H. Rubi Hudson will introduce us to Predictive Models, how they might help address existential risks from AI, as well as some of the dangers and caveats of this approach. Today’s (pretrained) large language models can be thought of as systems that predict text. With systems such as GPT-4o we are already seeing this augmented with predictive capabilities for other modalities such as audio and video. And in theory it can be extended to predict anything that can be measured. ...

September 20, 2024 · 1 min · 204 words · Trajectory Labs Team

Predictive Models

Link to sign up Getting here: Enter the lobby at 100 University Ave (right next to St Andrew subway station), and message Giles Edkins on the meetup app or call him on 647-823-4865 to be let up to room 6H. Neural networks - and transformers in particular - exhibit an irritating phenomenon. When trying to interpret each individual neuron, it is often polysemantic: activating in two or more seemingly unrelated contexts. ...

September 20, 2024 · 1 min · 130 words · Trajectory Labs Team