Yann LeCun: "If you are interested in human-level ai, don't work on LLMs"
Abandon generative models in favor joint-embedding architectures Abandon probabilistic model in favor of energy-based models Abandon contrastive methods in favor of regularized methods Abandon Reinforcement Learning In favor of model-predictive control Use RL only when planning doesn't yield the predicted outcome, to adjust the world model or the critic. IF YOU ARE INTERESTED IN HUMAN-LEVEL AI, DON'T WORK ON LLMs
— Lior Alexander · original post ↗