{"id":602,"date":"2024-03-08T10:33:48","date_gmt":"2024-03-08T10:33:48","guid":{"rendered":"https:\/\/sapiens.it.com\/?p=602"},"modified":"2024-03-08T10:33:49","modified_gmt":"2024-03-08T10:33:49","slug":"ai-at-meta-open-source-limits-of-llms-agi-and-the-future-of-ai","status":"publish","type":"post","link":"https:\/\/sapiens.it.com\/?p=602","title":{"rendered":"AI at Meta, Open Source, Limits of LLMs, AGI and the Future of AI"},"content":{"rendered":"\n

https:\/\/www.linkedin.com\/posts\/jacquesludik_yann-lecun-meta-ai-open-source-limits-activity-7171810012837752833-DfsE<\/a>

Excellent conversation between Lex Fridman and Yann LeCun about AI at Meta, Open Source, Limits of LLMs, AGI and the Future of AI.<\/p>\n\n\n\n

Good background for some of the technical discussion on Yann’s proposals and work can be found in some of his papers such as “A Path Towards Autonomous Machine Intelligence” https:\/\/openreview.net\/pdf?id=BZ5a1r-kVsf<\/a><\/p>\n\n\n\n

See also my article on \u201cIntelligent Agents, AGI, Active inference and the Free Energy Principle\u201d and questions about reasoning, understanding, goals, planning, agency etc. to make real progress in AI. https:\/\/lnkd.in\/d4WebpXs<\/a> and https:\/\/lnkd.in\/gE_5m9vC.<\/p>\n\n\n\n

See also other articles in the “Democratizing AI” Newsletter https:\/\/www.linkedin.com\/newsletters\/democratizing-ai-6906521507938258944\/<\/a><\/p>\n\n\n\n

Some of the key topics addressed in Lex’s latest discussion with Yann:<\/p>\n\n\n\n

\ud83c\udfbe Importance of open source AI in countering concentration of power and shaping a positive future for humanity.<\/p>\n\n\n\n

See also my book on “Democratizing Artificial Intelligence to Benefit Everyone: Shaping a Better Future in the Smart Technology Era” jacquesludik.com that shares similar sentiments.<\/p>\n\n\n\n

\ud83c\udfbe The process of language generation involves auto regressive prediction, distinct from pre-planning speech regardless of language.<\/p>\n\n\n\n

\ud83c\udfbe Training joint embedding predictive architecture (JEPA) requires contrastive learning to avoid collapse and produce meaningful representations.<\/p>\n\n\n\n

\ud83c\udfbe Innovative AI techniques: I-JEPA and V-JEPA for image and video masking, improving video representation prediction.<\/p>\n\n\n\n

\ud83c\udfbe Self-supervised learning in AR LLMs.<\/p>\n\n\n\n

\ud83c\udfbe Uncovering the depth of human communication beyond language through implicit cues and humor.<\/p>\n\n\n\n

\ud83c\udfbe Development of a new AI system for complex problem-solving using internal world models.<\/p>\n\n\n\n

\ud83c\udfbe Recommendations to shift from generative models to joint embedding architectures for improved image representation.<\/p>\n\n\n\n

\ud83c\udfbe Utilizing open source platforms to enhance AI systems for diverse applications and industries.<\/p>\n\n\n\n

\ud83c\udfbe Ethical considerations in AI development, including defining hate speech and dangerous content, and the limitations of large language models.<\/p>\n\n\n\n

\ud83c\udfbe Intelligence is multidimensional, making it impossible to compare entities based on skills. AI doomers’ catastrophic scenarios are based on false assumptions.<\/p>\n\n\n\n

\ud83c\udfbe Fear of new technology’s societal impact is rooted in human psychology and resistance to change.<\/p>\n\n\n\n

\ud83c\udfbe Challenges in training world models, planning in non-physical systems, and scaling up innovative work in AI learning world models, reasoning, understanding, goals, planning, agency, etc., that are all key to making real progress in AI.<\/p>\n\n\n\n

\n