{"id":411,"date":"2023-08-03T05:41:17","date_gmt":"2023-08-03T05:41:17","guid":{"rendered":"https:\/\/sapiens.it.com\/?p=411"},"modified":"2023-08-03T05:41:18","modified_gmt":"2023-08-03T05:41:18","slug":"on-gpt-4-self-improvement","status":"publish","type":"post","link":"https:\/\/sapiens.it.com\/?p=411","title":{"rendered":"On GPT-4 self-improvement"},"content":{"rendered":"\n<p><\/p>\n\n\n\n<p><a href=\"https:\/\/www.linkedin.com\/posts\/jacquesludik_gpt-4-can-improve-itself-ft-reflexion-activity-7050426192234971136-GoQy?utm_source=share&amp;utm_medium=member_desktop\">https:\/\/www.linkedin.com\/posts\/jacquesludik_gpt-4-can-improve-itself-ft-reflexion-activity-7050426192234971136-GoQy<\/a><\/p>\n\n\n\n<p>On GPT-4 self-improvement, as also mentioned by&nbsp;<a href=\"https:\/\/www.linkedin.com\/in\/ACoAAANHUM4Ba-7gLW9R4il3U9t3O_2BkbkSDvU\">Andrej Karpathy<\/a>, we are not seeing max GPT-4 capability yet. Through &#8220;prompt design, tool use, meta cognition strategies (e.g., idea of attempt, critique, retry, capabilities model, etc.) this technology is very likely to go a long way&#8221;.<\/p>\n\n\n\n<p>See also &#8220;AI Explained&#8221; video&nbsp;<a href=\"https:\/\/lnkd.in\/dFgxNqr3\">https:\/\/lnkd.in\/dFgxNqr3<\/a>&nbsp;and the following recent papers as background.<\/p>\n\n\n\n<p>\u2705 Reflexion: an autonomous agent with dynamic memory and self-reflection (20 Mar 2023)<br><a href=\"https:\/\/lnkd.in\/dHS76uYs\">https:\/\/lnkd.in\/dHS76uYs<\/a><br><a href=\"https:\/\/lnkd.in\/dJiPHstp\">https:\/\/lnkd.in\/dJiPHstp<\/a><\/p>\n\n\n\n<p>\u2705 HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face (2 Apr 2023)<br><a href=\"https:\/\/lnkd.in\/dwb7KUJD\">https:\/\/lnkd.in\/dwb7KUJD<\/a><\/p>\n\n\n\n<p>\u2705 DERA: Enhancing Large Language Model Completions with Dialog-Enabled Resolving Agents (30 Mar 2023)<br><a href=\"https:\/\/lnkd.in\/devvDs_2\">https:\/\/lnkd.in\/devvDs_2<\/a><\/p>\n\n\n\n<p>\u2705 Language Models can Solve Computer Tasks (30 Mar 2023)<br><a href=\"https:\/\/lnkd.in\/dDED_ikv\">https:\/\/lnkd.in\/dDED_ikv<\/a><\/p>\n\n\n\n<p>\u2705 Language Models can Solve Computer Tasks (30 Mar 2023)<br><a href=\"https:\/\/lnkd.in\/dDED_ikv\">https:\/\/lnkd.in\/dDED_ikv<\/a><\/p>\n\n\n\n<p>\u2705&nbsp;<a href=\"http:\/\/taskmatrix.ai\/\">TaskMatrix.AI<\/a>: Completing Tasks by Connecting Foundation Models with Millions of APIs (29 Mar 2023)<br><a href=\"https:\/\/lnkd.in\/dJc_Wndw\">https:\/\/lnkd.in\/dJc_Wndw<\/a><\/p>\n\n\n\n<p>\u2705 Sparks of Artificial General Intelligence: Early experiments with GPT-4 (27 Mar 2023)<br><a href=\"https:\/\/lnkd.in\/dZTrY2ay\">https:\/\/lnkd.in\/dZTrY2ay<\/a><\/p>\n\n\n\n<p>\u2705 GPT-4 Technical Report (27 Mar 2023)<br><a href=\"https:\/\/lnkd.in\/dmSEHesx\">https:\/\/lnkd.in\/dmSEHesx<\/a><\/p>\n\n\n\n<p>\u2705 Alpaca: A Strong, Replicable Instruction-Following Model (13 Mar 2023)<br><a href=\"https:\/\/lnkd.in\/dC66CjwM\">https:\/\/lnkd.in\/dC66CjwM<\/a><\/p>\n\n\n\n<p>\u2705 LARGE LANGUAGE MODELS CAN SELF-IMPROVE (25 Oct 2022)<br><a href=\"https:\/\/lnkd.in\/dNVbQCGC\">https:\/\/lnkd.in\/dNVbQCGC<\/a><\/p>\n\n\n\n<p>\u2705 ALFWORLD: ALIGNING TEXT AND EMBODIED ENVIRONMENTS FOR INTERACTIVE LEARNING (14 Mar 2021)<br><a href=\"https:\/\/lnkd.in\/dp6SjPuj\">https:\/\/lnkd.in\/dp6SjPuj<\/a><\/p>\n\n\n\n<p><a href=\"https:\/\/www.linkedin.com\/company\/nvidia\/\">NVIDIA<\/a>&nbsp;shows new research on using AI to improve chip designs<br><a href=\"https:\/\/lnkd.in\/dN2ZFRA5\">https:\/\/lnkd.in\/dN2ZFRA5<\/a><\/p>\n\n\n\n<p><a href=\"https:\/\/www.linkedin.com\/company\/google\/\">Google<\/a>&nbsp;C.E.O. Sundar Pichai on the A.I. Moment: \u2018You Will See Us Be Bold\u2019<br><a href=\"https:\/\/lnkd.in\/dgWBd56m\">https:\/\/lnkd.in\/dgWBd56m<\/a><\/p>\n\n\n\n<p>\ud83c\udf0d The Power of Generative AI: Exploring its Impact, Applications, Limitations, and Future<br><a href=\"https:\/\/lnkd.in\/dp2e6c5P\">https:\/\/lnkd.in\/dp2e6c5P<\/a><br><a href=\"https:\/\/lnkd.in\/dMRdCJv4\">https:\/\/lnkd.in\/dMRdCJv4<\/a><\/p>\n\n\n\n<p>\ud83c\udf0d \u201cDemocratizing Artificial Intelligence to Benefit Everyone: Shaping a Better Future in the Smart Technology Era\u201d&nbsp;<a href=\"http:\/\/jacquesludik.com\/\">jacquesludik.com<\/a><\/p>\n\n\n\n<p><a href=\"https:\/\/www.linkedin.com\/company\/openai\/\">OpenAI<\/a>,&nbsp;<a href=\"https:\/\/www.linkedin.com\/company\/swisscognitive\/\">SwissCognitive, World-Leading AI Network<\/a>,&nbsp;<a href=\"https:\/\/www.linkedin.com\/company\/miiafrica\/\">Machine Intelligence Institute of Africa | MIIA<\/a>,&nbsp;<a href=\"https:\/\/www.linkedin.com\/company\/cortexlogic\/\">Cortex Logic<\/a>,&nbsp;<a href=\"https:\/\/www.linkedin.com\/company\/cortexgroup\/\">Cortex Group<\/a>,&nbsp;<a href=\"https:\/\/www.linkedin.com\/company\/dsnai\/\">DSNai &#8211; Data Science Nigeria<\/a>,&nbsp;<a href=\"https:\/\/www.linkedin.com\/company\/ai-centre-of-excellence\/\">AICE Africa<\/a>,&nbsp;<a href=\"https:\/\/www.linkedin.com\/company\/google\/\">Google<\/a>,&nbsp;<a href=\"https:\/\/www.linkedin.com\/company\/meta\/\">Meta<\/a>,&nbsp;<a href=\"https:\/\/www.linkedin.com\/company\/metaai\/\">Meta AI<\/a>,&nbsp;<a href=\"https:\/\/www.linkedin.com\/company\/deepmind\/\">DeepMind<\/a>,&nbsp;<a href=\"https:\/\/www.linkedin.com\/company\/stanfordhai\/\">Stanford Institute for Human-Centered Artificial Intelligence (HAI)<\/a>,&nbsp;<a href=\"https:\/\/www.linkedin.com\/company\/oecd-ai\/\">OECD.AI<\/a>,&nbsp;<a href=\"https:\/\/www.linkedin.com\/company\/world-economic-forum\/\">World Economic Forum<\/a>,&nbsp;<a href=\"https:\/\/www.linkedin.com\/company\/helloverses\/\">VERSES<\/a>,&nbsp;<a href=\"https:\/\/www.linkedin.com\/company\/university-of-washington\/\">University of Washington<\/a>,&nbsp;<a href=\"https:\/\/www.linkedin.com\/company\/microsoft\/\">Microsoft<\/a>,&nbsp;<a href=\"https:\/\/www.linkedin.com\/company\/carnegie-mellon-university\/\">Carnegie Mellon University<\/a>,&nbsp;<a href=\"https:\/\/www.linkedin.com\/company\/microsoftresearch\/\">Microsoft Research<\/a>,&nbsp;<a href=\"https:\/\/www.linkedin.com\/company\/curai\/\">Curai Health<\/a>,&nbsp;<a href=\"https:\/\/www.linkedin.com\/company\/university-of-california-irvine\/\">UC Irvine<\/a>,&nbsp;<a href=\"https:\/\/www.linkedin.com\/company\/zhejiang-university\/\">Zhejiang University<\/a>,&nbsp;<a href=\"https:\/\/www.linkedin.com\/company\/university-of-illinois-urbana-champaign\/\">University of Illinois Urbana-Champaign<\/a><\/p>\n\n\n\n<p><a href=\"https:\/\/www.linkedin.com\/feed\/hashtag\/?keywords=artificialintelligence&amp;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A7050426192234971136\">#artificialintelligence<\/a><a href=\"https:\/\/www.linkedin.com\/feed\/hashtag\/?keywords=technology&amp;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A7050426192234971136\">#technology<\/a><a href=\"https:\/\/www.linkedin.com\/feed\/hashtag\/?keywords=datascience&amp;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A7050426192234971136\">#datascience<\/a><a href=\"https:\/\/www.linkedin.com\/feed\/hashtag\/?keywords=africa&amp;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A7050426192234971136\">#africa<\/a><a href=\"https:\/\/www.linkedin.com\/feed\/hashtag\/?keywords=network&amp;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A7050426192234971136\">#network<\/a><br><a href=\"https:\/\/www.linkedin.com\/feed\/hashtag\/?keywords=ai&amp;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A7050426192234971136\">#ai<\/a><a href=\"https:\/\/www.linkedin.com\/feed\/hashtag\/?keywords=design&amp;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A7050426192234971136\">#design<\/a><a href=\"https:\/\/www.linkedin.com\/feed\/hashtag\/?keywords=research&amp;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A7050426192234971136\">#research<\/a><a href=\"https:\/\/www.linkedin.com\/feed\/hashtag\/?keywords=learning&amp;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A7050426192234971136\">#learning<\/a><a href=\"https:\/\/www.linkedin.com\/feed\/hashtag\/?keywords=google&amp;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A7050426192234971136\">#google<\/a><a href=\"https:\/\/www.linkedin.com\/feed\/hashtag\/?keywords=intelligence&amp;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A7050426192234971136\">#intelligence<\/a><a href=\"https:\/\/www.linkedin.com\/feed\/hashtag\/?keywords=language&amp;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A7050426192234971136\">#language<\/a><a href=\"https:\/\/www.linkedin.com\/feed\/hashtag\/?keywords=video&amp;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A7050426192234971136\">#video<\/a><a href=\"https:\/\/www.linkedin.com\/feed\/hashtag\/?keywords=cognition&amp;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A7050426192234971136\">#cognition<\/a><a href=\"https:\/\/www.linkedin.com\/feed\/hashtag\/?keywords=cognition&amp;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A7050426192234971136\">#cognition<\/a><a href=\"https:\/\/www.linkedin.com\/feed\/hashtag\/?keywords=microsoft&amp;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A7050426192234971136\">#microsoft<\/a><a href=\"https:\/\/www.linkedin.com\/feed\/hashtag\/?keywords=university&amp;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A7050426192234971136\">#university<\/a><a href=\"https:\/\/www.linkedin.com\/feed\/hashtag\/?keywords=health&amp;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A7050426192234971136\">#health<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>https:\/\/www.linkedin.com\/posts\/jacquesludik_gpt-4-can-improve-itself-ft-reflexion-activity-7050426192234971136-GoQy On GPT-4 self-improvement, as also mentioned by&nbsp;Andrej Karpathy, we are not seeing max GPT-4 capability yet. Through &#8220;prompt design, tool use, meta cognition strategies (e.g.,<span class=\"excerpt-hellip\"> [\u2026]<\/span><\/p>\n","protected":false},"author":1,"featured_media":412,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3,4,5],"tags":[],"class_list":["post-411","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-artificial-intelligence","category-democratizing-ai","category-sapiens-network"],"_links":{"self":[{"href":"https:\/\/sapiens.it.com\/index.php?rest_route=\/wp\/v2\/posts\/411","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sapiens.it.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sapiens.it.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sapiens.it.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/sapiens.it.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=411"}],"version-history":[{"count":1,"href":"https:\/\/sapiens.it.com\/index.php?rest_route=\/wp\/v2\/posts\/411\/revisions"}],"predecessor-version":[{"id":413,"href":"https:\/\/sapiens.it.com\/index.php?rest_route=\/wp\/v2\/posts\/411\/revisions\/413"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/sapiens.it.com\/index.php?rest_route=\/wp\/v2\/media\/412"}],"wp:attachment":[{"href":"https:\/\/sapiens.it.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=411"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sapiens.it.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=411"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sapiens.it.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=411"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}