{"id":31193,"date":"2024-08-06T22:29:13","date_gmt":"2024-08-06T22:29:13","guid":{"rendered":"https:\/\/www.africa-press.net\/benin\/politique\/pourquoi-lia-generative-devient-elle-efficace-dun-coup"},"modified":"2024-08-06T22:36:17","modified_gmt":"2024-08-06T22:36:17","slug":"pourquoi-lia-generative-devient-elle-efficace-dun-coup","status":"publish","type":"post","link":"https:\/\/www.africa-press.net\/benin\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup","title":{"rendered":"Pourquoi l&rsquo;IA g\u00e9n\u00e9rative devient-elle efficace d&rsquo;un coup ?"},"content":{"rendered":"<p><span style=\"color: #ff6600\"><strong>Africa-Press &#8211; Benin. <\/strong><\/span>Les inge\u0301nieurs d&rsquo;OpenAI ont appele\u0301 ce phe\u0301nome\u0300ne le grokking dans un article publie\u0301 de\u0301but 2022. Lorsque l&rsquo;on entrai\u0302ne sur des donne\u0301es un transformeur, le type d&rsquo;algorithme qui sert de base aux grands mode\u0300les d&rsquo;intelligence artificielle ge\u0301ne\u0301rative tel GPT d&rsquo;OpenAI, la premie\u0300re pe\u0301riode d&rsquo;entrai\u0302nement (ou epoch) ne donne pas de re\u0301sultats formidables. Si on prolonge l&rsquo;entrai\u0302nement sur une me\u0302me dure\u0301e, avec les me\u0302mes donne\u0301es, sans rien changer a\u0300 l&rsquo;algorithme, me\u0302me chose. Et ainsi de suite pendant des dizaines de milliers de se\u0301ances de dure\u0301es strictement identiques quand soudain, la qualite\u0301 des re\u0301sultats monte en fle\u0300che, d&rsquo;un coup !<\/p>\n<p>Or, ni les chercheurs d&rsquo;OpenAI, qui ont de\u0301couvert ce grokking par hasard, ni personne d&rsquo;autre ne savent pourquoi il se produit. Le terme vient du ce\u0301le\u0300bre roman de science-fiction \u00ab\u00a0En terre e\u0301trange\u0300re\u00a0\u00bb (1961), de Robert Heinlein, et renvoie au fait de comprendre intuitivement. Manie\u0300re de sugge\u0301rer que la machine serait doue\u0301e de compre\u0301hension faute d&rsquo;explication plus scientifique !<\/p>\n<p><b>Explorer diffe\u0301rentes me\u0301thodes pour en savoir plus<\/b><\/p>\n<p>Directeur de recherche et pre\u0301sident du comite\u0301 d&rsquo;e\u0301thique du nume\u0301rique du CEA, a\u0300 Saclay, Alexei Grinbaum n&rsquo;he\u0301site en tout cas pas a\u0300 parler d&rsquo;un \u00ab\u00a0phe\u0301nome\u0300ne myste\u0301rieux\u00a0\u00bb. \u00ab\u00a0C&rsquo;est un domaine fascinant sur lequel il y a encore assez peu de recherches. La science commence tout juste a\u0300 aborder cette question, et la premie\u0300re approche serait d&rsquo;utiliser ce que l&rsquo;on appelle les phe\u0301nome\u0300nes critiques en physique statistique, quand il y a des transitions de phase. \u00a0\u00bb<\/p>\n<p>C&rsquo;est-a\u0300-dire quand, par exemple, l&rsquo;e\u0301tat de la matie\u0300re change physiquement en fonction d&rsquo;une variable. \u00ab\u00a0Pour les syste\u0300mes physiques, comme les gaz, les liquides, nous avons des variables comme la pression, la tempe\u0301rature, le volume. Mais pour les grands mode\u0300les de langage, nous ne savons pas quelles sont les variables pertinentes permettant de de\u0301crire cette transition. C&rsquo;est complique\u0301 de construire un mode\u0300le dans ces conditions. \u00a0\u00bb<\/p>\n<p>Parmi les diffe\u0301rentes me\u0301thodes pour essayer d&rsquo;en savoir plus, le de\u0301veloppement de \u00ab\u00a0mode\u0300le-jouet\u00a0\u00bb est le plus prometteur, selon le chercheur. Il s&rsquo;agit tout simplement de petits algorithmes de type transformeur, avec peu de couches, permettant d&rsquo;observer plus facilement comment s&rsquo;ope\u0300rent les calculs. \u00ab\u00a0Sans doute qu&rsquo;il se passe des choses dans les tre\u0300s grands transformeurs qu&rsquo;on ne voit pas du tout dans les petits, pre\u0301vient Alexei Grinbaum. Mais cela peut nous donner quelques ide\u0301es. \u00a0\u00bb<\/p>\n<p><strong>Pour plus d&rsquo;informations et d&rsquo;analyses sur la <span style=\"color: #ff6600\">Benin<\/span>, suivez <span style=\"color: #ff6600\">Africa-Press<\/span><\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Africa-Press &#8211; Benin. Les inge\u0301nieurs d&rsquo;OpenAI ont appele\u0301 ce phe\u0301nome\u0300ne le grokking dans un article publie\u0301 de\u0301but 2022. Lorsque l&rsquo;on entrai\u0302ne sur des donne\u0301es un transformeur, le type d&rsquo;algorithme qui sert de base aux grands mode\u0300les d&rsquo;intelligence artificielle ge\u0301ne\u0301rative tel GPT d&rsquo;OpenAI, la premie\u0300re pe\u0301riode d&rsquo;entrai\u0302nement (ou epoch) ne donne pas de re\u0301sultats formidables. Si [&hellip;]<\/p>\n","protected":false},"author":82,"featured_media":31192,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[22,10],"tags":[45],"class_list":["post-31193","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-divers","category-toutes-les-actualites","tag-benin"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v26.1 (Yoast SEO v27.0) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>Pourquoi l&#039;IA g\u00e9n\u00e9rative devient-elle efficace d&#039;un coup ? - B\u00e9nin<\/title>\n<meta name=\"description\" content=\"Les inge\u0301nieurs d&#039;OpenAI ont appele\u0301 ce phe\u0301nome\u0300ne le grokking dans un article publie\u0301 de\u0301but 2022. Lorsque l&#039;on entrai ...\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.africa-press.net\/benin\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup\" \/>\n<meta property=\"og:locale\" content=\"fr_FR\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Pourquoi l&#039;IA g\u00e9n\u00e9rative devient-elle efficace d&#039;un coup ?\" \/>\n<meta property=\"og:description\" content=\"Les inge\u0301nieurs d&#039;OpenAI ont appele\u0301 ce phe\u0301nome\u0300ne le grokking dans un article publie\u0301 de\u0301but 2022. Lorsque l&#039;on entrai ...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.africa-press.net\/benin\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup\" \/>\n<meta property=\"og:site_name\" content=\"B\u00e9nin\" \/>\n<meta property=\"article:published_time\" content=\"2024-08-06T22:29:13+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-08-06T22:36:17+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/static.africa-press.net\/benin\/sites\/46\/2024\/08\/sm_1722971018.810314.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"900\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"cfeditorfr\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u00c9crit par\" \/>\n\t<meta name=\"twitter:data1\" content=\"cfeditorfr\" \/>\n\t<meta name=\"twitter:label2\" content=\"Dur\u00e9e de lecture estim\u00e9e\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.africa-press.net\/benin\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.africa-press.net\/benin\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup\"},\"author\":{\"name\":\"cfeditorfr\",\"@id\":\"https:\/\/www.africa-press.net\/benin\/#\/schema\/person\/2b1cf3cd81a31e3cd26889ca66d677f1\"},\"headline\":\"Pourquoi l&rsquo;IA g\u00e9n\u00e9rative devient-elle efficace d&rsquo;un coup ?\",\"datePublished\":\"2024-08-06T22:29:13+00:00\",\"dateModified\":\"2024-08-06T22:36:17+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.africa-press.net\/benin\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup\"},\"wordCount\":482,\"commentCount\":0,\"image\":{\"@id\":\"https:\/\/www.africa-press.net\/benin\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup#primaryimage\"},\"thumbnailUrl\":\"https:\/\/static.africa-press.net\/benin\/sites\/46\/2024\/08\/sm_1722971018.810314.jpg\",\"keywords\":[\"B\u00e9nin\"],\"articleSection\":[\"Divers\",\"Toutes les actualit\u00e9s\"],\"inLanguage\":\"fr-FR\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.africa-press.net\/benin\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.africa-press.net\/benin\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup\",\"url\":\"https:\/\/www.africa-press.net\/benin\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup\",\"name\":\"Pourquoi l'IA g\u00e9n\u00e9rative devient-elle efficace d'un coup ? - B\u00e9nin\",\"isPartOf\":{\"@id\":\"https:\/\/www.africa-press.net\/benin\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.africa-press.net\/benin\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.africa-press.net\/benin\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup#primaryimage\"},\"thumbnailUrl\":\"https:\/\/static.africa-press.net\/benin\/sites\/46\/2024\/08\/sm_1722971018.810314.jpg\",\"datePublished\":\"2024-08-06T22:29:13+00:00\",\"dateModified\":\"2024-08-06T22:36:17+00:00\",\"author\":{\"@id\":\"https:\/\/www.africa-press.net\/benin\/#\/schema\/person\/2b1cf3cd81a31e3cd26889ca66d677f1\"},\"description\":\"Les inge\u0301nieurs d'OpenAI ont appele\u0301 ce phe\u0301nome\u0300ne le grokking dans un article publie\u0301 de\u0301but 2022. Lorsque l'on entrai ...\",\"breadcrumb\":{\"@id\":\"https:\/\/www.africa-press.net\/benin\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup#breadcrumb\"},\"inLanguage\":\"fr-FR\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.africa-press.net\/benin\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-FR\",\"@id\":\"https:\/\/www.africa-press.net\/benin\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup#primaryimage\",\"url\":\"https:\/\/static.africa-press.net\/benin\/sites\/46\/2024\/08\/sm_1722971018.810314.jpg\",\"contentUrl\":\"https:\/\/static.africa-press.net\/benin\/sites\/46\/2024\/08\/sm_1722971018.810314.jpg\",\"width\":1200,\"height\":900,\"caption\":\"Pourquoi l'IA g\u00e9n\u00e9rative devient-elle efficace d'un coup ?\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.africa-press.net\/benin\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Accueil\",\"item\":\"https:\/\/www.africa-press.net\/benin\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Pourquoi l&#8217;IA g\u00e9n\u00e9rative devient-elle efficace d&#8217;un coup ?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.africa-press.net\/benin\/#website\",\"url\":\"https:\/\/www.africa-press.net\/benin\/\",\"name\":\"B\u00e9nin\",\"description\":\"Just another Africa News Agency Sites site\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.africa-press.net\/benin\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"fr-FR\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.africa-press.net\/benin\/#\/schema\/person\/2b1cf3cd81a31e3cd26889ca66d677f1\",\"name\":\"cfeditorfr\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Pourquoi l'IA g\u00e9n\u00e9rative devient-elle efficace d'un coup ? - B\u00e9nin","description":"Les inge\u0301nieurs d'OpenAI ont appele\u0301 ce phe\u0301nome\u0300ne le grokking dans un article publie\u0301 de\u0301but 2022. Lorsque l'on entrai ...","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.africa-press.net\/benin\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup","og_locale":"fr_FR","og_type":"article","og_title":"Pourquoi l'IA g\u00e9n\u00e9rative devient-elle efficace d'un coup ?","og_description":"Les inge\u0301nieurs d'OpenAI ont appele\u0301 ce phe\u0301nome\u0300ne le grokking dans un article publie\u0301 de\u0301but 2022. Lorsque l'on entrai ...","og_url":"https:\/\/www.africa-press.net\/benin\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup","og_site_name":"B\u00e9nin","article_published_time":"2024-08-06T22:29:13+00:00","article_modified_time":"2024-08-06T22:36:17+00:00","og_image":[{"width":1200,"height":900,"url":"https:\/\/static.africa-press.net\/benin\/sites\/46\/2024\/08\/sm_1722971018.810314.jpg","type":"image\/jpeg"}],"author":"cfeditorfr","twitter_card":"summary_large_image","twitter_misc":{"\u00c9crit par":"cfeditorfr","Dur\u00e9e de lecture estim\u00e9e":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.africa-press.net\/benin\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup#article","isPartOf":{"@id":"https:\/\/www.africa-press.net\/benin\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup"},"author":{"name":"cfeditorfr","@id":"https:\/\/www.africa-press.net\/benin\/#\/schema\/person\/2b1cf3cd81a31e3cd26889ca66d677f1"},"headline":"Pourquoi l&rsquo;IA g\u00e9n\u00e9rative devient-elle efficace d&rsquo;un coup ?","datePublished":"2024-08-06T22:29:13+00:00","dateModified":"2024-08-06T22:36:17+00:00","mainEntityOfPage":{"@id":"https:\/\/www.africa-press.net\/benin\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup"},"wordCount":482,"commentCount":0,"image":{"@id":"https:\/\/www.africa-press.net\/benin\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup#primaryimage"},"thumbnailUrl":"https:\/\/static.africa-press.net\/benin\/sites\/46\/2024\/08\/sm_1722971018.810314.jpg","keywords":["B\u00e9nin"],"articleSection":["Divers","Toutes les actualit\u00e9s"],"inLanguage":"fr-FR","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.africa-press.net\/benin\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.africa-press.net\/benin\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup","url":"https:\/\/www.africa-press.net\/benin\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup","name":"Pourquoi l'IA g\u00e9n\u00e9rative devient-elle efficace d'un coup ? - B\u00e9nin","isPartOf":{"@id":"https:\/\/www.africa-press.net\/benin\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.africa-press.net\/benin\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup#primaryimage"},"image":{"@id":"https:\/\/www.africa-press.net\/benin\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup#primaryimage"},"thumbnailUrl":"https:\/\/static.africa-press.net\/benin\/sites\/46\/2024\/08\/sm_1722971018.810314.jpg","datePublished":"2024-08-06T22:29:13+00:00","dateModified":"2024-08-06T22:36:17+00:00","author":{"@id":"https:\/\/www.africa-press.net\/benin\/#\/schema\/person\/2b1cf3cd81a31e3cd26889ca66d677f1"},"description":"Les inge\u0301nieurs d'OpenAI ont appele\u0301 ce phe\u0301nome\u0300ne le grokking dans un article publie\u0301 de\u0301but 2022. Lorsque l'on entrai ...","breadcrumb":{"@id":"https:\/\/www.africa-press.net\/benin\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup#breadcrumb"},"inLanguage":"fr-FR","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.africa-press.net\/benin\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup"]}]},{"@type":"ImageObject","inLanguage":"fr-FR","@id":"https:\/\/www.africa-press.net\/benin\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup#primaryimage","url":"https:\/\/static.africa-press.net\/benin\/sites\/46\/2024\/08\/sm_1722971018.810314.jpg","contentUrl":"https:\/\/static.africa-press.net\/benin\/sites\/46\/2024\/08\/sm_1722971018.810314.jpg","width":1200,"height":900,"caption":"Pourquoi l'IA g\u00e9n\u00e9rative devient-elle efficace d'un coup ?"},{"@type":"BreadcrumbList","@id":"https:\/\/www.africa-press.net\/benin\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Accueil","item":"https:\/\/www.africa-press.net\/benin\/"},{"@type":"ListItem","position":2,"name":"Pourquoi l&#8217;IA g\u00e9n\u00e9rative devient-elle efficace d&#8217;un coup ?"}]},{"@type":"WebSite","@id":"https:\/\/www.africa-press.net\/benin\/#website","url":"https:\/\/www.africa-press.net\/benin\/","name":"B\u00e9nin","description":"Just another Africa News Agency Sites site","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.africa-press.net\/benin\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"fr-FR"},{"@type":"Person","@id":"https:\/\/www.africa-press.net\/benin\/#\/schema\/person\/2b1cf3cd81a31e3cd26889ca66d677f1","name":"cfeditorfr"}]}},"_links":{"self":[{"href":"https:\/\/www.africa-press.net\/benin\/wp-json\/wp\/v2\/posts\/31193","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.africa-press.net\/benin\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.africa-press.net\/benin\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.africa-press.net\/benin\/wp-json\/wp\/v2\/users\/82"}],"replies":[{"embeddable":true,"href":"https:\/\/www.africa-press.net\/benin\/wp-json\/wp\/v2\/comments?post=31193"}],"version-history":[{"count":0,"href":"https:\/\/www.africa-press.net\/benin\/wp-json\/wp\/v2\/posts\/31193\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.africa-press.net\/benin\/wp-json\/wp\/v2\/media\/31192"}],"wp:attachment":[{"href":"https:\/\/www.africa-press.net\/benin\/wp-json\/wp\/v2\/media?parent=31193"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.africa-press.net\/benin\/wp-json\/wp\/v2\/categories?post=31193"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.africa-press.net\/benin\/wp-json\/wp\/v2\/tags?post=31193"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}