{"id":60894,"date":"2024-08-09T12:00:00","date_gmt":"2024-08-09T12:00:00","guid":{"rendered":"https:\/\/www.africa-press.net\/senegal\/politique\/pourquoi-lia-generative-devient-elle-efficace-dun-coup"},"modified":"2024-08-10T04:08:40","modified_gmt":"2024-08-10T04:08:40","slug":"pourquoi-lia-generative-devient-elle-efficace-dun-coup","status":"publish","type":"post","link":"https:\/\/www.africa-press.net\/senegal\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup","title":{"rendered":"Pourquoi l\u2019IA g\u00e9n\u00e9rative devient-elle efficace d\u2019un coup ?"},"content":{"rendered":"<p><span style=\"color: #ff6600\"><strong>Africa-Press &#8211; Senegal. <\/strong><\/span>Les inge\u0301nieurs d\u2019OpenAI ont appele\u0301 ce phe\u0301nome\u0300ne le grokking dans un article publie\u0301 de\u0301but 2022. Lorsque l\u2019on entrai\u0302ne sur des donne\u0301es un transformeur, le type d\u2019algorithme qui sert de base aux grands mode\u0300les d\u2019intelligence artificielle ge\u0301ne\u0301rative tel GPT d\u2019OpenAI, la premie\u0300re pe\u0301riode d\u2019entrai\u0302nement (ou epoch) ne donne pas de re\u0301sultats formidables. Si on prolonge l\u2019entrai\u0302nement sur une me\u0302me dure\u0301e, avec les me\u0302mes donne\u0301es, sans rien changer a\u0300 l\u2019algorithme, me\u0302me chose. Et ainsi de suite pendant des dizaines de milliers de se\u0301ances de dure\u0301es strictement identiques quand soudain, la qualite\u0301 des re\u0301sultats monte en fle\u0300che, d\u2019un coup !<\/p>\n<p>Or, ni les chercheurs d\u2019OpenAI, qui ont de\u0301couvert ce grokking par hasard, ni personne d\u2019autre ne savent pourquoi il se produit. Le terme vient du ce\u0301le\u0300bre roman de science-fiction \u201cEn terre e\u0301trange\u0300re\u201d (1961), de Robert Heinlein, et renvoie au fait de comprendre intuitivement. Manie\u0300re de sugge\u0301rer que la machine serait doue\u0301e de compre\u0301hension faute d\u2019explication plus scientifique !<\/p>\n<p><b>Explorer diffe\u0301rentes me\u0301thodes pour en savoir plus<\/b><\/p>\n<p>Directeur de recherche et pre\u0301sident du comite\u0301 d\u2019e\u0301thique du nume\u0301rique du CEA, a\u0300 Saclay, Alexei Grinbaum n\u2019he\u0301site en tout cas pas a\u0300 parler d\u2019un \u201cphe\u0301nome\u0300ne myste\u0301rieux\u201d. \u201cC\u2019est un domaine fascinant sur lequel il y a encore assez peu de recherches. La science commence tout juste a\u0300 aborder cette question, et la premie\u0300re approche serait d\u2019utiliser ce que l\u2019on appelle les phe\u0301nome\u0300nes critiques en physique statistique, quand il y a des transitions de phase. \u201d<\/p>\n<p>C\u2019est-a\u0300-dire quand, par exemple, l\u2019e\u0301tat de la matie\u0300re change physiquement en fonction d\u2019une variable. \u201cPour les syste\u0300mes physiques, comme les gaz, les liquides, nous avons des variables comme la pression, la tempe\u0301rature, le volume. Mais pour les grands mode\u0300les de langage, nous ne savons pas quelles sont les variables pertinentes permettant de de\u0301crire cette transition. C\u2019est complique\u0301 de construire un mode\u0300le dans ces conditions.<\/p>\n<p>Parmi les diffe\u0301rentes me\u0301thodes pour essayer d\u2019en savoir plus, le de\u0301veloppement de \u201cmode\u0300le-jouet\u201d est le plus prometteur, selon le chercheur. Il s\u2019agit tout simplement de petits algorithmes de type transformeur, avec peu de couches, permettant d\u2019observer plus facilement comment s\u2019ope\u0300rent les calculs. \u201cSans doute qu\u2019il se passe des choses dans les tre\u0300s grands transformeurs qu\u2019on ne voit pas du tout dans les petits, pre\u0301vient Alexei Grinbaum. Mais cela peut nous donner quelques ide\u0301es. \u201d<\/p>\n<p><strong>Pour plus d&rsquo;informations et d&rsquo;analyses sur la Senegal, suivez Africa-Press<\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Africa-Press &#8211; Senegal. Les inge\u0301nieurs d\u2019OpenAI ont appele\u0301 ce phe\u0301nome\u0300ne le grokking dans un article publie\u0301 de\u0301but 2022. Lorsque l\u2019on entrai\u0302ne sur des donne\u0301es un transformeur, le type d\u2019algorithme qui sert de base aux grands mode\u0300les d\u2019intelligence artificielle ge\u0301ne\u0301rative tel GPT d\u2019OpenAI, la premie\u0300re pe\u0301riode d\u2019entrai\u0302nement (ou epoch) ne donne pas de re\u0301sultats formidables. Si [&hellip;]<\/p>\n","protected":false},"author":82,"featured_media":60893,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[22,10],"tags":[44],"class_list":["post-60894","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-divers","category-toutes-les-actualites","tag-senegal-2"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v26.1 (Yoast SEO v27.0) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>Pourquoi l\u2019IA g\u00e9n\u00e9rative devient-elle efficace d\u2019un coup ? - Senegal<\/title>\n<meta name=\"description\" content=\"Les inge\u0301nieurs d\u2019OpenAI ont appele\u0301 ce phe\u0301nome\u0300ne le grokking dans un article publie\u0301 de\u0301but 2022. Lorsque l\u2019on entrai ...\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.africa-press.net\/senegal\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup\" \/>\n<meta property=\"og:locale\" content=\"fr_FR\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Pourquoi l\u2019IA g\u00e9n\u00e9rative devient-elle efficace d\u2019un coup ?\" \/>\n<meta property=\"og:description\" content=\"Les inge\u0301nieurs d\u2019OpenAI ont appele\u0301 ce phe\u0301nome\u0300ne le grokking dans un article publie\u0301 de\u0301but 2022. Lorsque l\u2019on entrai ...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.africa-press.net\/senegal\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup\" \/>\n<meta property=\"og:site_name\" content=\"Senegal\" \/>\n<meta property=\"article:published_time\" content=\"2024-08-09T12:00:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-08-10T04:08:40+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/static.africa-press.net\/senegal\/sites\/13\/2024\/08\/sm_1723246337.163875.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"900\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"cfeditorfr\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u00c9crit par\" \/>\n\t<meta name=\"twitter:data1\" content=\"cfeditorfr\" \/>\n\t<meta name=\"twitter:label2\" content=\"Dur\u00e9e de lecture estim\u00e9e\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.africa-press.net\/senegal\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.africa-press.net\/senegal\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup\"},\"author\":{\"name\":\"cfeditorfr\",\"@id\":\"https:\/\/www.africa-press.net\/senegal\/#\/schema\/person\/2b1cf3cd81a31e3cd26889ca66d677f1\"},\"headline\":\"Pourquoi l\u2019IA g\u00e9n\u00e9rative devient-elle efficace d\u2019un coup ?\",\"datePublished\":\"2024-08-09T12:00:00+00:00\",\"dateModified\":\"2024-08-10T04:08:40+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.africa-press.net\/senegal\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup\"},\"wordCount\":482,\"commentCount\":0,\"image\":{\"@id\":\"https:\/\/www.africa-press.net\/senegal\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup#primaryimage\"},\"thumbnailUrl\":\"https:\/\/static.africa-press.net\/senegal\/sites\/13\/2024\/08\/sm_1723246337.163875.jpg\",\"keywords\":[\"Senegal\"],\"articleSection\":[\"Divers\",\"Toutes les actualit\u00e9s\"],\"inLanguage\":\"fr-FR\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.africa-press.net\/senegal\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.africa-press.net\/senegal\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup\",\"url\":\"https:\/\/www.africa-press.net\/senegal\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup\",\"name\":\"Pourquoi l\u2019IA g\u00e9n\u00e9rative devient-elle efficace d\u2019un coup ? - Senegal\",\"isPartOf\":{\"@id\":\"https:\/\/www.africa-press.net\/senegal\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.africa-press.net\/senegal\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.africa-press.net\/senegal\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup#primaryimage\"},\"thumbnailUrl\":\"https:\/\/static.africa-press.net\/senegal\/sites\/13\/2024\/08\/sm_1723246337.163875.jpg\",\"datePublished\":\"2024-08-09T12:00:00+00:00\",\"dateModified\":\"2024-08-10T04:08:40+00:00\",\"author\":{\"@id\":\"https:\/\/www.africa-press.net\/senegal\/#\/schema\/person\/2b1cf3cd81a31e3cd26889ca66d677f1\"},\"description\":\"Les inge\u0301nieurs d\u2019OpenAI ont appele\u0301 ce phe\u0301nome\u0300ne le grokking dans un article publie\u0301 de\u0301but 2022. Lorsque l\u2019on entrai ...\",\"breadcrumb\":{\"@id\":\"https:\/\/www.africa-press.net\/senegal\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup#breadcrumb\"},\"inLanguage\":\"fr-FR\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.africa-press.net\/senegal\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-FR\",\"@id\":\"https:\/\/www.africa-press.net\/senegal\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup#primaryimage\",\"url\":\"https:\/\/static.africa-press.net\/senegal\/sites\/13\/2024\/08\/sm_1723246337.163875.jpg\",\"contentUrl\":\"https:\/\/static.africa-press.net\/senegal\/sites\/13\/2024\/08\/sm_1723246337.163875.jpg\",\"width\":1200,\"height\":900,\"caption\":\"Pourquoi l\u2019IA g\u00e9n\u00e9rative devient-elle efficace d\u2019un coup ?\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.africa-press.net\/senegal\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Accueil\",\"item\":\"https:\/\/www.africa-press.net\/senegal\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Pourquoi l\u2019IA g\u00e9n\u00e9rative devient-elle efficace d\u2019un coup ?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.africa-press.net\/senegal\/#website\",\"url\":\"https:\/\/www.africa-press.net\/senegal\/\",\"name\":\"Africa Press | Senegal | Homepage\",\"description\":\"Just another Africa News Agency Sites site\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.africa-press.net\/senegal\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"fr-FR\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.africa-press.net\/senegal\/#\/schema\/person\/2b1cf3cd81a31e3cd26889ca66d677f1\",\"name\":\"cfeditorfr\",\"url\":\"https:\/\/www.africa-press.net\/senegal\/author\/cfeditorfr\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Pourquoi l\u2019IA g\u00e9n\u00e9rative devient-elle efficace d\u2019un coup ? - Senegal","description":"Les inge\u0301nieurs d\u2019OpenAI ont appele\u0301 ce phe\u0301nome\u0300ne le grokking dans un article publie\u0301 de\u0301but 2022. Lorsque l\u2019on entrai ...","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.africa-press.net\/senegal\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup","og_locale":"fr_FR","og_type":"article","og_title":"Pourquoi l\u2019IA g\u00e9n\u00e9rative devient-elle efficace d\u2019un coup ?","og_description":"Les inge\u0301nieurs d\u2019OpenAI ont appele\u0301 ce phe\u0301nome\u0300ne le grokking dans un article publie\u0301 de\u0301but 2022. Lorsque l\u2019on entrai ...","og_url":"https:\/\/www.africa-press.net\/senegal\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup","og_site_name":"Senegal","article_published_time":"2024-08-09T12:00:00+00:00","article_modified_time":"2024-08-10T04:08:40+00:00","og_image":[{"width":1200,"height":900,"url":"https:\/\/static.africa-press.net\/senegal\/sites\/13\/2024\/08\/sm_1723246337.163875.jpg","type":"image\/jpeg"}],"author":"cfeditorfr","twitter_card":"summary_large_image","twitter_misc":{"\u00c9crit par":"cfeditorfr","Dur\u00e9e de lecture estim\u00e9e":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.africa-press.net\/senegal\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup#article","isPartOf":{"@id":"https:\/\/www.africa-press.net\/senegal\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup"},"author":{"name":"cfeditorfr","@id":"https:\/\/www.africa-press.net\/senegal\/#\/schema\/person\/2b1cf3cd81a31e3cd26889ca66d677f1"},"headline":"Pourquoi l\u2019IA g\u00e9n\u00e9rative devient-elle efficace d\u2019un coup ?","datePublished":"2024-08-09T12:00:00+00:00","dateModified":"2024-08-10T04:08:40+00:00","mainEntityOfPage":{"@id":"https:\/\/www.africa-press.net\/senegal\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup"},"wordCount":482,"commentCount":0,"image":{"@id":"https:\/\/www.africa-press.net\/senegal\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup#primaryimage"},"thumbnailUrl":"https:\/\/static.africa-press.net\/senegal\/sites\/13\/2024\/08\/sm_1723246337.163875.jpg","keywords":["Senegal"],"articleSection":["Divers","Toutes les actualit\u00e9s"],"inLanguage":"fr-FR","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.africa-press.net\/senegal\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.africa-press.net\/senegal\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup","url":"https:\/\/www.africa-press.net\/senegal\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup","name":"Pourquoi l\u2019IA g\u00e9n\u00e9rative devient-elle efficace d\u2019un coup ? - Senegal","isPartOf":{"@id":"https:\/\/www.africa-press.net\/senegal\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.africa-press.net\/senegal\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup#primaryimage"},"image":{"@id":"https:\/\/www.africa-press.net\/senegal\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup#primaryimage"},"thumbnailUrl":"https:\/\/static.africa-press.net\/senegal\/sites\/13\/2024\/08\/sm_1723246337.163875.jpg","datePublished":"2024-08-09T12:00:00+00:00","dateModified":"2024-08-10T04:08:40+00:00","author":{"@id":"https:\/\/www.africa-press.net\/senegal\/#\/schema\/person\/2b1cf3cd81a31e3cd26889ca66d677f1"},"description":"Les inge\u0301nieurs d\u2019OpenAI ont appele\u0301 ce phe\u0301nome\u0300ne le grokking dans un article publie\u0301 de\u0301but 2022. Lorsque l\u2019on entrai ...","breadcrumb":{"@id":"https:\/\/www.africa-press.net\/senegal\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup#breadcrumb"},"inLanguage":"fr-FR","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.africa-press.net\/senegal\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup"]}]},{"@type":"ImageObject","inLanguage":"fr-FR","@id":"https:\/\/www.africa-press.net\/senegal\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup#primaryimage","url":"https:\/\/static.africa-press.net\/senegal\/sites\/13\/2024\/08\/sm_1723246337.163875.jpg","contentUrl":"https:\/\/static.africa-press.net\/senegal\/sites\/13\/2024\/08\/sm_1723246337.163875.jpg","width":1200,"height":900,"caption":"Pourquoi l\u2019IA g\u00e9n\u00e9rative devient-elle efficace d\u2019un coup ?"},{"@type":"BreadcrumbList","@id":"https:\/\/www.africa-press.net\/senegal\/toutes-les-actualites\/pourquoi-lia-generative-devient-elle-efficace-dun-coup#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Accueil","item":"https:\/\/www.africa-press.net\/senegal\/"},{"@type":"ListItem","position":2,"name":"Pourquoi l\u2019IA g\u00e9n\u00e9rative devient-elle efficace d\u2019un coup ?"}]},{"@type":"WebSite","@id":"https:\/\/www.africa-press.net\/senegal\/#website","url":"https:\/\/www.africa-press.net\/senegal\/","name":"Africa Press | Senegal | Homepage","description":"Just another Africa News Agency Sites site","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.africa-press.net\/senegal\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"fr-FR"},{"@type":"Person","@id":"https:\/\/www.africa-press.net\/senegal\/#\/schema\/person\/2b1cf3cd81a31e3cd26889ca66d677f1","name":"cfeditorfr","url":"https:\/\/www.africa-press.net\/senegal\/author\/cfeditorfr"}]}},"_links":{"self":[{"href":"https:\/\/www.africa-press.net\/senegal\/wp-json\/wp\/v2\/posts\/60894","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.africa-press.net\/senegal\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.africa-press.net\/senegal\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.africa-press.net\/senegal\/wp-json\/wp\/v2\/users\/82"}],"replies":[{"embeddable":true,"href":"https:\/\/www.africa-press.net\/senegal\/wp-json\/wp\/v2\/comments?post=60894"}],"version-history":[{"count":0,"href":"https:\/\/www.africa-press.net\/senegal\/wp-json\/wp\/v2\/posts\/60894\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.africa-press.net\/senegal\/wp-json\/wp\/v2\/media\/60893"}],"wp:attachment":[{"href":"https:\/\/www.africa-press.net\/senegal\/wp-json\/wp\/v2\/media?parent=60894"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.africa-press.net\/senegal\/wp-json\/wp\/v2\/categories?post=60894"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.africa-press.net\/senegal\/wp-json\/wp\/v2\/tags?post=60894"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}