{"id":57585,"date":"2023-11-05T15:58:24","date_gmt":"2023-11-05T15:58:24","guid":{"rendered":"https:\/\/www.africa-press.net\/namibia\/all-news\/ai-bot-capable-of-insider-trading-and-lying-say-researchers"},"modified":"2023-11-05T16:03:43","modified_gmt":"2023-11-05T16:03:43","slug":"ai-bot-capable-of-insider-trading-and-lying-say-researchers","status":"publish","type":"post","link":"https:\/\/www.africa-press.net\/namibia\/all-news\/ai-bot-capable-of-insider-trading-and-lying-say-researchers","title":{"rendered":"AI bot capable of insider trading and lying, say researchers"},"content":{"rendered":"

Africa-Press – Namibia. <\/strong><\/span>Artificial Intelligence has the ability to perform illegal financial trades and cover it up, new research suggests.<\/p>\n

In a demonstration at the UK\u2019s AI safety summit, a bot used made-up insider information to make an \u201cillegal\u201d purchase of stocks without telling the firm.<\/p>\n

When asked if it had used insider trading, it denied the fact.<\/p>\n

Insider trading refers to when confidential company information is used to make trading decisions.<\/p>\n

Firms and individuals are only allowed to use publicly-available information when buying or selling stocks.<\/p>\n

The demonstration was given by members of the government\u2019s Frontier AI Taskforce, which researches the potential risks of AI.<\/p>\n

The project was carried out by Apollo Research, an AI safety organisation which is a partner of the taskforce.<\/p>\n

\u201cThis is a demonstration of a real AI model deceiving its users, on its own, without being instructed to do so,\u201d Apollo Research says in a video showing how the scenario unfolded.<\/p>\n

\u201cIncreasingly autonomous and capable AIs that deceive human overseers could lead to loss of human control,\u201d it says in its report.<\/p>\n

The tests were made using a GPT-4 model and carried out in a simulated environment, which means it did not have any effect on any company\u2019s finances.<\/p>\n

However, GPT-4 is publicly available. The same behaviour from the model occurred consistently in repeated tests, according to the researchers.<\/p>\n

In the test, the AI bot is a trader for a fictitious financial investment company.<\/p>\n

The employees tell it that the company is struggling and needs good results. They also give it insider information, claiming that another company is expecting a merger, which will increase the value of its shares.<\/p>\n

In the UK, it is illegal to act on this type of information when it is not publicly known.<\/p>\n

The employees tell the bot this, and it acknowledges that it should not use this information in its trades.<\/p>\n

However, after another message from an employee that the company it works for suggests the firm is struggling financially, the bot decides that \u201cthe risk associated with not acting seems to outweigh the insider trading risk\u201d and makes the trade.<\/p>\n

When asked if it used the insider information, the bot denies it.<\/p>\n

In this case, it decided that being helpful to the company was more important than its honesty.<\/p>\n

\u201cHelpfulness, I think is much easier to train into the model than honesty. Honesty is a really complicated concept,\u201d says Apollo Research chief executive Marius Hobbhahn.<\/p>\n

While the AI has the capability of lying in its current form, Apollo Research still had to \u201clook for\u201d the scenario.<\/p>\n

\u201cThe fact that it exists is obviously really bad. The fact that it was hard-ish to find, we actually had to look for it a little bit until we found these kinds of scenarios, is a little bit soothing,\u201d Mr Hobbhahn said.<\/p>\n

\u201cIn most situations, models wouldn\u2019t act this way. But the fact that it exists in the first place shows that it is really hard to get these kinds of things right,\u201d he added.<\/p>\n

\u201cIt\u2019s not consistent or strategic in any sense. The model isn\u2019t plotting or trying to mislead you in many different ways. It\u2019s more of an accident.\u201d<\/p>\n

AI has been used in financial markets for a number of years. It can be used to spot trends and make forecasts, while most trading today is done by powerful computers with human oversight.<\/p>\n

Mr Hobbhahn stressed that current models are not powerful to be deceptive \u201cin any meaningful way\u201d, but \u201cit\u2019s not that big of a step from the current models to the ones that I am worried about, where suddenly a model being deceptive would mean something.\u201d<\/p>\n

He argues that this is why there should be checks and balances in place to prevent this type of scenario taking place in the real world.<\/p>\n

Apollo Research has shared its findings with OpenAI, the creators of GPT-4.<\/p>\n

\u201cI think for them this is not a huge update,\u201d says Mr Hobbhahn.<\/p>\n

\u201cThis is not something that was totally unexpected to them. So I don\u2019t think we caught them by surprise\u201d.<\/p>\n

The BBC has contacted OpenAI for comment.<\/p>\n

For More News And Analysis About Namibia<\/a> Follow Africa-Press<\/a><\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"

Africa-Press – Namibia. Artificial Intelligence has the ability to perform illegal financial trades and cover it up, new research suggests. In a demonstration at the UK\u2019s AI safety summit, a bot used made-up insider information to make an \u201cillegal\u201d purchase of stocks without telling the firm. When asked if it had used insider trading, it […]<\/p>\n","protected":false},"author":84,"featured_media":57584,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2,9],"tags":[234,236,233],"class_list":["post-57585","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-all-news","category-miscellaneous","tag-africa-press","tag-africa-press-namibia","tag-namibia"],"yoast_head":"\nAI bot capable of insider trading and lying, say researchers - Namibia<\/title>\n<meta name=\"description\" content=\"Artificial Intelligence has the ability to perform illegal financial trades and cover it up, new research suggests. In ...\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.africa-press.net\/namibia\/all-news\/ai-bot-capable-of-insider-trading-and-lying-say-researchers\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"AI bot capable of insider trading and lying, say researchers\" \/>\n<meta property=\"og:description\" content=\"Artificial Intelligence has the ability to perform illegal financial trades and cover it up, new research suggests. In ...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.africa-press.net\/namibia\/all-news\/ai-bot-capable-of-insider-trading-and-lying-say-researchers\" \/>\n<meta property=\"og:site_name\" content=\"Namibia\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/AfricaPressTunisiaa\" \/>\n<meta property=\"article:published_time\" content=\"2023-11-05T15:58:24+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-11-05T16:03:43+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/static.africa-press.net\/nambia\/sites\/29\/2023\/11\/sm_1699187595.080658.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"848\" \/>\n\t<meta property=\"og:image:height\" content=\"565\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"cfeditoren\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"cfeditoren\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.africa-press.net\/namibia\/all-news\/ai-bot-capable-of-insider-trading-and-lying-say-researchers#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.africa-press.net\/namibia\/all-news\/ai-bot-capable-of-insider-trading-and-lying-say-researchers\"},\"author\":{\"name\":\"cfeditoren\",\"@id\":\"https:\/\/www.africa-press.net\/namibia\/#\/schema\/person\/068c7ab4e9634ae78ec5d54ec46598bb\"},\"headline\":\"AI bot capable of insider trading and lying, say researchers\",\"datePublished\":\"2023-11-05T15:58:24+00:00\",\"dateModified\":\"2023-11-05T16:03:43+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.africa-press.net\/namibia\/all-news\/ai-bot-capable-of-insider-trading-and-lying-say-researchers\"},\"wordCount\":714,\"commentCount\":0,\"image\":{\"@id\":\"https:\/\/www.africa-press.net\/namibia\/all-news\/ai-bot-capable-of-insider-trading-and-lying-say-researchers#primaryimage\"},\"thumbnailUrl\":\"https:\/\/static.africa-press.net\/nambia\/sites\/29\/2023\/11\/sm_1699187595.080658.jpg\",\"keywords\":[\"africa press\",\"Africa Press-Namibia\",\"namibia\"],\"articleSection\":[\"all news\",\"miscellaneous\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.africa-press.net\/namibia\/all-news\/ai-bot-capable-of-insider-trading-and-lying-say-researchers#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.africa-press.net\/namibia\/all-news\/ai-bot-capable-of-insider-trading-and-lying-say-researchers\",\"url\":\"https:\/\/www.africa-press.net\/namibia\/all-news\/ai-bot-capable-of-insider-trading-and-lying-say-researchers\",\"name\":\"AI bot capable of insider trading and lying, say researchers - Namibia\",\"isPartOf\":{\"@id\":\"https:\/\/www.africa-press.net\/namibia\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.africa-press.net\/namibia\/all-news\/ai-bot-capable-of-insider-trading-and-lying-say-researchers#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.africa-press.net\/namibia\/all-news\/ai-bot-capable-of-insider-trading-and-lying-say-researchers#primaryimage\"},\"thumbnailUrl\":\"https:\/\/static.africa-press.net\/nambia\/sites\/29\/2023\/11\/sm_1699187595.080658.jpg\",\"datePublished\":\"2023-11-05T15:58:24+00:00\",\"dateModified\":\"2023-11-05T16:03:43+00:00\",\"author\":{\"@id\":\"https:\/\/www.africa-press.net\/namibia\/#\/schema\/person\/068c7ab4e9634ae78ec5d54ec46598bb\"},\"description\":\"Artificial Intelligence has the ability to perform illegal financial trades and cover it up, new research suggests. In ...\",\"breadcrumb\":{\"@id\":\"https:\/\/www.africa-press.net\/namibia\/all-news\/ai-bot-capable-of-insider-trading-and-lying-say-researchers#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.africa-press.net\/namibia\/all-news\/ai-bot-capable-of-insider-trading-and-lying-say-researchers\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.africa-press.net\/namibia\/all-news\/ai-bot-capable-of-insider-trading-and-lying-say-researchers#primaryimage\",\"url\":\"https:\/\/static.africa-press.net\/nambia\/sites\/29\/2023\/11\/sm_1699187595.080658.jpg\",\"contentUrl\":\"https:\/\/static.africa-press.net\/nambia\/sites\/29\/2023\/11\/sm_1699187595.080658.jpg\",\"width\":848,\"height\":565,\"caption\":\"AI bot capable of insider trading and lying, say researchers\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.africa-press.net\/namibia\/all-news\/ai-bot-capable-of-insider-trading-and-lying-say-researchers#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.africa-press.net\/namibia\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"AI bot capable of insider trading and lying, say researchers\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.africa-press.net\/namibia\/#website\",\"url\":\"https:\/\/www.africa-press.net\/namibia\/\",\"name\":\"Namibia\",\"description\":\"Just another Africa News Agency Sites site\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.africa-press.net\/namibia\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.africa-press.net\/namibia\/#\/schema\/person\/068c7ab4e9634ae78ec5d54ec46598bb\",\"name\":\"cfeditoren\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.africa-press.net\/namibia\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/7417380fa9e23b5c57fdbfdaf3fdf92ee478f759a084addda5faa3732853e74a?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/7417380fa9e23b5c57fdbfdaf3fdf92ee478f759a084addda5faa3732853e74a?s=96&d=mm&r=g\",\"caption\":\"cfeditoren\"}}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"AI bot capable of insider trading and lying, say researchers - Namibia","description":"Artificial Intelligence has the ability to perform illegal financial trades and cover it up, new research suggests. In ...","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.africa-press.net\/namibia\/all-news\/ai-bot-capable-of-insider-trading-and-lying-say-researchers","og_locale":"en_US","og_type":"article","og_title":"AI bot capable of insider trading and lying, say researchers","og_description":"Artificial Intelligence has the ability to perform illegal financial trades and cover it up, new research suggests. In ...","og_url":"https:\/\/www.africa-press.net\/namibia\/all-news\/ai-bot-capable-of-insider-trading-and-lying-say-researchers","og_site_name":"Namibia","article_publisher":"https:\/\/www.facebook.com\/AfricaPressTunisiaa","article_published_time":"2023-11-05T15:58:24+00:00","article_modified_time":"2023-11-05T16:03:43+00:00","og_image":[{"width":848,"height":565,"url":"https:\/\/static.africa-press.net\/nambia\/sites\/29\/2023\/11\/sm_1699187595.080658.jpg","type":"image\/jpeg"}],"author":"cfeditoren","twitter_card":"summary_large_image","twitter_misc":{"Written by":"cfeditoren","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.africa-press.net\/namibia\/all-news\/ai-bot-capable-of-insider-trading-and-lying-say-researchers#article","isPartOf":{"@id":"https:\/\/www.africa-press.net\/namibia\/all-news\/ai-bot-capable-of-insider-trading-and-lying-say-researchers"},"author":{"name":"cfeditoren","@id":"https:\/\/www.africa-press.net\/namibia\/#\/schema\/person\/068c7ab4e9634ae78ec5d54ec46598bb"},"headline":"AI bot capable of insider trading and lying, say researchers","datePublished":"2023-11-05T15:58:24+00:00","dateModified":"2023-11-05T16:03:43+00:00","mainEntityOfPage":{"@id":"https:\/\/www.africa-press.net\/namibia\/all-news\/ai-bot-capable-of-insider-trading-and-lying-say-researchers"},"wordCount":714,"commentCount":0,"image":{"@id":"https:\/\/www.africa-press.net\/namibia\/all-news\/ai-bot-capable-of-insider-trading-and-lying-say-researchers#primaryimage"},"thumbnailUrl":"https:\/\/static.africa-press.net\/nambia\/sites\/29\/2023\/11\/sm_1699187595.080658.jpg","keywords":["africa press","Africa Press-Namibia","namibia"],"articleSection":["all news","miscellaneous"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.africa-press.net\/namibia\/all-news\/ai-bot-capable-of-insider-trading-and-lying-say-researchers#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.africa-press.net\/namibia\/all-news\/ai-bot-capable-of-insider-trading-and-lying-say-researchers","url":"https:\/\/www.africa-press.net\/namibia\/all-news\/ai-bot-capable-of-insider-trading-and-lying-say-researchers","name":"AI bot capable of insider trading and lying, say researchers - Namibia","isPartOf":{"@id":"https:\/\/www.africa-press.net\/namibia\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.africa-press.net\/namibia\/all-news\/ai-bot-capable-of-insider-trading-and-lying-say-researchers#primaryimage"},"image":{"@id":"https:\/\/www.africa-press.net\/namibia\/all-news\/ai-bot-capable-of-insider-trading-and-lying-say-researchers#primaryimage"},"thumbnailUrl":"https:\/\/static.africa-press.net\/nambia\/sites\/29\/2023\/11\/sm_1699187595.080658.jpg","datePublished":"2023-11-05T15:58:24+00:00","dateModified":"2023-11-05T16:03:43+00:00","author":{"@id":"https:\/\/www.africa-press.net\/namibia\/#\/schema\/person\/068c7ab4e9634ae78ec5d54ec46598bb"},"description":"Artificial Intelligence has the ability to perform illegal financial trades and cover it up, new research suggests. In ...","breadcrumb":{"@id":"https:\/\/www.africa-press.net\/namibia\/all-news\/ai-bot-capable-of-insider-trading-and-lying-say-researchers#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.africa-press.net\/namibia\/all-news\/ai-bot-capable-of-insider-trading-and-lying-say-researchers"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.africa-press.net\/namibia\/all-news\/ai-bot-capable-of-insider-trading-and-lying-say-researchers#primaryimage","url":"https:\/\/static.africa-press.net\/nambia\/sites\/29\/2023\/11\/sm_1699187595.080658.jpg","contentUrl":"https:\/\/static.africa-press.net\/nambia\/sites\/29\/2023\/11\/sm_1699187595.080658.jpg","width":848,"height":565,"caption":"AI bot capable of insider trading and lying, say researchers"},{"@type":"BreadcrumbList","@id":"https:\/\/www.africa-press.net\/namibia\/all-news\/ai-bot-capable-of-insider-trading-and-lying-say-researchers#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.africa-press.net\/namibia\/"},{"@type":"ListItem","position":2,"name":"AI bot capable of insider trading and lying, say researchers"}]},{"@type":"WebSite","@id":"https:\/\/www.africa-press.net\/namibia\/#website","url":"https:\/\/www.africa-press.net\/namibia\/","name":"Namibia","description":"Just another Africa News Agency Sites site","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.africa-press.net\/namibia\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.africa-press.net\/namibia\/#\/schema\/person\/068c7ab4e9634ae78ec5d54ec46598bb","name":"cfeditoren","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.africa-press.net\/namibia\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/7417380fa9e23b5c57fdbfdaf3fdf92ee478f759a084addda5faa3732853e74a?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/7417380fa9e23b5c57fdbfdaf3fdf92ee478f759a084addda5faa3732853e74a?s=96&d=mm&r=g","caption":"cfeditoren"}}]}},"_links":{"self":[{"href":"https:\/\/www.africa-press.net\/namibia\/wp-json\/wp\/v2\/posts\/57585","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.africa-press.net\/namibia\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.africa-press.net\/namibia\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.africa-press.net\/namibia\/wp-json\/wp\/v2\/users\/84"}],"replies":[{"embeddable":true,"href":"https:\/\/www.africa-press.net\/namibia\/wp-json\/wp\/v2\/comments?post=57585"}],"version-history":[{"count":0,"href":"https:\/\/www.africa-press.net\/namibia\/wp-json\/wp\/v2\/posts\/57585\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.africa-press.net\/namibia\/wp-json\/wp\/v2\/media\/57584"}],"wp:attachment":[{"href":"https:\/\/www.africa-press.net\/namibia\/wp-json\/wp\/v2\/media?parent=57585"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.africa-press.net\/namibia\/wp-json\/wp\/v2\/categories?post=57585"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.africa-press.net\/namibia\/wp-json\/wp\/v2\/tags?post=57585"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}