{"id":462,"date":"2018-10-14T13:16:42","date_gmt":"2018-10-14T10:16:42","guid":{"rendered":"https:\/\/openinsurance.io\/?p=462"},"modified":"2018-10-23T12:03:44","modified_gmt":"2018-10-23T09:03:44","slug":"open-insurance-and-liability-of-ai-systems","status":"publish","type":"post","link":"https:\/\/openinsurance.io\/open-insurance-and-liability-of-ai-systems\/","title":{"rendered":"Exploring Liability Challenges Caused by Rogue AI Systems"},"content":{"rendered":"

One of the objectives of the Open Insurance Initiative (OPIN)<\/a> is the design of an API standard that is versatile enough to allow and advance interoperability with a world increasingly driven by IoT, AI and autonomous agents.<\/p>\n

As part of the ongoing research into advancing this initiative, a topic which might appear off limits to this work but had continuously aroused our curiosity, was the treatment of liability caused by rogue, AI driven systems.<\/p>\n

We believe that despite the importance of the topic it is rather relegated to the sidelines of publicity while we are all glorifying InsurTech or dashing to build the next insurance unicorn. Liability is one area that could actually stun entrepreneurs and slow innovation. This could be economically disastrous.<\/p>\n

The following represents my views (I am not a law professional) of the issues arising therefore I stand to be corrected if others have more legal and studied opinions.<\/p>\n

Let us first consider the challenges faced by insurers and law professionals in dealing with AI as a source of liability.<\/p>\n

Technically, the main challenges stem from the fact that AI technologies are developing at phenomenal pace reflected for instance, in increased autonomous capabilities and the accelerated deployment and integration of such technologies in many everyday gadgets, equipment and vehicles. AI will soon become so ubiquitous that much of the software and equipment we use will be communicating together independently without human intervention.<\/p>\n

A robotic or an autonomous system might be referred to as an artificial computational agent. Legally, there is little body of legal research on the treatment of artificial agents and this explains the lack of regulatory guidance on such topic. For example, could existing legal theory be used to establish legal liability of developers of highly autonomous systems? Could they establish criminal negligence or criminal intent to commit a crime? Could some of these advanced highly autonomous robots qualify as legal persons and be punished for their unlawful actions? And how will the doctrine of strict liability apply in these instances?<\/p>\n

It should be noted that some risks are becoming better understood in terms of the source of liability, as in self-driven vehicles (they are always designed with safety first in mind) where legal precedents are already being established given the numerous claims and accidents that have accumulated over the past few years. However, there are many other instances where the cause of liability may be very difficult to establish.<\/p>\n

For Insurers, great effort is needed to establish the foreseeability of damage that could be caused by different autonomous systems. For example, do developers have knowledge of potential problems (misrepresentation \/ non-disclosure)? Could these systems use their acquired datasets to evolve into totally different systems with different intentions? What\u2019s the level of protection that these systems have against highly concealed adversarial inputs and data poisoning attacks?<\/p>\n

Most present day policies protecting against commercial general liability, auto liability, professional liability and products liability do not address these risks properly.<\/p>\n

Is there potential for AI developers to be drawn into criminal or civil courts if their programs\/platforms are deemed criminally liable\/negligent?<\/strong><\/p>\n

Part of the challenges that AI introduces is establishing who is responsible for the damage or loss when an accident occurs. A prime example is autonomous vehicles, issues could arise in proportioning the amount of responsibility each of the passenger\/driver, vehicle manufacturer and the system developers are judged to assume.<\/p>\n

If a developer is deemed criminally liable or negligent then recourse may be pursued in both criminal and civil courts. It should be noted that causation, intent and responsibility get increasingly difficult to untangle when AI is involved.<\/p>\n

The application of joint and several liability may mean the party with the largest resources end up footing much of the damages awarded, in this case the manufacturer.<\/p>\n

How is AI going to affect the insurance industry in the coming years?<\/strong><\/p>\n

Insurers are looking at adapting their insurance policies to protect clients. Liability, property, auto, health and life insurance will need to better address new exposures.<\/p>\n

Risk assessment has to continually play catch up with the uncertainties being introduced such as the impact of these new technologies and the potential for catastrophic events.<\/p>\n

The medical profession, for example, has introduced new complexities for underwrites of medical malpractice covers. Digital health deploying AI in disease recognition, genetic testing, virtual nursing and surgical robotics introduce risks of mismanaged care due to AI errors and lack of human oversight.<\/p>\n

The complexity introduced by AI in applying strict liability will mean new models of liability coverage will likely be adopted. These models will probably assume the focus is severely shifted to the manufacturers and software developers and less on the consumer.<\/p>\n

Areas that AI is going to particularly affect insurers<\/strong><\/p>\n

The insurance industry itself is evolving through increased use of ML, VR and AR. The industry sees efficiency and enhanced customer experience as competitive advantages gainable through the use of AI. Many companies are already deploying chatbots, robo-advisors and instant underwriting algorithms to refine underwriting, claims settlement, fraud detection, marketing and customer servicing.<\/p>\n

Is legislation keeping up with AI development?<\/strong><\/p>\n

There is no doubt in my mind that there is a growing case for modified legal frameworks due to the shortcomings of existing philosophy and legal theory in accommodating incidents resulting from sophisticated AI agents.<\/p>\n

A clear liability framework must be developed to adequately address human interests to ensure justice for those who are harmed by autonomous systems.<\/p>\n

While some in the legal profession are conducting research and providing studied opinions on the treatment of myriad of issues relating to liability and independent agencies, I believe initiatives could be setup and financed by stakeholders in the legal, manufacturing and insurance industries to work with policy makers in drafting an improved legal framework.<\/p>\n

Fouad Husseini<\/p>\n","protected":false},"excerpt":{"rendered":"

One of the objectives of the Open Insurance Initiative (OPIN) is the design of an API standard that is versatile…<\/p>\n","protected":false},"author":1,"featured_media":353,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[18],"tags":[20,15,14,21,19],"yoast_head":"\nExploring Liability Challenges Caused by Rogue AI Systems - Open Insurance<\/title>\n<meta name=\"description\" content=\"With the increasing adoption of Open Insurance. AI legal liability is an area that could actually stun entrepreneurs and slow innovation. This could be economically disastrous.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/openinsurance.io\/open-insurance-and-liability-of-ai-systems\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Exploring Liability Challenges Caused by Rogue AI Systems - Open Insurance\" \/>\n<meta property=\"og:description\" content=\"With the increasing adoption of Open Insurance. AI legal liability is an area that could actually stun entrepreneurs and slow innovation. This could be economically disastrous.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/openinsurance.io\/open-insurance-and-liability-of-ai-systems\/\" \/>\n<meta property=\"og:site_name\" content=\"Open Insurance\" \/>\n<meta property=\"article:published_time\" content=\"2018-10-14T10:16:42+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2018-10-23T09:03:44+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/openinsurance.io\/wp-content\/uploads\/2018\/07\/community-project-OPIN-4.jpeg\" \/>\n\t<meta property=\"og:image:width\" content=\"1920\" \/>\n\t<meta property=\"og:image:height\" content=\"1314\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@opininitiative\" \/>\n<meta name=\"twitter:site\" content=\"@opininitiative\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/openinsurance.io\/open-insurance-and-liability-of-ai-systems\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/openinsurance.io\/open-insurance-and-liability-of-ai-systems\/\"},\"author\":{\"name\":\"Admin\",\"@id\":\"https:\/\/openinsurance.io\/#\/schema\/person\/157093a7dc8684ca5542d1dec60632ee\"},\"headline\":\"Exploring Liability Challenges Caused by Rogue AI Systems\",\"datePublished\":\"2018-10-14T10:16:42+00:00\",\"dateModified\":\"2018-10-23T09:03:44+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/openinsurance.io\/open-insurance-and-liability-of-ai-systems\/\"},\"wordCount\":973,\"publisher\":{\"@id\":\"https:\/\/openinsurance.io\/#organization\"},\"image\":{\"@id\":\"https:\/\/openinsurance.io\/open-insurance-and-liability-of-ai-systems\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/openinsurance.io\/wp-content\/uploads\/2018\/07\/community-project-OPIN-4.jpeg\",\"keywords\":[\"artificialintelligence\",\"insurance\",\"insurtech\",\"legaltech\",\"openinsurance\"],\"articleSection\":[\"Blog\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/openinsurance.io\/open-insurance-and-liability-of-ai-systems\/\",\"url\":\"https:\/\/openinsurance.io\/open-insurance-and-liability-of-ai-systems\/\",\"name\":\"Exploring Liability Challenges Caused by Rogue AI Systems - Open Insurance\",\"isPartOf\":{\"@id\":\"https:\/\/openinsurance.io\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/openinsurance.io\/open-insurance-and-liability-of-ai-systems\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/openinsurance.io\/open-insurance-and-liability-of-ai-systems\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/openinsurance.io\/wp-content\/uploads\/2018\/07\/community-project-OPIN-4.jpeg\",\"datePublished\":\"2018-10-14T10:16:42+00:00\",\"dateModified\":\"2018-10-23T09:03:44+00:00\",\"description\":\"With the increasing adoption of Open Insurance. AI legal liability is an area that could actually stun entrepreneurs and slow innovation. This could be economically disastrous.\",\"breadcrumb\":{\"@id\":\"https:\/\/openinsurance.io\/open-insurance-and-liability-of-ai-systems\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/openinsurance.io\/open-insurance-and-liability-of-ai-systems\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/openinsurance.io\/open-insurance-and-liability-of-ai-systems\/#primaryimage\",\"url\":\"https:\/\/openinsurance.io\/wp-content\/uploads\/2018\/07\/community-project-OPIN-4.jpeg\",\"contentUrl\":\"https:\/\/openinsurance.io\/wp-content\/uploads\/2018\/07\/community-project-OPIN-4.jpeg\",\"width\":1920,\"height\":1314,\"caption\":\"The Challenges of Artificial Intelligence as a Source of Liability\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/openinsurance.io\/open-insurance-and-liability-of-ai-systems\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/openinsurance.io\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Exploring Liability Challenges Caused by Rogue AI Systems\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/openinsurance.io\/#website\",\"url\":\"https:\/\/openinsurance.io\/\",\"name\":\"The Open Insurance Initiative\",\"description\":\"Open Insurance Think Tank\",\"publisher\":{\"@id\":\"https:\/\/openinsurance.io\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/openinsurance.io\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/openinsurance.io\/#organization\",\"name\":\"Open Insurance\",\"url\":\"https:\/\/openinsurance.io\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/openinsurance.io\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/openinsurance.io\/wp-content\/uploads\/2019\/12\/Open-Insurance_228x100-white.png\",\"contentUrl\":\"https:\/\/openinsurance.io\/wp-content\/uploads\/2019\/12\/Open-Insurance_228x100-white.png\",\"width\":228,\"height\":100,\"caption\":\"Open Insurance\"},\"image\":{\"@id\":\"https:\/\/openinsurance.io\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/x.com\/opininitiative\",\"https:\/\/www.linkedin.com\/company\/the-open-insurance-initiative-opin\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/openinsurance.io\/#\/schema\/person\/157093a7dc8684ca5542d1dec60632ee\",\"name\":\"Admin\",\"url\":\"https:\/\/openinsurance.io\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Exploring Liability Challenges Caused by Rogue AI Systems - Open Insurance","description":"With the increasing adoption of Open Insurance. AI legal liability is an area that could actually stun entrepreneurs and slow innovation. This could be economically disastrous.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/openinsurance.io\/open-insurance-and-liability-of-ai-systems\/","og_locale":"en_US","og_type":"article","og_title":"Exploring Liability Challenges Caused by Rogue AI Systems - Open Insurance","og_description":"With the increasing adoption of Open Insurance. AI legal liability is an area that could actually stun entrepreneurs and slow innovation. This could be economically disastrous.","og_url":"https:\/\/openinsurance.io\/open-insurance-and-liability-of-ai-systems\/","og_site_name":"Open Insurance","article_published_time":"2018-10-14T10:16:42+00:00","article_modified_time":"2018-10-23T09:03:44+00:00","og_image":[{"width":1920,"height":1314,"url":"https:\/\/openinsurance.io\/wp-content\/uploads\/2018\/07\/community-project-OPIN-4.jpeg","type":"image\/jpeg"}],"author":"Admin","twitter_card":"summary_large_image","twitter_creator":"@opininitiative","twitter_site":"@opininitiative","twitter_misc":{"Written by":"Admin","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/openinsurance.io\/open-insurance-and-liability-of-ai-systems\/#article","isPartOf":{"@id":"https:\/\/openinsurance.io\/open-insurance-and-liability-of-ai-systems\/"},"author":{"name":"Admin","@id":"https:\/\/openinsurance.io\/#\/schema\/person\/157093a7dc8684ca5542d1dec60632ee"},"headline":"Exploring Liability Challenges Caused by Rogue AI Systems","datePublished":"2018-10-14T10:16:42+00:00","dateModified":"2018-10-23T09:03:44+00:00","mainEntityOfPage":{"@id":"https:\/\/openinsurance.io\/open-insurance-and-liability-of-ai-systems\/"},"wordCount":973,"publisher":{"@id":"https:\/\/openinsurance.io\/#organization"},"image":{"@id":"https:\/\/openinsurance.io\/open-insurance-and-liability-of-ai-systems\/#primaryimage"},"thumbnailUrl":"https:\/\/openinsurance.io\/wp-content\/uploads\/2018\/07\/community-project-OPIN-4.jpeg","keywords":["artificialintelligence","insurance","insurtech","legaltech","openinsurance"],"articleSection":["Blog"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/openinsurance.io\/open-insurance-and-liability-of-ai-systems\/","url":"https:\/\/openinsurance.io\/open-insurance-and-liability-of-ai-systems\/","name":"Exploring Liability Challenges Caused by Rogue AI Systems - Open Insurance","isPartOf":{"@id":"https:\/\/openinsurance.io\/#website"},"primaryImageOfPage":{"@id":"https:\/\/openinsurance.io\/open-insurance-and-liability-of-ai-systems\/#primaryimage"},"image":{"@id":"https:\/\/openinsurance.io\/open-insurance-and-liability-of-ai-systems\/#primaryimage"},"thumbnailUrl":"https:\/\/openinsurance.io\/wp-content\/uploads\/2018\/07\/community-project-OPIN-4.jpeg","datePublished":"2018-10-14T10:16:42+00:00","dateModified":"2018-10-23T09:03:44+00:00","description":"With the increasing adoption of Open Insurance. AI legal liability is an area that could actually stun entrepreneurs and slow innovation. This could be economically disastrous.","breadcrumb":{"@id":"https:\/\/openinsurance.io\/open-insurance-and-liability-of-ai-systems\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/openinsurance.io\/open-insurance-and-liability-of-ai-systems\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/openinsurance.io\/open-insurance-and-liability-of-ai-systems\/#primaryimage","url":"https:\/\/openinsurance.io\/wp-content\/uploads\/2018\/07\/community-project-OPIN-4.jpeg","contentUrl":"https:\/\/openinsurance.io\/wp-content\/uploads\/2018\/07\/community-project-OPIN-4.jpeg","width":1920,"height":1314,"caption":"The Challenges of Artificial Intelligence as a Source of Liability"},{"@type":"BreadcrumbList","@id":"https:\/\/openinsurance.io\/open-insurance-and-liability-of-ai-systems\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/openinsurance.io\/"},{"@type":"ListItem","position":2,"name":"Exploring Liability Challenges Caused by Rogue AI Systems"}]},{"@type":"WebSite","@id":"https:\/\/openinsurance.io\/#website","url":"https:\/\/openinsurance.io\/","name":"The Open Insurance Initiative","description":"Open Insurance Think Tank","publisher":{"@id":"https:\/\/openinsurance.io\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/openinsurance.io\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/openinsurance.io\/#organization","name":"Open Insurance","url":"https:\/\/openinsurance.io\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/openinsurance.io\/#\/schema\/logo\/image\/","url":"https:\/\/openinsurance.io\/wp-content\/uploads\/2019\/12\/Open-Insurance_228x100-white.png","contentUrl":"https:\/\/openinsurance.io\/wp-content\/uploads\/2019\/12\/Open-Insurance_228x100-white.png","width":228,"height":100,"caption":"Open Insurance"},"image":{"@id":"https:\/\/openinsurance.io\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/opininitiative","https:\/\/www.linkedin.com\/company\/the-open-insurance-initiative-opin\/"]},{"@type":"Person","@id":"https:\/\/openinsurance.io\/#\/schema\/person\/157093a7dc8684ca5542d1dec60632ee","name":"Admin","url":"https:\/\/openinsurance.io\/author\/admin\/"}]}},"_links":{"self":[{"href":"https:\/\/openinsurance.io\/wp-json\/wp\/v2\/posts\/462"}],"collection":[{"href":"https:\/\/openinsurance.io\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/openinsurance.io\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/openinsurance.io\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/openinsurance.io\/wp-json\/wp\/v2\/comments?post=462"}],"version-history":[{"count":3,"href":"https:\/\/openinsurance.io\/wp-json\/wp\/v2\/posts\/462\/revisions"}],"predecessor-version":[{"id":471,"href":"https:\/\/openinsurance.io\/wp-json\/wp\/v2\/posts\/462\/revisions\/471"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/openinsurance.io\/wp-json\/wp\/v2\/media\/353"}],"wp:attachment":[{"href":"https:\/\/openinsurance.io\/wp-json\/wp\/v2\/media?parent=462"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/openinsurance.io\/wp-json\/wp\/v2\/categories?post=462"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/openinsurance.io\/wp-json\/wp\/v2\/tags?post=462"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}