{"id":22087,"date":"2023-06-13T08:29:37","date_gmt":"2023-06-13T08:29:37","guid":{"rendered":"https:\/\/www.imprima.com\/?p=22087"},"modified":"2023-06-19T11:11:57","modified_gmt":"2023-06-19T11:11:57","slug":"smart-redaction-how-and-why-it-works","status":"publish","type":"post","link":"https:\/\/www.imprima.com\/blog\/automated-redaction-llm","title":{"rendered":"Large Language Models for Automated Redaction"},"content":{"rendered":"\n

Technology deep dive (but don\u2019t be put off if you are a non-technical person, we will keep it high-level)<\/span><\/p>\n\n\n\n

Last week we discussed how time limits and the likelihood for error make manual redaction very challenging, and why even automated redaction is a difficult nut to crack, at least with traditional search methods, and \u201cRegular Expressions\u201d (see last week’s blog on Redaction challenges<\/a><\/strong>).<\/p>\n\n\n\n

This week we will discuss how it can be solved, with AI. But not just any AI. AI is a rather fluid label. Some people even claim that techniques like Regular Expressions constitute AI. Whilst regex certainly has a use case, it has major downsides for redaction purposes, as discussed last week<\/strong><\/a>.<\/p>\n\n\n\n

<\/div>\n\n\n\n

Machine Learning and Large Language Models.<\/span><\/p>\n\n\n\n

The key technology to be used is machine learning. But again, not just any machine learning. You need a technique that uses the whole, unabridged text, as the context of the information to be found (and redacted) is key to finding (and redacting) that information. We have found that the optimal way this can be reliably and accurately done is by using \u201cLarge Language Models\u201d (the technology underlying ChatGPT).<\/p>\n\n\n\n

<\/div>\n\n\n\n

What is a Large Language Model (LLM)?<\/span><\/p>\n\n\n\n

Essentially an LLM is a Neural Network<\/a><\/strong>, trained on a large body of text (e.g., Wikipedia, Common Crawl<\/a><\/strong> etc.). LLMs predict the next word (or a word in between), given its preceding (or surrounding) sequence of words and sentences. They are trained to do that by leaving words out, to fill in the blanks, so to speak. You may know the so-called Cloze test<\/a><\/strong>, which tests your ability to fill in the blanks, e.g. \u201cmonkeys like to \u2026 bananas\u201c. You could say that LLMs are trained to ace that test!<\/p>\n\n\n\n

As a result, these models can understand the patterns of languages, such as grammar and style (which makes ChatGPT so eloquent!), but also, if enough training data is used, semantics and logic (which makes ChatGPT able to produce informative text, though not always accurately. Interesting read on that: ChatGPT is no stochastic parrot. But it also claims that 1 is greater than 1<\/a><\/strong>). These models have as additional advantage that they are trained without the need for humans to \u201clabel\u201d the data first. And that makes it feasible to train LLMs on very large amounts of data with relatively low human effort (other than very smart data scientists! And of course, huge computer resources!).<\/p>\n\n\n\n

<\/div>\n\n\n\n

How we use LLMs at Imprima<\/span><\/p>\n\n\n\n

At Imprima, we use an LLM that we have customised for the purpose of redaction, and trained on documentation typically found in DD. We have trained it in multiple languages, and it predicts across languages. Accuracy in one language is increased through the utilisation of training data in other languages working in conjunction with each other.<\/p>\n\n\n\n

It is designed and trained to categorise words (or other \u201ctokens\u201d such as numbers, etc.) so it can subsequently find the words that, in the redaction use case, are to be redacted. This has several advantages. As it uses the context of the words to be redacted, it relies on the meaning of the words to be redacted, rather than on the exact words themselves. Therefore, it enables you to bypass the major disadvantage of traditional techniques such as search or Regular Expressions (see last week’s blog post<\/a><\/strong>.)<\/p>\n\n\n\n

That said, its overarching advantage is its accuracy and reliability, which goes far beyond what any other automated redaction can do. We have shown that in a previous blog post (Smart VDRs \u2013 it is all about accuracy<\/a><\/strong>), and we will discuss further in the next blog post.<\/p>\n\n\n\n

<\/div>\n\n\n\n

Conclusion<\/span><\/p>\n\n\n\n

At Imprima, we believe that LLMs can really transform the Due Diligence process, not only for mundane tasks such as redaction, but also to extract key data relevant for DD (our Smart Summaries<\/a><\/strong> tool is a first step towards the goal). Though many worry about AI\u2019s potential threats to humanity (Runaway AI Is an Extinction Risk, Experts Warn<\/a><\/strong> ), others mostly focus on its benefits for business (Can AI help you solve problems?<\/a><\/strong>), and so do we.<\/p>\n\n\n\n

To end on a lighter note: AI is not a nuclear weapon, even though the rhetoric seems to sometimes indicate that (a quiz recently published in the NYT is testament to that: A.I. or Nuclear Weapons: Can You Tell These Quotes Apart?<\/a><\/strong>)<\/p>\n\n\n\n

Next week we will discuss how accurate and reliable LLM-based redaction is, by showing results on actual DD data, and how it works in practice.<\/p>\n\n\n\n

Stay tuned!<\/p>\n\n\n\n

<\/div>\n\n\n\n

Are you looking for a VDR with fully integrated redaction software which leverages AI? Speak to our sales team<\/a> or check out our Smart Redaction page here<\/a>.<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

Technology deep dive (but don\u2019t be put off if you are a non-technical person, we will keep it high-level) Last week we discussed how time limits and the likelihood for error make manual redaction very challenging, and why even automated redaction is a difficult nut to crack, at least with traditional search methods, and \u201cRegular […]<\/p>\n","protected":false},"author":8,"featured_media":22097,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[169,170,163,171],"tags":[],"class_list":["post-22087","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-artificial-intelligence","category-legal","category-ma","category-vdr"],"yoast_head":"\nLarge Language Models for Automated Redaction - Imprima<\/title>\n<meta name=\"description\" content=\"Machine Learning and Large Language Models are the basis of Imprima's Smart Redaction tool, integrated into the Virtual Dataroom.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.imprima.com\/blog\/automated-redaction-llm\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Large Language Models for Automated Redaction\" \/>\n<meta property=\"og:description\" content=\"Machine Learning and Large Language Models are the basis of Imprima's Smart Redaction tool, integrated into the Virtual Dataroom.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.imprima.com\/blog\/automated-redaction-llm\" \/>\n<meta property=\"og:site_name\" content=\"Imprima\" \/>\n<meta property=\"article:published_time\" content=\"2023-06-13T08:29:37+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-06-19T11:11:57+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.imprima.com\/wp-content\/uploads\/2023\/06\/LLM-blog-header-v1.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1500\" \/>\n\t<meta property=\"og:image:height\" content=\"749\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Marcus Tolan\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Marcus Tolan\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.imprima.com\/blog\/automated-redaction-llm#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.imprima.com\/blog\/automated-redaction-llm\"},\"author\":{\"name\":\"Marcus Tolan\",\"@id\":\"https:\/\/www.imprima.com\/#\/schema\/person\/91ac413cefc7cd6c4ec7034f7cef47f2\"},\"headline\":\"Large Language Models for Automated Redaction\",\"datePublished\":\"2023-06-13T08:29:37+00:00\",\"dateModified\":\"2023-06-19T11:11:57+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.imprima.com\/blog\/automated-redaction-llm\"},\"wordCount\":781,\"publisher\":{\"@id\":\"https:\/\/www.imprima.com\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.imprima.com\/blog\/automated-redaction-llm#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.imprima.com\/wp-content\/uploads\/2023\/06\/LLM-blog-header-v1.jpg\",\"articleSection\":[\"Artificial Intelligence\",\"Legal\",\"M&A\",\"VDR\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.imprima.com\/blog\/automated-redaction-llm\",\"url\":\"https:\/\/www.imprima.com\/blog\/automated-redaction-llm\",\"name\":\"Large Language Models for Automated Redaction - Imprima\",\"isPartOf\":{\"@id\":\"https:\/\/www.imprima.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.imprima.com\/blog\/automated-redaction-llm#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.imprima.com\/blog\/automated-redaction-llm#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.imprima.com\/wp-content\/uploads\/2023\/06\/LLM-blog-header-v1.jpg\",\"datePublished\":\"2023-06-13T08:29:37+00:00\",\"dateModified\":\"2023-06-19T11:11:57+00:00\",\"description\":\"Machine Learning and Large Language Models are the basis of Imprima's Smart Redaction tool, integrated into the Virtual Dataroom.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.imprima.com\/blog\/automated-redaction-llm#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.imprima.com\/blog\/automated-redaction-llm\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.imprima.com\/blog\/automated-redaction-llm#primaryimage\",\"url\":\"https:\/\/www.imprima.com\/wp-content\/uploads\/2023\/06\/LLM-blog-header-v1.jpg\",\"contentUrl\":\"https:\/\/www.imprima.com\/wp-content\/uploads\/2023\/06\/LLM-blog-header-v1.jpg\",\"width\":1500,\"height\":749,\"caption\":\"Large Language Model Graphic\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.imprima.com\/blog\/automated-redaction-llm#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.imprima.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Large Language Models for Automated Redaction\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.imprima.com\/#website\",\"url\":\"https:\/\/www.imprima.com\/\",\"name\":\"Imprima\",\"description\":\"Secure Online Data Room Services by Imprima\",\"publisher\":{\"@id\":\"https:\/\/www.imprima.com\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.imprima.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.imprima.com\/#organization\",\"name\":\"Imprima\",\"url\":\"https:\/\/www.imprima.com\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.imprima.com\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.imprima.com\/wp-content\/uploads\/2021\/05\/imprima-logo-new.svg\",\"contentUrl\":\"https:\/\/www.imprima.com\/wp-content\/uploads\/2021\/05\/imprima-logo-new.svg\",\"width\":507.43,\"height\":149.18,\"caption\":\"Imprima\"},\"image\":{\"@id\":\"https:\/\/www.imprima.com\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.imprima.com\/#\/schema\/person\/91ac413cefc7cd6c4ec7034f7cef47f2\",\"name\":\"Marcus Tolan\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Large Language Models for Automated Redaction - Imprima","description":"Machine Learning and Large Language Models are the basis of Imprima's Smart Redaction tool, integrated into the Virtual Dataroom.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.imprima.com\/blog\/automated-redaction-llm","og_locale":"en_US","og_type":"article","og_title":"Large Language Models for Automated Redaction","og_description":"Machine Learning and Large Language Models are the basis of Imprima's Smart Redaction tool, integrated into the Virtual Dataroom.","og_url":"https:\/\/www.imprima.com\/blog\/automated-redaction-llm","og_site_name":"Imprima","article_published_time":"2023-06-13T08:29:37+00:00","article_modified_time":"2023-06-19T11:11:57+00:00","og_image":[{"width":1500,"height":749,"url":"https:\/\/www.imprima.com\/wp-content\/uploads\/2023\/06\/LLM-blog-header-v1.jpg","type":"image\/jpeg"}],"author":"Marcus Tolan","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Marcus Tolan","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.imprima.com\/blog\/automated-redaction-llm#article","isPartOf":{"@id":"https:\/\/www.imprima.com\/blog\/automated-redaction-llm"},"author":{"name":"Marcus Tolan","@id":"https:\/\/www.imprima.com\/#\/schema\/person\/91ac413cefc7cd6c4ec7034f7cef47f2"},"headline":"Large Language Models for Automated Redaction","datePublished":"2023-06-13T08:29:37+00:00","dateModified":"2023-06-19T11:11:57+00:00","mainEntityOfPage":{"@id":"https:\/\/www.imprima.com\/blog\/automated-redaction-llm"},"wordCount":781,"publisher":{"@id":"https:\/\/www.imprima.com\/#organization"},"image":{"@id":"https:\/\/www.imprima.com\/blog\/automated-redaction-llm#primaryimage"},"thumbnailUrl":"https:\/\/www.imprima.com\/wp-content\/uploads\/2023\/06\/LLM-blog-header-v1.jpg","articleSection":["Artificial Intelligence","Legal","M&A","VDR"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.imprima.com\/blog\/automated-redaction-llm","url":"https:\/\/www.imprima.com\/blog\/automated-redaction-llm","name":"Large Language Models for Automated Redaction - Imprima","isPartOf":{"@id":"https:\/\/www.imprima.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.imprima.com\/blog\/automated-redaction-llm#primaryimage"},"image":{"@id":"https:\/\/www.imprima.com\/blog\/automated-redaction-llm#primaryimage"},"thumbnailUrl":"https:\/\/www.imprima.com\/wp-content\/uploads\/2023\/06\/LLM-blog-header-v1.jpg","datePublished":"2023-06-13T08:29:37+00:00","dateModified":"2023-06-19T11:11:57+00:00","description":"Machine Learning and Large Language Models are the basis of Imprima's Smart Redaction tool, integrated into the Virtual Dataroom.","breadcrumb":{"@id":"https:\/\/www.imprima.com\/blog\/automated-redaction-llm#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.imprima.com\/blog\/automated-redaction-llm"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.imprima.com\/blog\/automated-redaction-llm#primaryimage","url":"https:\/\/www.imprima.com\/wp-content\/uploads\/2023\/06\/LLM-blog-header-v1.jpg","contentUrl":"https:\/\/www.imprima.com\/wp-content\/uploads\/2023\/06\/LLM-blog-header-v1.jpg","width":1500,"height":749,"caption":"Large Language Model Graphic"},{"@type":"BreadcrumbList","@id":"https:\/\/www.imprima.com\/blog\/automated-redaction-llm#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.imprima.com\/"},{"@type":"ListItem","position":2,"name":"Large Language Models for Automated Redaction"}]},{"@type":"WebSite","@id":"https:\/\/www.imprima.com\/#website","url":"https:\/\/www.imprima.com\/","name":"Imprima","description":"Secure Online Data Room Services by Imprima","publisher":{"@id":"https:\/\/www.imprima.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.imprima.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.imprima.com\/#organization","name":"Imprima","url":"https:\/\/www.imprima.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.imprima.com\/#\/schema\/logo\/image\/","url":"https:\/\/www.imprima.com\/wp-content\/uploads\/2021\/05\/imprima-logo-new.svg","contentUrl":"https:\/\/www.imprima.com\/wp-content\/uploads\/2021\/05\/imprima-logo-new.svg","width":507.43,"height":149.18,"caption":"Imprima"},"image":{"@id":"https:\/\/www.imprima.com\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.imprima.com\/#\/schema\/person\/91ac413cefc7cd6c4ec7034f7cef47f2","name":"Marcus Tolan"}]}},"_links":{"self":[{"href":"https:\/\/www.imprima.com\/wp-json\/wp\/v2\/posts\/22087","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.imprima.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.imprima.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.imprima.com\/wp-json\/wp\/v2\/users\/8"}],"replies":[{"embeddable":true,"href":"https:\/\/www.imprima.com\/wp-json\/wp\/v2\/comments?post=22087"}],"version-history":[{"count":0,"href":"https:\/\/www.imprima.com\/wp-json\/wp\/v2\/posts\/22087\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.imprima.com\/wp-json\/wp\/v2\/media\/22097"}],"wp:attachment":[{"href":"https:\/\/www.imprima.com\/wp-json\/wp\/v2\/media?parent=22087"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.imprima.com\/wp-json\/wp\/v2\/categories?post=22087"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.imprima.com\/wp-json\/wp\/v2\/tags?post=22087"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}