Get AI ready

Chris_Wynder · July 25

Or How to create safe, customer ready GenAI Apps

Being AI ready really comes down the question “How do I protect patient data while gaining the power of Large Language Models and General Pre-trained Transformers?”

Generative AI teases the potential for massive efficiencies and insight especially in industries where deep subject matter expertise is hard to find. There are key industries that would gain from GenAI; Medical technology, Agriculture/Animal husbandry, and Advanced Manufacturing.

What benefits come from GenAI in regulated industries?

Untapped potential: Unstructured data encompasses text documents, social media conversations, images, and audio recordings — a rich source of insights often overlooked due to its complexity. AI orchestration platforms address this by providing tools for data ingestion, cleaning, and pre-processing.
Streamlining the Workflow: AI orchestration automates the tasks of extracting data from diverse sources, transforming it into a structured format, and feeding it to AI models in a timely and efficient manner. This eliminates manual intervention and streamlines the entire AI development lifecycle.
Maximizing AI Performance: By making unstructured data usable, AI orchestration unlocks the full potential of AI models. Structured data allows models to identify patterns and relationships more effectively, leading to more accurate predictions, improved decision-making, and enhanced AI performance across various applications.

However for each of these industries there are real risks that are currently a black box for Large Language Models that stymie innovation.

As a Software developer the key to taking advantage of Generative AI is the orchestration layer that connects industry specific data to “AI” to create “Generated insight”. AI orchestration is the key to innovative products that bring value to organizations.

The companies that incorporate AI orchestrators into their applications will be the new standard bearers of B2B software.

An AI Orchestrator powers innovation by allowing key sensitive data to provide context to a query of a general knowledge base without risk of data exposure.

In simplest terms what you really need to do is take generic advice from GenAI tools and make it tangible for a specific single person. That person has a huge personal corpus of knowledge and is looking for advice on moving forward and solving their specific problem not just some crowd-sourced information. Satisfying this specific person requires feeding “GenAI tools; LLMs, GPTs” with that persons’ most private and sensitive data.

What data is both necessary and too valuable to simply be given to the large SaaS AI?

Lets take Healthcare/Pharma as an example. Key innovations around streamlining patient experience and identifying novel therapeutics are extraordinarily risky with today’s LLM based AI systems.

What are the key capabilities of an AI orchestrator :

· Data Sandboxing- current systems combine large amounts of data across multiple points of context- by design. This is a real privacy risk.

Solution: Create isolated environments (sandboxes) where patient data is processed by the GAI engine. This prevents unauthorized access to patient data from other parts of the system.

· Privacy-Preserving Techniques-for individual hospitals, deep understanding of their proprietary data requires context for aligned interests; e.g. rare disease research only specific elements are necessary

Solution:: Explore techniques like federated learning that allow the GAI app to function without directly revealing individual patient information. This could take the form of “Small Language Models” that allow tokenized access for a LLM to query a restricted dataset.

· Model Explain-ability-: Ensure the GenAI model’s decision-making process is transparent and understandable. This helps doctors assess the reliability of the app’s recommendations and identify potential biases.

In practical terms AI orchestration consists having capabilities in three distinct areas: Cyber-security, Machine ready data that is organized and classified.

AI orchestration_technical capabilities.jpg

Innovation without the risk

AI orchestration acts like the maestro of a data symphony. For example in healthcare, imagine all the various data sources — clinical trials, research databases, patient information, electronic health records, and even social media sentiment around certain drugs- being available to be analyzed and optimized without PHI or intellectual property risk.

The good news is that OpenText has the pieces available today to developers: