Go Back to Case Studies

Star Alliance Airline Soars with Alteryx Server

At a Glance

1000+

Workflows Governed

10

Departments Migrated

25

Alteryx Champions Trained

Overview

Service

Data Engineering & Infrastructure

Industry

Airlines

Stack

Machine Learning & Gen AI

Gen AI in Pharma: Medical Insights Agent

Published on Feb 07, 2025

Author(s)

Ethan Pirso

Analytics Consultant

Scott Carr

Co-Founder & Managing Partner

Technology Stack

The Challenge

A global pharmaceutical company faced difficulties processing and analyzing vast amounts of medical insights gathered from healthcare professionals (HCPs). Without automated data pipelines, insight generation was slow, making it difficult to track prescribing behaviors, patient perceptions, and emerging medical trends. Teams relied on manual processes, delaying critical decisions and limiting visibility into key patterns.

The Solution

Compass Analytics implemented an AI-powered solution, the first of its kind at our client. We built data pipelines using Snowflake for scalable storage and Dataiku for advanced analytics. The solution automated the ingestion, transformation, and categorization of HCP insights, applying machine learning models for structured summarization. A large language model (LLM) chatbot was integrated into the Dataiku Answers web app, enabling real-time knowledge retrieval. Power BI dashboards visualized automated summaries and topic modeling results, giving stakeholders a clear and actionable view of prescribing behaviors and medical trends.

Impact

Stack

Our Client's Context

Our client, a global pharmaceutical manufacturer needed a streamlined way to extract and analyze insights from healthcare professionals while ensuring regulatory compliance. Their existing processes were manual and resource-intensive, requiring significant effort to categorize insights and generate reports.

Sales, research, and marketing teams operated in silos, each relying on different data sources. The lack of a centralized system made it difficult to automate data ingestion, classify insights, and provide real-time access to critical information. To overcome these challenges, the company partnered with Compass Analytics to implement a AI-driven solution including automation, predictive modeling, and real-time knowledge retrieval.

The Hidden Complexity of Medical Insights

Data Overload

With thousands of HCP reports and continuous feedback, the company struggled to efficiently process and analyze vast amounts of medical data.

Manual Processes & Inefficiencies

Manual data handling required extensive effort to consolidate, categorize, and summarize prescribing trends, slowing insight generation.

Lack of Real-Time Insights

Without automation, critical trends in prescribing behavior and patient perceptions were often identified too late, limiting proactive decision-making.

Unlocking Medical Insights with AI

Compass Analytics developed an AI-powered system that automated insight extraction, categorization, and knowledge retrieval. By integrating Snowflake for secure storage and Dataiku for advanced analytics, the company established a robust pipeline that streamlined data ingestion and transformation.

A custom-built LLM chatbot within the Dataiku Answers web app provided real-time access to a knowledge base, ensuring teams could retrieve relevant insights instantly. Insights and topic modeling results from LDA/LLM-driven analysis were automatically labeled using coherence scores to determine optimal topic segmentation. These findings were deployed via a custom Dataiku Plugin developed by Compass and visualized in Power BI.

The Dataiku Answers chatbot provides real-time responses to complex medical queries, enabling teams to retrieve critical insights, prescribing trends, and patient perceptions effortlessly. Powered by LLM and integrated with Snowflake, it streamlines decision-making with instant, AI-driven knowledge retrieval.
We transformed custom analytics into a reusable Topic Modeling plugin, enabling seamless deployment across projects and Dataiku instances—eliminating the need for coding while ensuring scalability and efficiency.
This visualization highlights the distribution of healthcare professional (HCP) insights across key medical topics. Using AI-powered topic modeling, insights are automatically categorized into themes such as Cardiovascular Treatment Innovations, Educational Concerns in Clinical Practice, Treatment Adherence Concerns, and Promising Clinical Therapies—enabling faster, insights from unstructured data.

Transforming Data into Actionable Insights

By implementing robust data pipelines, real-time knowledge retrieval, and advanced topic modeling, the company transformed its ability to extract, summarize, and analyze medical insights. The integration of Snowflake, Dataiku, and Power BI enabled streamlined operations, improved insight accuracy, and faster decision-making. With a scalable AI solution in place, the company gained enhanced visibility into prescribing behaviors, proactive strategy development, and more efficient cross-team collaboration.

AI-Driven Insight Summarization

Automated summarization of medical insights enabled faster reporting and improved visibility into HCP prescribing behaviors. LLM recipes in Dataiku categorized and summarized insights, reducing manual processing time.

Cognitive Automation for Streamlined Data Processing

Eliminated manual effort in data ingestion, transformation, and topic modeling. Snowflake stored structured and unstructured HCP data, while a custom Dataiku Plugin classified insights using LDA/LLM-driven topic modeling. Analysts and business teams could focus on strategy rather than data processing.

Real-Time Knowledge Access with LLM Chatbots

Sales, marketing, and research teams gained instant access to a medical insights knowledge base. An LLM-based RAG chatbot retrieved relevant insights within the Dataiku Answers web app, enabling seamless integration with Snowflake data. Decision-making accelerated, and cross-team collaboration improved by reducing reliance on manual research and reporting.

Interested in learning more?

Fill out the form below and we'll get back to you as soon as possible.

William Chan

Founder & CEO

Schedule a Call

First Name*

Last Name*

Business Email Address*

Company*

Industry*

Job Title*

Area of Interest*

Fields with an * are mandatory

Thank you for registering. We'll be in touch with event details.

Oops! Something went wrong while submitting the form.