Innovation in Exploration - Prominence
Innovation in Exploration09/16/2019
AnalyticsAnalytics TeamCultureData GovernanceDeploymentEpic ServicesEventsRevenue Cycle All posts

As we talked about in our recent Dear Data blogs, our Analytics team uses data in innovative ways that bring value to healthcare organizations and the patients they serve, value like improving clinic operations, increasing quality of care, decreasing accounts receivable, and more. Today we are going to focus on a recent interesting data challenge and the value it provided the organization.


We were working with UCSF’s Medical Education Team to gather insight into their education program and curriculum. They were trying to answer questions like:

Answering these types of questions facilitates meeting regulatory requirements, but also allows the team to better plan going forward.


Through talking with the team, we identified the need to better search across their existing data set, by creating a “google-like” search within a Tableau application. To do this, we faced two main challenges:

Challenge #1: Getting the Data

Tableau users will appreciate its ability to connect to a variety of data sources with little more than the click of a button. However, an API-based data source like Ilios presents a bit more of a challenge. To overcome this hurdle, we took advantage of Tableau’s Web Data Connector or WDC (, which provides a JavaScript interface for querying web APIs to produce Tableau extracts.

WDC is created and maintained by Tableau and integrates well with the product, but unlike standard database connections, implementing with the WDC isn’t exactly plug-and-play. Among the considerations while developing for the Ilios API with WDC were:

Challenges notwithstanding, 1100 lines of JavaScript later, we had a fully-functional API-driven data source. Data successfully extracted, it was time to tackle search.

Challenge #2: ‘Google-like’ Searching

Searching sounds simple, right? It is really about creating relationships between various data elements and determining, what parameters and Boolean logic to apply.  You are right, the Tableau Boolean logic was not the tough part.  The tough part was making it run quickly!  Our initial iteration took over 30 minutes to return results – imagine typing something into Google and having to wait for 30(!!) minutes to see the results.  Our second attempt brought the time down to 5 minutes, something that we thought was a pretty good improvement from 30 minutes, but we knew we could do better!

The finished product returns search results anywhere from 10-60 seconds – still not quite like Google but much closer.  The optimal Tableau configuration for performance involved creating a second search data source that was a slimmed down version of the primary data source.  The search data source contained only those fields that were used to match the keyword Boolean search and was used as a filter throughout the application.  If you haven’t already, check out the Tableau Desktop’s built in Performance Monitoring tool ( ), as analyzing this was key to optimizing workbook performance.

Cheers to New Challenges

While some customers need a dashboard and the ability to quickly see key performance indicators, others need the ability to ask questions of their data.  The value derived from the data customers have is use case specific and that is where the fun really starts.  We love exploring new data sets, new questions and challenges. Do you have a challenge you would like to share with us?

Recent Posts
Community service lies at the heart of our mission and values. We believe in giving back to the communities that support us and fostering a culture o…
Informatica World 2024 was a groundbreaking event that brought together data enthusiasts, experts, and innovators from across the globe to discuss …
Our team recently gathered in Nashville, TN, for our highly anticipated Summit. More than just a meeting, our Summits embody the essence of our compa…
The Prominence Advisors culture team has introduced something exciting and fun this year: Pod Spirit Week! For the first time, the Prominence Pods…
We're proud to be named one of Chicago's Best and Brightest Companies to Work For! For the 11th year in a row, we're honored to join this list of top…
© 2024 Prominence Advisors, Inc, All Rights Reserved