Innovation in Exploration09/16/2019
As we talked about in our recent Dear Data blogs, our Analytics team uses data in innovative ways that bring value to healthcare organizations and the patients they serve, value like improving clinic operations, increasing quality of care, decreasing accounts receivable, and more. Today we are going to focus on a recent interesting data challenge and the value it provided the organization.
Situation
We were working with UCSF’s Medical Education Team to gather insight into their education program and curriculum. They were trying to answer questions like:
Answering these types of questions facilitates meeting regulatory requirements, but also allows the team to better plan going forward.
Solution
Through talking with the team, we identified the need to better search across their existing data set, by creating a “google-like” search within a Tableau application. To do this, we faced two main challenges:
Challenge #1: Getting the Data
Tableau users will appreciate its ability to connect to a variety of data sources with little more than the click of a button. However, an API-based data source like Ilios presents a bit more of a challenge. To overcome this hurdle, we took advantage of Tableau’s Web Data Connector or WDC (https://tableau.github.io/webdataconnector/), which provides a JavaScript interface for querying web APIs to produce Tableau extracts.
WDC is created and maintained by Tableau and integrates well with the product, but unlike standard database connections, implementing with the WDC isn’t exactly plug-and-play. Among the considerations while developing for the Ilios API with WDC were:
Challenges notwithstanding, 1100 lines of JavaScript later, we had a fully-functional API-driven data source. Data successfully extracted, it was time to tackle search.
Challenge #2: ‘Google-like’ Searching
Searching sounds simple, right? It is really about creating relationships between various data elements and determining, what parameters and Boolean logic to apply. You are right, the Tableau Boolean logic was not the tough part. The tough part was making it run quickly! Our initial iteration took over 30 minutes to return results – imagine typing something into Google and having to wait for 30(!!) minutes to see the results. Our second attempt brought the time down to 5 minutes, something that we thought was a pretty good improvement from 30 minutes, but we knew we could do better!
The finished product returns search results anywhere from 10-60 seconds – still not quite like Google but much closer. The optimal Tableau configuration for performance involved creating a second search data source that was a slimmed down version of the primary data source. The search data source contained only those fields that were used to match the keyword Boolean search and was used as a filter throughout the application. If you haven’t already, check out the Tableau Desktop’s built in Performance Monitoring tool (https://onlinehelp.tableau.com/current/pro/desktop/en-us/perf_record_create_desktop.htm ), as analyzing this was key to optimizing workbook performance.
Cheers to New Challenges
While some customers need a dashboard and the ability to quickly see key performance indicators, others need the ability to ask questions of their data. The value derived from the data customers have is use case specific and that is where the fun really starts. We love exploring new data sets, new questions and challenges. Do you have a challenge you would like to share with us?
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Fermentum leo vel orci porta non pulvinar. Luctus venenatis lectus magna fringilla urna porttitor. Sodales ut eu sem integer vitae justo eget magna. Ultrices eros in cursus turpis massa tincidunt dui. Urna duis convallis convallis tellus id. Sed elementum tempus egestas sed sed risus pretium quam. Aliquam nulla facilisi cras fermentum odio eu feugiat pretium. Tellus in metus vulputate eu scelerisque. Sem nulla pharetra diam sit. Urna et pharetra pharetra massa massa ultricies mi quis hendrerit. Sed risus ultricies tristique nulla. Euismod lacinia at quis risus sed vulputate odio ut. Mauris rhoncus aenean vel elit. Tortor posuere ac ut consequat semper viverra nam libero. Pellentesque habitant morbi tristique senectus et netus et. Sem integer vitae justo eget magna fermentum iaculis eu non. Adipiscing diam donec adipiscing tristique. Massa sapien faucibus et molestie ac feugiat sed lectus vestibulum. Id diam vel quam elementum pulvinar.
Lorem ipsum dolor sit amet. Lobortis elementum nibh tellus molestie. Blandit volutpat maecenas volutpat blandit aliquam etiam erat velit scelerisque. Tellus cras adipiscing enim eu turpis egestas pretium aenean. Feugiat nisl pretium fusce id velit ut. Auctor urna nunc id cursus. Velit dignissim sodales ut eu sem integer vitae justo. Pellentesque adipiscing commodo elit at imperdiet dui accumsan sit. Nisi vitae suscipit tellus mauris. Interdum varius sit amet mattis vulputate enim. At risus viverra adipiscing at in tellus integer. Nunc scelerisque viverra mauris in aliquam sem. Convallis posuere morbi leo urna. In vitae turpis massa sed elementum tempus. Cursus euismod quis viverra nibh cras. Eros donec ac odio tempor orci dapibus ultrices in. Augue ut lectus arcu bibendum. Eget sit amet tellus cras adipiscing enim. Tincidunt praesent semper feugiat nibh sed pulvinar proin gravida.
