This CLIENT is a financial tech company which enables banks to actively manage their portfolios by rating, valuing, buying and selling loans through their technology platform. CLIENT is headquartered in Boston, MA with offices located throughout the United States, Europe, and South America.
CLIENT is a pioneer and innovator in the commercial and residential loan industries. Upon inception in 2000, CLIENT developed and deployed the first online loan sale platform. This groundbreaking platform enabled millions of imaged documents to be accessed virtually through a secure document sharing application.
INTRICITY is a team of specialized Data Management, Data Warehousing, and Business Intelligence experts. The team members at INTRICITY have been handpicked over the course of 20 years, and represent the top talent globally in Data-oriented disciplines.
Redshift to Snowflake
Intricity was introduced to the CLIENT as part of a query optimization engagement being conducted by Looker. Their BI layer was leveraging Redshift to run the queries. At this time CLIENT was building their next generation platform but kept running into significant issues with the query performance for their dashboards. Intricity was asked by Looker to investigate the queries being issued to see if any optimizations could be done to their environment.
Several factors were contributing to the query latency
- The data was not well modeled to deliver performant queries
- Their dashboards were very large creating a large body of queries to kick off all at once
- The SQL being generated by the LookML was producing some case statements which made the queries very expansive
After reviewing the queries, it was clear improvements could be made, however, the queries were not so egregious as to justify the slow responses from Redshift. Intricity needed a baseline to determine whether something else was going on. The Intricity team decided to run a mini-investigation using Snowflake as the baseline. Having conducted so many POCs, Intricity had all the environmental details ready for such an investigation and got approval from CLIENT to attempt the comparison.
Read the full Case Study here: https://view.attach.io/Hk4iIBQMr