Case Study: Teradata Conversion
Written by Intricity
Teradata to Snowflake Migration at Major Retailer
Intricity worked with a private department store based on the East Coast of the US with just under 300 stores located in 16 states and a growing digital presence. The retailer has a wide assortment of national brands and private label fashion apparel, shoes and accessories for all age groups along with top name cosmetics, a wedding registry, and a large selection of quality merchandise for the home.
Intricity is a team of specialized Data Management, Data Warehousing, and Business Intelligence experts. The team members at Intricity have been handpicked over the course of 20 years, and represent the top talent globally in Data oriented disciplines.
Challenge and Wins
The retailer had been a Teradata customer for 8 years. Over time the query speed of the retailer’s Teradata environment degraded, resulting in unacceptable turn around times for data science queries. The situation weighed down on the relationship between business and IT. Additionally, the retailer was faced with the constraints of an ever encroaching Amazon footprint in the retail space. The retailer needed better inventory and customer analytic performance to ensure that they could compete with Amazon’s market presence. They decided to engage in a digital transformation which clearly Teradata was not capable of supporting. An evaluation was set up to test Snowflake against the same Monday morning stresses that Teradata had to endure. The results were a “no brainer” for them. Later in the sales cycle Google BigQuery got evaluated, but they failed to produce the same level of simplicity and simplicity of conversion.
The retailer’s Teradata instance had 8 years of established integration code. To get their arms around the effort they produced complexity counts around the content currently connected to Teradata like utilities, initial load, ingestion, transfer & scheduling, tables, views, and data volumes. Intricity leveraged these statistics to produce a fixed priced “lift and shift” migration proposal.
The retailer’s original Data Warehouse technology stack was migrated to Teradata in 2010. This original migration brought a lot of legacy code which was written for that original deployment and was at least 20 years old. However, this code was being leveraged in Teradata in 2018. The code was written in a combination of SQL, Job Information Language, and Shell Scripts. The complexity of this integration was very high as it was deployed with extensive logging, self-healing routines, and code segments some more than 20 years old.
Over the 20 year period many code segments, and their relationship to the larger integration picture, had been forgotten. Thus the migration of this customer’s deployment required an ability to drill into the hidden complexities within the code to ensure the migration completed effectively. This was especially the case with the code that was migrated into Teradata from their previous legacy environment, much of which was not even being used. This code was mixed in with all the current code but no determination was available on whether these legacy code segments were being used.
Intricity leveraged BladeBridge to automate the migration of 80% of the SQL, JIL, Shell Scripts, and Teradata code to Snowflake by using its automated tooling. The tooling provided a cycle where code patterns could be batched, converted, tested, and further reviewed for erroring code patterns. This cycle repeated itself until all the patterns had been migrated.
By leveraging BladeBridge's automation, Intricity was able to zero into the code segments that were strictly unique or required deeper individual validation.
In addition to migrating the code to work in Snowflake, Intricity also was able to isolate and retire code segments that were not being presently used. This enabled the retailer to emerge with a much cleaner code base than they originally had.
Call to Action
Intricity has created a repeatable framework for conducting these migrations which has a proven track record. This framework is used not just for Teradata migrations but for any source system to Snowflake. For a short description of how this framework is specifically used with Teradata see Intricity’s Teradata to Snowflake Migration slick.
Who is Intricity?
Intricity is a specialized selection of over 100 Data Management Professionals, with offices located across the USA and Headquarters in New York City. Our team of experts has implemented in a variety of Industries including, Healthcare, Insurance, Manufacturing, Financial Services, Media, Pharmaceutical, Retail, and others. Intricity is uniquely positioned as a partner to the business that deeply understands what makes the data tick. This joint knowledge and acumen has positioned Intricity to beat out its Big 4 competitors time and time again. Intricity’s area of expertise spans the entirety of the information lifecycle. This means when you’re problem involves data; Intricity will be a trusted partner. Intricity's services cover a broad range of data-to-information engineering needs:
What Makes Intricity Different?
While Intricity conducts highly intricate and complex data management projects, Intricity is first a foremost a Business User Centric consulting company. Our internal slogan is to Simplify Complexity. This means that we take complex data management challenges and not only make them understandable to the business but also make them easier to operate. Intricity does this through using tools and techniques that are familiar to business people but adapted for IT content.
Intricity authors a highly sought after Data Management Video Series targeted towards Business Stakeholders at https://www.intricity.com/videos. These videos are used in universities across the world. Here is a small set of universities leveraging Intricity’s videos as a teaching tool:
Talk With a Specialist
If you would like to talk with an Intricity Specialist about your particular scenario, don’t hesitate to reach out to us. You can write us an email: email@example.com
(C) 2020 by Intricity, LLC
This content is the sole property of Intricity LLC. No reproduction can be made without Intricity's explicit consent.
Intricity, LLC. 244 Fifth Avenue Suite 2026 New York, NY 10001
Phone: 212.461.1100 • Fax: 212.461.1110 • Website: www.intricity.com