Data Archival using Automated Sliding Window Partitioning - Part I
Introduction One of the most common requirement in day-to-day production environment maintenance is data archival. As, the amount of data grows due to constant inflow of data. The overall performance of the application might also go down due to the ever increasing number of records in the underlying database tables. This is where data archival comes into picture. Data archival simply means to move the data from the table which is being used by any downstream application to an archival table. Ofcourse, it needs to be ensured that the data archival process is well thought off in terms of its impact on the data available for consumption for downstream applications. It means for example, we do not want a scenario wherein a report was generated on the yearly sales data and we archived 6 months worth of sales data, thus ending up showing only 6 months sales in an yearly sales report. For this post, we will focus on the underlying concept of the 'sliding window partitioning...