The solution has 6 databases on 2 local servers and 2 servers in Azure. apart from databases supporting embedded services such as SQL Server Reporting Services, replication, Data Collection etc.
The databases contain information about products collected from sites, namely: name, ID, model, manufacturer, category, price, short description, ratings and reviews etc. Processed and aggregated data is stored in the databases aimed at further usage for business analysis. These data warehouses are needed for calculation of certain macro indicators, such as the dynamics of the products number on the website, manufacturers’ ranking, price index, etc. The aggregated data is replicated to a local webserver where it is accessed for customers via SQL Server Reporting Services Reports and into Azure SQL Database where it is accessed via a web-site developed using ASP.NET technology and DevExpress controls.
More than 100 SQL Server Agent jobs perform tasks for the database maintenance, replication, totals calculation, keeping up to date the list of proxy servers, etc.
Tools and Technologies