Title

TTL: A transference, transformation and loading approach for active monitoring

Date of this Version

8-29-2011

Document Type

Conference Paper

Publication Details

Citation only.

Chavez-Mora, E. & Finnie, G. (2011). TTL: A transference, transformation and loading approach for active monitoring. Presented at the13th international conference on Data Warehousing and Knowledge Discovery (DaWaK'11), Toulouse, France.

Access the conference website.

2011 HERDC submission. FoR code: 080609

© Copyright Emma Chavez-Mora & Gavin Finnie, 2011

ISBN

9783642235436

Abstract

In Data Warehouse (DW) environments, operational processes move data from sources to the warehouse. This includes data export, preparation, and loading usually performed using Extraction, Transformation and Loading (ETL) tools. Past research has treated DW ”as collections of materialized views” whose data is regularly refreshed and locally stored [1]. Requirements have changed and real time transactions are required to support on-line operational decision making. Traditional DW systems may impose unacceptable delays due to their batch nature. ETL techniques are difficult to scale up to address the challenge of data loading, performance and low latency to provide real-time decision support. We propose a new approach for designing real-time DW in which traditional ETL does not apply. Data is pre-analysed by agents in each data source before being pushed as needed to the DW. The approach has been evaluated in a simulated environment and some of the results are discussed here.

This document is currently not available here.

Share

COinS
 

This document has been peer reviewed.