On Deriving Net Change Information From Change Logs - The DELTALAYER-Algorithm.

S.B. Rinderle, M. Jurisch, M.U. Reichert

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

13 Citations (Scopus)
20 Downloads (Pure)

Abstract

The management of change logs is crucial in different areas of information systems like data replication, data warehousing, and process management. One barrier that hampers the (intelligent) use of respective change logs is the possibly large amount of unnecessary and redundant data provided by them. In particular, change logs often contain information about changes which actually have had no effect on the original data source (e.g., due to subsequently applied, overriding change operations). Typically, such inflated logs lead to difficulties with respect to system performance, data quality or change comparability. In order to deal with this we introduce the DeltaLayer algorithm. It takes arbitrary change log information as input and produces a cleaned output which only contains the net change effects; i.e., the produced log only contains information about those changes which actually have had an effect on the original source. We formally prove the minimality of our algorithm, and we show how it can be applied in different domains; e.g., the post-processing of differential snapshots in data warehouses or the analysis of conflicting changes in process management systems. Altogether the ability to purge change logs from unnecessary information provides the basis for a more intelligent handling of these logs.
Original languageUndefined
Title of host publicationProceedings 12th GI-Conference on Database Systems in Business, Technology and Web (BTW'07)
Place of PublicationBonn
PublisherKoellen Verlag
Pages364-381
Number of pages18
ISBN (Print)978-3-88579-197-3
Publication statusPublished - Mar 2007

Publication series

NameLecture Notes in Informatics (LNI)
PublisherKoellen Verlag
Number1
VolumeLNI-103
ISSN (Print)1617-5468

Keywords

  • SCS-Services
  • METIS-241712
  • IR-66633
  • EWI-8222

Cite this

Rinderle, S. B., Jurisch, M., & Reichert, M. U. (2007). On Deriving Net Change Information From Change Logs - The DELTALAYER-Algorithm. In Proceedings 12th GI-Conference on Database Systems in Business, Technology and Web (BTW'07) (pp. 364-381). (Lecture Notes in Informatics (LNI); Vol. LNI-103, No. 1). Bonn: Koellen Verlag.
Rinderle, S.B. ; Jurisch, M. ; Reichert, M.U. / On Deriving Net Change Information From Change Logs - The DELTALAYER-Algorithm. Proceedings 12th GI-Conference on Database Systems in Business, Technology and Web (BTW'07). Bonn : Koellen Verlag, 2007. pp. 364-381 (Lecture Notes in Informatics (LNI); 1).
@inproceedings{c3045e7643884c1985f6219fce6d83e6,
title = "On Deriving Net Change Information From Change Logs - The DELTALAYER-Algorithm.",
abstract = "The management of change logs is crucial in different areas of information systems like data replication, data warehousing, and process management. One barrier that hampers the (intelligent) use of respective change logs is the possibly large amount of unnecessary and redundant data provided by them. In particular, change logs often contain information about changes which actually have had no effect on the original data source (e.g., due to subsequently applied, overriding change operations). Typically, such inflated logs lead to difficulties with respect to system performance, data quality or change comparability. In order to deal with this we introduce the DeltaLayer algorithm. It takes arbitrary change log information as input and produces a cleaned output which only contains the net change effects; i.e., the produced log only contains information about those changes which actually have had an effect on the original source. We formally prove the minimality of our algorithm, and we show how it can be applied in different domains; e.g., the post-processing of differential snapshots in data warehouses or the analysis of conflicting changes in process management systems. Altogether the ability to purge change logs from unnecessary information provides the basis for a more intelligent handling of these logs.",
keywords = "SCS-Services, METIS-241712, IR-66633, EWI-8222",
author = "S.B. Rinderle and M. Jurisch and M.U. Reichert",
year = "2007",
month = "3",
language = "Undefined",
isbn = "978-3-88579-197-3",
series = "Lecture Notes in Informatics (LNI)",
publisher = "Koellen Verlag",
number = "1",
pages = "364--381",
booktitle = "Proceedings 12th GI-Conference on Database Systems in Business, Technology and Web (BTW'07)",

}

Rinderle, SB, Jurisch, M & Reichert, MU 2007, On Deriving Net Change Information From Change Logs - The DELTALAYER-Algorithm. in Proceedings 12th GI-Conference on Database Systems in Business, Technology and Web (BTW'07). Lecture Notes in Informatics (LNI), no. 1, vol. LNI-103, Koellen Verlag, Bonn, pp. 364-381.

On Deriving Net Change Information From Change Logs - The DELTALAYER-Algorithm. / Rinderle, S.B.; Jurisch, M.; Reichert, M.U.

Proceedings 12th GI-Conference on Database Systems in Business, Technology and Web (BTW'07). Bonn : Koellen Verlag, 2007. p. 364-381 (Lecture Notes in Informatics (LNI); Vol. LNI-103, No. 1).

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

TY - GEN

T1 - On Deriving Net Change Information From Change Logs - The DELTALAYER-Algorithm.

AU - Rinderle, S.B.

AU - Jurisch, M.

AU - Reichert, M.U.

PY - 2007/3

Y1 - 2007/3

N2 - The management of change logs is crucial in different areas of information systems like data replication, data warehousing, and process management. One barrier that hampers the (intelligent) use of respective change logs is the possibly large amount of unnecessary and redundant data provided by them. In particular, change logs often contain information about changes which actually have had no effect on the original data source (e.g., due to subsequently applied, overriding change operations). Typically, such inflated logs lead to difficulties with respect to system performance, data quality or change comparability. In order to deal with this we introduce the DeltaLayer algorithm. It takes arbitrary change log information as input and produces a cleaned output which only contains the net change effects; i.e., the produced log only contains information about those changes which actually have had an effect on the original source. We formally prove the minimality of our algorithm, and we show how it can be applied in different domains; e.g., the post-processing of differential snapshots in data warehouses or the analysis of conflicting changes in process management systems. Altogether the ability to purge change logs from unnecessary information provides the basis for a more intelligent handling of these logs.

AB - The management of change logs is crucial in different areas of information systems like data replication, data warehousing, and process management. One barrier that hampers the (intelligent) use of respective change logs is the possibly large amount of unnecessary and redundant data provided by them. In particular, change logs often contain information about changes which actually have had no effect on the original data source (e.g., due to subsequently applied, overriding change operations). Typically, such inflated logs lead to difficulties with respect to system performance, data quality or change comparability. In order to deal with this we introduce the DeltaLayer algorithm. It takes arbitrary change log information as input and produces a cleaned output which only contains the net change effects; i.e., the produced log only contains information about those changes which actually have had an effect on the original source. We formally prove the minimality of our algorithm, and we show how it can be applied in different domains; e.g., the post-processing of differential snapshots in data warehouses or the analysis of conflicting changes in process management systems. Altogether the ability to purge change logs from unnecessary information provides the basis for a more intelligent handling of these logs.

KW - SCS-Services

KW - METIS-241712

KW - IR-66633

KW - EWI-8222

M3 - Conference contribution

SN - 978-3-88579-197-3

T3 - Lecture Notes in Informatics (LNI)

SP - 364

EP - 381

BT - Proceedings 12th GI-Conference on Database Systems in Business, Technology and Web (BTW'07)

PB - Koellen Verlag

CY - Bonn

ER -

Rinderle SB, Jurisch M, Reichert MU. On Deriving Net Change Information From Change Logs - The DELTALAYER-Algorithm. In Proceedings 12th GI-Conference on Database Systems in Business, Technology and Web (BTW'07). Bonn: Koellen Verlag. 2007. p. 364-381. (Lecture Notes in Informatics (LNI); 1).