IQ-Meter is the first comprehensive tool for the evaluation of data-transformation systems. It can facilitate data architects' work on complex scenarios with both commercial and research systems. It is based on three core ideas:

  1. a definition of a data-transformation system that is sufficiently general to capture a wide class of tools - including research schema-mapping systems, commercial mapping systems and transformation-editors, and ETL tools - and at the same time tight enough for the purpose of our evaluation;
  2. a new fast algorithm to measure of the quality of the outputs produced by a data translation tool on a given mapping scenario;
  3. a natural definition and measure of the user-effort needed to achieve such quality.
Ultimately, these techniques allow us to measure the level of intelligence of a data-transformation tool, defined as the ratio between the quality of the outputs generated by the system on a given task, and the amount of user effort required to generate them. The lower the effort required to obtain results of the best quality with a system, the higher its IQ. IQ-Meter builds on these techniques, and provides sophisticated functionalities for the evaluation of data transformation tools.


Last update: 28 Mar 2014


2 results

[CIKM2012] What is the IQ of Your Data Transformation System? (, , , ), In Proceedings of the 21st ACM International Conference on Information and Knowledge Management, ACM, . [bibtex] [pdf] [doi]
[VLDB2011] ++Spicy: an OpenSource Tool for Second-Generation Schema Mapping and Data Exchange (, , , , ), In Proceedings of the VLDB Endowment, VLDB Endowment, volume 4, . [bibtex] [pdf]

Related Projects


Comments, Bugs, Requests