Apache Wayang in Action: Enabling Data Systems Integration via a Unified Data Analytics Framework.

Kaustubh Beedkar; Aurélien Bertrand; Haralampos Gavriilidis; Augusto José Fonseca; Zoi Kaoudi; Mingxi Liu; Volker Markl; Juri Petersen; Fábio Porto; Víctor Ribeiro; Mads Sejer Pedersen; Lucas Giusti Tavares; Michalis Vargiamis; Chen Xu

doi:10.1145/3722212.3725081

Apache Wayang in Action: Enabling Data Systems Integration via a Unified Data Analytics Framework.

Kaustubh Beedkar
, Aurélien Bertrand
, Haralampos Gavriilidis
, Augusto José Fonseca
, Zoi Kaoudi
, Mingxi Liu
, Volker Markl
, Juri Petersen
, Fábio Porto
, Víctor Ribeiro
, Mads Sejer Pedersen
, Lucas Giusti Tavares
, Michalis Vargiamis
, Chen Xu

Research output: Conference Article in Proceeding or Book/Report chapter › Article in proceedings › Research › peer-review

Abstract

Apache Wayang is an open-source framework, which provides a systematic and efficient solution for unifying data analytics over disparate data sources and via integrating multiple heterogeneous data systems. It achieves that by decoupling applications from the underlying systems. In addition, it provides an optimizer so that users do not have to specify the platforms on which their pipeline should run but the optimizer can determine the best way given a cost metric. In this demonstration, we showcase how the flexible architecture of Wayang enables seamless integration with multiple heterogeneous data systems and how the query optimizer can lead to better performance.

Original language	English
Title of host publication	Companion of the 2025 International Conference on Management of Data
Number of pages	4
Place of Publication	New York, USA
Publisher	Association for Computing Machinery
Publication date	22 Jun 2025
Pages	35-38
ISBN (Print)	9798400715648
ISBN (Electronic)	9798400715648
DOIs	https://doi.org/10.1145/3722212.3725081
Publication status	Published - 22 Jun 2025
Event	Management of Data - Berlin, Berlin, Germany Duration: 22 Jun 2025 → 27 Jun 2025 Conference number: 21 https://2025.sigmod.org/

Conference

Conference	Management of Data
Number	21
Location	Berlin
Country/Territory	Germany
City	Berlin
Period	22/06/2025 → 27/06/2025
Internet address	https://2025.sigmod.org/

Keywords

Unified Data Analytics
Query Optimization

Access to Document

10.1145/3722212.3725081Licence: CC BY

https://dblp.org/rec/conf/sigmod/BeedkarBGFKLMP025

Cite this

Beedkar, K., Bertrand, A., Gavriilidis, H., Fonseca, A. J., Kaoudi, Z., Liu, M., Markl, V., Petersen, J., Porto, F., Ribeiro, V., Pedersen, M. S., Tavares, L. G., Vargiamis, M., & Xu, C. (2025). Apache Wayang in Action: Enabling Data Systems Integration via a Unified Data Analytics Framework. In Companion of the 2025 International Conference on Management of Data (pp. 35-38). Association for Computing Machinery. https://doi.org/10.1145/3722212.3725081

@inproceedings{459ed7c1067e47b6a8cb03fd448c463b,

title = "Apache Wayang in Action: Enabling Data Systems Integration via a Unified Data Analytics Framework.",

abstract = "Apache Wayang is an open-source framework, which provides a systematic and efficient solution for unifying data analytics over disparate data sources and via integrating multiple heterogeneous data systems. It achieves that by decoupling applications from the underlying systems. In addition, it provides an optimizer so that users do not have to specify the platforms on which their pipeline should run but the optimizer can determine the best way given a cost metric. In this demonstration, we showcase how the flexible architecture of Wayang enables seamless integration with multiple heterogeneous data systems and how the query optimizer can lead to better performance.",

keywords = "query optimization, unified analytics, Unified Data Analytics, Query Optimization",

author = "Kaustubh Beedkar and Aur{\'e}lien Bertrand and Haralampos Gavriilidis and Fonseca, \{Augusto Jos{\'e}\} and Zoi Kaoudi and Mingxi Liu and Volker Markl and Juri Petersen and F{\'a}bio Porto and V{\'i}ctor Ribeiro and Pedersen, \{Mads Sejer\} and Tavares, \{Lucas Giusti\} and Michalis Vargiamis and Chen Xu",

note = "DBLP's bibliographic metadata records provided through http://dblp.org/search/publ/api are distributed under a Creative Commons CC0 1.0 Universal Public Domain Dedication. Although the bibliographic metadata records are provided consistent with CC0 1.0 Dedication, the content described by the metadata records is not. Content may be subject to copyright, rights of privacy, rights of publicity and other restrictions.; Management of Data, ACM SIGMOD/PODS ; Conference date: 22-06-2025 Through 27-06-2025",

year = "2025",

month = jun,

day = "22",

doi = "10.1145/3722212.3725081",

language = "English",

isbn = "9798400715648",

pages = "35--38",

booktitle = "Companion of the 2025 International Conference on Management of Data",

publisher = "Association for Computing Machinery",

address = "United States",

url = "https://2025.sigmod.org/",

}

Beedkar, K, Bertrand, A, Gavriilidis, H, Fonseca, AJ, Kaoudi, Z, Liu, M, Markl, V, Petersen, J, Porto, F, Ribeiro, V, Pedersen, MS, Tavares, LG, Vargiamis, M & Xu, C 2025, Apache Wayang in Action: Enabling Data Systems Integration via a Unified Data Analytics Framework. in Companion of the 2025 International Conference on Management of Data. Association for Computing Machinery, New York, USA , pp. 35-38, Management of Data, Berlin, Berlin, Germany, 22/06/2025. https://doi.org/10.1145/3722212.3725081

Apache Wayang in Action: Enabling Data Systems Integration via a Unified Data Analytics Framework. / Beedkar, Kaustubh; Bertrand, Aurélien; Gavriilidis, Haralampos et al.
Companion of the 2025 International Conference on Management of Data. New York, USA : Association for Computing Machinery, 2025. p. 35-38.

Research output: Conference Article in Proceeding or Book/Report chapter › Article in proceedings › Research › peer-review

TY - GEN

T1 - Apache Wayang in Action: Enabling Data Systems Integration via a Unified Data Analytics Framework.

AU - Beedkar, Kaustubh

AU - Bertrand, Aurélien

AU - Gavriilidis, Haralampos

AU - Fonseca, Augusto José

AU - Kaoudi, Zoi

AU - Liu, Mingxi

AU - Markl, Volker

AU - Petersen, Juri

AU - Porto, Fábio

AU - Ribeiro, Víctor

AU - Pedersen, Mads Sejer

AU - Tavares, Lucas Giusti

AU - Vargiamis, Michalis

AU - Xu, Chen

N1 - Conference code: 21

PY - 2025/6/22

Y1 - 2025/6/22

N2 - Apache Wayang is an open-source framework, which provides a systematic and efficient solution for unifying data analytics over disparate data sources and via integrating multiple heterogeneous data systems. It achieves that by decoupling applications from the underlying systems. In addition, it provides an optimizer so that users do not have to specify the platforms on which their pipeline should run but the optimizer can determine the best way given a cost metric. In this demonstration, we showcase how the flexible architecture of Wayang enables seamless integration with multiple heterogeneous data systems and how the query optimizer can lead to better performance.

AB - Apache Wayang is an open-source framework, which provides a systematic and efficient solution for unifying data analytics over disparate data sources and via integrating multiple heterogeneous data systems. It achieves that by decoupling applications from the underlying systems. In addition, it provides an optimizer so that users do not have to specify the platforms on which their pipeline should run but the optimizer can determine the best way given a cost metric. In this demonstration, we showcase how the flexible architecture of Wayang enables seamless integration with multiple heterogeneous data systems and how the query optimizer can lead to better performance.

KW - query optimization

KW - unified analytics

KW - Unified Data Analytics

KW - Query Optimization

U2 - 10.1145/3722212.3725081

DO - 10.1145/3722212.3725081

M3 - Article in proceedings

SN - 9798400715648

SP - 35

EP - 38

BT - Companion of the 2025 International Conference on Management of Data

PB - Association for Computing Machinery

CY - New York, USA

T2 - Management of Data

Y2 - 22 June 2025 through 27 June 2025

ER -

Apache Wayang in Action: Enabling Data Systems Integration via a Unified Data Analytics Framework.

Abstract

Conference

Keywords

Access to Document

Fingerprint

Cite this