Apache Wayang in Action: Enabling Data Systems Integration via a Unified Data Analytics Framework.

Kaustubh Beedkar; Aurélien Bertrand; Haralampos Gavriilidis; Augusto José Fonseca; Zoi Kaoudi; Mingxi Liu; Volker Markl; Juri Petersen; Fábio Porto; Víctor Ribeiro; Mads Sejer Pedersen; Lucas Giusti Tavares; Michalis Vargiamis; Chen Xu

doi:10.1145/3722212.3725081

Apache Wayang in Action: Enabling Data Systems Integration via a Unified Data Analytics Framework.

Kaustubh Beedkar
, Aurélien Bertrand
, Haralampos Gavriilidis
, Augusto José Fonseca
, Zoi Kaoudi
, Mingxi Liu
, Volker Markl
, Juri Petersen
, Fábio Porto
, Víctor Ribeiro
, Mads Sejer Pedersen
, Lucas Giusti Tavares
, Michalis Vargiamis
, Chen Xu

Publikation: Konference artikel i Proceeding eller bog/rapport kapitel › Konferencebidrag i proceedings › Forskning › peer review

Abstract

Apache Wayang is an open-source framework, which provides a systematic and efficient solution for unifying data analytics over disparate data sources and via integrating multiple heterogeneous data systems. It achieves that by decoupling applications from the underlying systems. In addition, it provides an optimizer so that users do not have to specify the platforms on which their pipeline should run but the optimizer can determine the best way given a cost metric. In this demonstration, we showcase how the flexible architecture of Wayang enables seamless integration with multiple heterogeneous data systems and how the query optimizer can lead to better performance.

Originalsprog	Engelsk
Titel	Companion of the 2025 International Conference on Management of Data
Antal sider	4
Udgivelsessted	New York, USA
Forlag	Association for Computing Machinery
Publikationsdato	22 jun. 2025
Sider	35-38
ISBN (Trykt)	9798400715648
ISBN (Elektronisk)	9798400715648
DOI	https://doi.org/10.1145/3722212.3725081
Status	Udgivet - 22 jun. 2025
Begivenhed	Management of Data - Berlin, Berlin, Tyskland Varighed: 22 jun. 2025 → 27 jun. 2025 Konferencens nummer: 21 https://2025.sigmod.org/

Konference

Konference	Management of Data
Nummer	21
Lokation	Berlin
Land/Område	Tyskland
By	Berlin
Periode	22/06/2025 → 27/06/2025
Internetadresse	https://2025.sigmod.org/

Emneord

query optimization
unified analytics

Adgang til dokumentet

10.1145/3722212.3725081Licens: CC BY

https://dblp.org/rec/conf/sigmod/BeedkarBGFKLMP025

Citationsformater

Beedkar, K., Bertrand, A., Gavriilidis, H., Fonseca, A. J., Kaoudi, Z., Liu, M., Markl, V., Petersen, J., Porto, F., Ribeiro, V., Pedersen, M. S., Tavares, L. G., Vargiamis, M., & Xu, C. (2025). Apache Wayang in Action: Enabling Data Systems Integration via a Unified Data Analytics Framework. I Companion of the 2025 International Conference on Management of Data (s. 35-38). Association for Computing Machinery. https://doi.org/10.1145/3722212.3725081

@inproceedings{459ed7c1067e47b6a8cb03fd448c463b,

title = "Apache Wayang in Action: Enabling Data Systems Integration via a Unified Data Analytics Framework.",

abstract = "Apache Wayang is an open-source framework, which provides a systematic and efficient solution for unifying data analytics over disparate data sources and via integrating multiple heterogeneous data systems. It achieves that by decoupling applications from the underlying systems. In addition, it provides an optimizer so that users do not have to specify the platforms on which their pipeline should run but the optimizer can determine the best way given a cost metric. In this demonstration, we showcase how the flexible architecture of Wayang enables seamless integration with multiple heterogeneous data systems and how the query optimizer can lead to better performance.",

keywords = "query optimization, unified analytics, Unified Data Analytics, Query Optimization",

author = "Kaustubh Beedkar and Aur{\'e}lien Bertrand and Haralampos Gavriilidis and Fonseca, \{Augusto Jos{\'e}\} and Zoi Kaoudi and Mingxi Liu and Volker Markl and Juri Petersen and F{\'a}bio Porto and V{\'i}ctor Ribeiro and Pedersen, \{Mads Sejer\} and Tavares, \{Lucas Giusti\} and Michalis Vargiamis and Chen Xu",

note = "DBLP's bibliographic metadata records provided through http://dblp.org/search/publ/api are distributed under a Creative Commons CC0 1.0 Universal Public Domain Dedication. Although the bibliographic metadata records are provided consistent with CC0 1.0 Dedication, the content described by the metadata records is not. Content may be subject to copyright, rights of privacy, rights of publicity and other restrictions.; Management of Data, ACM SIGMOD/PODS ; Conference date: 22-06-2025 Through 27-06-2025",

year = "2025",

month = jun,

day = "22",

doi = "10.1145/3722212.3725081",

language = "English",

isbn = "9798400715648",

pages = "35--38",

booktitle = "Companion of the 2025 International Conference on Management of Data",

publisher = "Association for Computing Machinery",

address = "United States",

url = "https://2025.sigmod.org/",

}

Beedkar, K, Bertrand, A, Gavriilidis, H, Fonseca, AJ, Kaoudi, Z, Liu, M, Markl, V, Petersen, J, Porto, F, Ribeiro, V, Pedersen, MS, Tavares, LG, Vargiamis, M & Xu, C 2025, Apache Wayang in Action: Enabling Data Systems Integration via a Unified Data Analytics Framework. i Companion of the 2025 International Conference on Management of Data. Association for Computing Machinery, New York, USA , s. 35-38, Management of Data, Berlin, Berlin, Tyskland, 22/06/2025. https://doi.org/10.1145/3722212.3725081

Apache Wayang in Action: Enabling Data Systems Integration via a Unified Data Analytics Framework. / Beedkar, Kaustubh; Bertrand, Aurélien; Gavriilidis, Haralampos et al.
Companion of the 2025 International Conference on Management of Data. New York, USA : Association for Computing Machinery, 2025. s. 35-38.

Publikation: Konference artikel i Proceeding eller bog/rapport kapitel › Konferencebidrag i proceedings › Forskning › peer review

TY - GEN

T1 - Apache Wayang in Action: Enabling Data Systems Integration via a Unified Data Analytics Framework.

AU - Beedkar, Kaustubh

AU - Bertrand, Aurélien

AU - Gavriilidis, Haralampos

AU - Fonseca, Augusto José

AU - Kaoudi, Zoi

AU - Liu, Mingxi

AU - Markl, Volker

AU - Petersen, Juri

AU - Porto, Fábio

AU - Ribeiro, Víctor

AU - Pedersen, Mads Sejer

AU - Tavares, Lucas Giusti

AU - Vargiamis, Michalis

AU - Xu, Chen

N1 - Conference code: 21

PY - 2025/6/22

Y1 - 2025/6/22

N2 - Apache Wayang is an open-source framework, which provides a systematic and efficient solution for unifying data analytics over disparate data sources and via integrating multiple heterogeneous data systems. It achieves that by decoupling applications from the underlying systems. In addition, it provides an optimizer so that users do not have to specify the platforms on which their pipeline should run but the optimizer can determine the best way given a cost metric. In this demonstration, we showcase how the flexible architecture of Wayang enables seamless integration with multiple heterogeneous data systems and how the query optimizer can lead to better performance.

AB - Apache Wayang is an open-source framework, which provides a systematic and efficient solution for unifying data analytics over disparate data sources and via integrating multiple heterogeneous data systems. It achieves that by decoupling applications from the underlying systems. In addition, it provides an optimizer so that users do not have to specify the platforms on which their pipeline should run but the optimizer can determine the best way given a cost metric. In this demonstration, we showcase how the flexible architecture of Wayang enables seamless integration with multiple heterogeneous data systems and how the query optimizer can lead to better performance.

KW - query optimization

KW - unified analytics

KW - Unified Data Analytics

KW - Query Optimization

U2 - 10.1145/3722212.3725081

DO - 10.1145/3722212.3725081

M3 - Article in proceedings

SN - 9798400715648

SP - 35

EP - 38

BT - Companion of the 2025 International Conference on Management of Data

PB - Association for Computing Machinery

CY - New York, USA

T2 - Management of Data

Y2 - 22 June 2025 through 27 June 2025

ER -

Apache Wayang in Action: Enabling Data Systems Integration via a Unified Data Analytics Framework.

Abstract

Konference

Emneord

Adgang til dokumentet

Fingeraftryk

Citationsformater