TY - GEN
T1 - ASQP-RL Demo
T2 - 2024 International Conferaence on Management of Data, SIGMOD 2024
AU - Davidson, Susan B.
AU - Milo, Tova
AU - Razmadze, Kathy
AU - Zeevi, Gal
N1 - Publisher Copyright:
© 2024 Owner/Author.
PY - 2024/6/9
Y1 - 2024/6/9
N2 - We demonstrate the Approximate Selection Query Processing (ASQP-RL) system, which uses Reinforcement Learning to select a subset of a large external dataset to process locally in a notebook during data exploration. Given a query workload over an external database and notebook memory size, the system translates the workload to select-project-join (non-aggregate) queries and finds a subset of each relation such that the data subset - called the approximation set - fits into the notebook memory and maximizes query result quality. The data subset can then be loaded into the notebook, and rapidly queried by the analyst. Our demonstration shows how ASQP-RL can be used during data exploration and achieve comparable results to external queries over the large dataset at significantly reduced query times. It also shows how ASQP-RL can be used for aggregation queries, achieving surprisingly good results compared to state-of-the-art techniques.
AB - We demonstrate the Approximate Selection Query Processing (ASQP-RL) system, which uses Reinforcement Learning to select a subset of a large external dataset to process locally in a notebook during data exploration. Given a query workload over an external database and notebook memory size, the system translates the workload to select-project-join (non-aggregate) queries and finds a subset of each relation such that the data subset - called the approximation set - fits into the notebook memory and maximizes query result quality. The data subset can then be loaded into the notebook, and rapidly queried by the analyst. Our demonstration shows how ASQP-RL can be used during data exploration and achieve comparable results to external queries over the large dataset at significantly reduced query times. It also shows how ASQP-RL can be used for aggregation queries, achieving surprisingly good results compared to state-of-the-art techniques.
KW - exploratory data analysis
KW - queries approximation
KW - reinforcement learning
UR - http://www.scopus.com/inward/record.url?scp=85196397296&partnerID=8YFLogxK
U2 - 10.1145/3626246.3654741
DO - 10.1145/3626246.3654741
M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???
AN - SCOPUS:85196397296
T3 - Proceedings of the ACM SIGMOD International Conference on Management of Data
SP - 452
EP - 455
BT - SIGMOD-Companion 2024 - Companion of the 2024 International Conferaence on Management of Data
PB - Association for Computing Machinery
Y2 - 9 June 2024 through 15 June 2024
ER -