Just in time: Personal temporal insights for altering model decisions

Naama Boer, Daniel Deutch, Nave Frost, Tova Milo

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

3 Scopus citations


The interpretability of complex Machine Learning models is coming to be a critical social concern, as they are increasingly used in human-related decision-making processes such as resume filtering or loan applications. Individuals receiving an undesired classification are likely to call for an explanation - preferably one that specifies what they should do in order to alter that decision when they reapply in the future. Existing work focuses on a single ML model and a single point in time, whereas in practice, both models and data evolve over time: an explanation for an application rejection in 2018 may be irrelevant in 2019 since in the meantime both the model and the applicant's data can change. To this end, we propose a novel framework that provides users with insights and plans for changing their classification in particular future time points. The solution is based on combining state-of-the-art algorithms for (single) model explanations, ones for predicting future models, and database-style querying of the obtained explanations. We propose to demonstrate the usefulness of our solution in the context of loan applications, and interactively engage the audience in computing and viewing suggestions tailored for applicants based on their unique characteristic.

Original languageEnglish
Title of host publicationProceedings - 2019 IEEE 35th International Conference on Data Engineering, ICDE 2019
PublisherIEEE Computer Society
Number of pages4
ISBN (Electronic)9781538674741
StatePublished - Apr 2019
Event35th IEEE International Conference on Data Engineering, ICDE 2019 - Macau, China
Duration: 8 Apr 201911 Apr 2019

Publication series

NameProceedings - International Conference on Data Engineering
ISSN (Print)1084-4627


Conference35th IEEE International Conference on Data Engineering, ICDE 2019


FundersFunder number
Europe Union’s Horizon 2020 research and innovation programme
Intel Corporation
Horizon 2020 Framework Programme804302
European Research Council
Israel Science Foundation


    • Accountability
    • Interpretability
    • Temporal


    Dive into the research topics of 'Just in time: Personal temporal insights for altering model decisions'. Together they form a unique fingerprint.

    Cite this