Abstract
The amount of data that is stored in databases and must be analyzed is growing fast. Many analytical tasks are based on iterative methods that approximate optimal solutions. Propensity score matching is a technique that is used to reduce bias during cohort building. The main step is the propensity score computation, which is usually implemented via iterative methods such as gradient descent. Our goal is to support efficient and scalable propensity score computation over relations in a column-oriented database. To achieve this goal, we introduce shape-preserving iterations that update values in existing tuples until a fix point is reached. Shape-preserving iterations enable gradient descent over relations and, thus, propensity score matching. We also show how to create appropriate input relations for shape-preserving iterations with randomly initialized relations. The empirical evaluation compares in-database iterations with the native implementation in MonetDB where iterations are flattened.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
We use the first character of the attribute name to refer to the attributes.
References
Scikit-learn: Machine Learning in Python. https://scikit-learn.org/. Accessed 11 Dec 2019
sklearn.datasets: Function make\_classification. https://scikit-learn.org/stable/modules/generated/sklearn.datasets.make_classification.html. Accessed 05 Mar 2020
The R Stats Package: R statistical functions. https://www.rdocumentation.org/packages/stats. Accessed 11 Dec 2019
Austin, P.: Optimal caliper widths for propensity-score matching when estimating differences in means and differences in proportions in observational studies. Pharm. Stat. 10, 150–161 (2011). https://doi.org/10.1002/pst.433
Binnig, C., Rehrmann, R., Faerber, F., Riewe, R.: FunSQL: it is time to make SQL functional. In: Proceedings of the 2012 Joint EDBT/ICDT Workshops, pp. 41–46. EDBT-ICDT 2012. ACM, New York (2012). http://doi.acm.org/10.1145/2320765.2320786
Dolmatova, O., Augsten, N., Böhlen, M.H.: Preserving contextual information in relational matrix operations. In: Proceedings of the 36th International Conference on Data Engineering. ICDE 2020, p. 4 (2020)
Dolmatova, O., Augsten, N., Böhlen, M.H.: A relational matrix algebra and its implementation in a column store. In: International Conference on Management of Data, SIGMOD 2020, Portland, OR, USA, 14–19 June 2020. ACM (2020)
Harrell Jr, F.E.: Right Heart Catheterization Dataset. http://biostat.mc.vanderbilt.edu/wiki/pub/Main/DataSets/rhc.csv. Accessed 02 Dec 2019
Jankov, D., et al.: Declarative recursive computation on an RDBMS: or, why you should use a database for distributed machine learning. Proc. VLDB Endow. 12(7), 822–835 (2019). https://doi.org/10.14778/3317315.3317323
Martin, J.H., Jurafsky, D.: Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition. Pearson/Prentice Hall, Upper Saddle River (2009)
Passing, L., et al.: SQL- and operator-centric data analytics in relational main-memory databases. In: Proceedings of the 20th International Conference on Extending Database Technology, EDBT 2017, Venice, Italy, 21–24 March 2017, pp. 84–95 (2017). https://doi.org/10.5441/002/edbt.2017.09
Rosenbaum, P.R., Rubin, D.B.: The central role of the propensity score in observational studies for causal effects. Biometrika 70(1), 41–55 (1983). http://www.jstor.org/stable/2335942
Ruder, S.: An overview of gradient descent optimization algorithms. arXiv preprint arXiv:1609.04747 (2016)
Senn, S., Graf, E., Caputo, A.: Stratification for the propensity score compared with linear regression techniques to assess the effect of treatment or exposure. Statistics in Medicine 26(30), 5529–5544 (2007). https://doi.org/10.1002/sim.3133, https://onlinelibrary.wiley.com/doi/abs/10.1002/sim.3133
University of Zurich: ScienceCloud. https://www.zi.uzh.ch/en/teaching-and-research/science-it/infrastructure/. Accessed 18 Mar 2020
Varga, R.S.: Matrix Iterative Analysis. Prentice-Hall Series in Automatic Computation. Prentice-Hall, Englewood Cliffs (1962)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Böhlen, M.H., Dolmatova, O., Krauthammer, M., Mariyagnanaseelan, A., Stahl, J., Surbeck, T. (2020). Iterations for Propensity Score Matching in MonetDB. In: Darmont, J., Novikov, B., Wrembel, R. (eds) Advances in Databases and Information Systems. ADBIS 2020. Lecture Notes in Computer Science(), vol 12245. Springer, Cham. https://doi.org/10.1007/978-3-030-54832-2_15
Download citation
DOI: https://doi.org/10.1007/978-3-030-54832-2_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-54831-5
Online ISBN: 978-3-030-54832-2
eBook Packages: Computer ScienceComputer Science (R0)