Hi,
I am very interested in the DataFrame Algebra mentioned in the section 4.3, Table 1 in paper: https://arxiv.org/pdf/2001.00888.pdf
Is there any documentation on how to access it via the modin library?
Hi @RAbraham, the algebra corresponds roughly to the modin dataframe layer in modin’s architecture. Modin running on ray, dask, or unidist will use the algebraic operators to parallelize computation.
Right now the Modin dataframe lives in modin.core.dataframe.pandas.dataframe.dataframe. You can view some operators there, e.g. the map operator is here.
1 Like
That’s great. Thanks!