I am going to answer your questions below:
- Well, I am using Azure ML pipelines, so I set a virtual environment as folows:
env = Environment(name="dataprep_regression_environment")
conda_deps = CondaDependencies.create(
env.python.conda_dependencies = conda_deps
However, I do not kown if additional configurations must be done, and how they must be done.
The data size is approximately 28 GB, and this data set is growing.
A great variety of operations are perfomed. I am concerned if some methods works, such as:
- pd.DataFrame.set_index() / pd.DataFrame.sort_index()
This questions are really useful for researching about why Modin is not working for me in Azure ML, Thank you so much.