Installation in Databricks
To make the Pathling encoders available within notebooks, navigate to the "Compute" section and click on the cluster. Click on the "Libraries" tab, and click "Install new".
Install both the
pathling PyPI package, and
Maven package. Once the cluster is restarted, the libraries should be available
for import and use within all notebooks.
By default, Databricks uses Java 8 within its clusters, while Pathling requires Java 11. To enable Java 11 support within your cluster, navigate to Advanced Options > Spark > Environment Variables and add the following:
See the Databricks documentation on Libraries for more information.