Skip to content

Installation

Ubunye Engine requires Python 3.9 – 3.11.

Core install

pip install ubunye-engine

This installs the CLI, config loader, plugin registry, and lineage tracker. PySpark and ML backends are optional extras.

Install extras

pip install "ubunye-engine[spark]"

Adds pyspark. Required to run format: hive, format: delta, and format: unity connectors.

pip install "ubunye-engine[ml]"

Adds scikit-learn, mlflow, and the ML plugin wrappers.

pip install "ubunye-engine[spark,ml]"

git clone https://github.com/ubunye-ai-ecosystems/ubunye_engine.git
cd ubunye_engine
pip install -e ".[dev,spark,ml]"
pre-commit install

Verify the install

ubunye version

Expected output:

Ubunye Engine v0.1.0

List all discovered plugins:

ubunye plugins

System requirements

Requirement Minimum
Python 3.9
Java (for Spark) 11
Apache Spark 3.3
PySpark (optional) 3.3

Databricks

On Databricks the cluster already has PySpark installed. Install only the core package on the driver: 

%pip install ubunye-engine

Next steps