Using omega|ml on private Spark ClustersΒΆ

omega|ml can be installed on any machine of your preference following below steps:

  • install omega|ml using pip

  • set env variables for mongodb and rabbitmq

  • start celery worker

  • import omega|ml on start of pyspark