• How to Deploy Spark with Kubernetes on Bright 9.1 with CentOS8

    The steps described in this page can be followed to run a distributed Spark application using Kubernetes on Bright 9.1. 1. Software versions The Docker image that is going to be used for Spark will provide software with the following main versions: Operating System: Debian GNU/Linux 10 Apache Spark: 3.1.1…

  • How Do I Create Docker images to use NVIDIA GPUs with Spark and XGBoost via RAPIDS?

    The steps described in this page can be followed to build a Docker image that is suitable for running distributed Spark applications using XGBoost and leveraging RAPIDS to take advantage of NVIDIA GPUs. A Python application requiring this Docker image is provided by Bright as a Jupyter notebook. It is…