diff --git a/docs/source/operators/deploy-distributed.md b/docs/source/operators/deploy-distributed.md index 09bb1555..849cbdd6 100644 --- a/docs/source/operators/deploy-distributed.md +++ b/docs/source/operators/deploy-distributed.md @@ -37,12 +37,12 @@ Entries in the remote hosts configuration should be fully qualified domain names All the kernel *specifications* configured to use the `DistributedProcessProxy` must be on all nodes to which there's a reference in the remote hosts configuration! With YARN cluster node, only the Python and R kernel _packages_ are required on each node, not the entire kernel specification. ``` -The following installs the sample `python_distributed` kernel specification relative to the 3.2.1 release on the given node. This step must be repeated for each node and each kernel specification. +The following installs the sample `python_distributed` kernel specification relative to the 3.2.2 release on the given node. This step must be repeated for each node and each kernel specification. ```Bash -wget https://github.com/jupyter-server/enterprise_gateway/releases/download/v3.2.1/jupyter_enterprise_gateway_kernelspecs-3.2.1.tar.gz +wget https://github.com/jupyter-server/enterprise_gateway/releases/download/v3.2.2/jupyter_enterprise_gateway_kernelspecs-3.2.2.tar.gz KERNELS_FOLDER=/usr/local/share/jupyter/kernels -tar -zxvf jupyter_enterprise_gateway_kernelspecs-3.2.1.tar.gz --strip 1 --directory $KERNELS_FOLDER/python_distributed/ python_distributed/ +tar -zxvf jupyter_enterprise_gateway_kernelspecs-3.2.2.tar.gz --strip 1 --directory $KERNELS_FOLDER/python_distributed/ python_distributed/ ``` ```{tip} diff --git a/docs/source/operators/deploy-kubernetes.md b/docs/source/operators/deploy-kubernetes.md index c6b602b4..931a1531 100644 --- a/docs/source/operators/deploy-kubernetes.md +++ b/docs/source/operators/deploy-kubernetes.md @@ -945,10 +945,10 @@ NAME READY STATUS RESTARTS AGE po/enterprise-gateway-74c46cb7fc-jrkl7 1/1 Running 0 2h NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE -svc/enterprise-gateway NodePort 10.110.253.2.1 8888:32422/TCP 2h +svc/enterprise-gateway NodePort 10.110.253.2.2 8888:32422/TCP 2h ``` -Of particular importance is the mapping to port `8888` (e.g.,`32422`). If you are performing this on the same host as where the notebook will run, then you will need to note the cluster-ip entry (e.g.,`10.110.253.2.1`). +Of particular importance is the mapping to port `8888` (e.g.,`32422`). If you are performing this on the same host as where the notebook will run, then you will need to note the cluster-ip entry (e.g.,`10.110.253.2.2`). (Note: if the number of replicas is > 1, then you will see two pods listed with different five-character suffixes.) @@ -1004,10 +1004,10 @@ kubectl logs -f pod/alice-5e755458-a114-4215-96b7-bcb016fc7b62 Note that if using multiple replicas, commands against each pod are required. -- The Kubernetes dashboard is useful as well. It's located at port `3.2.1` of the master node +- The Kubernetes dashboard is useful as well. It's located at port `3.2.2` of the master node ```bash -https://elyra-kube1.foo.bar.com:3.2.1/dashboard/#!/overview?namespace=default +https://elyra-kube1.foo.bar.com:3.2.2/dashboard/#!/overview?namespace=default ``` From there, logs can be accessed by selecting the `Pods` option in the left-hand pane followed by the _lined_ icon on diff --git a/docs/source/operators/deploy-yarn-cluster.md b/docs/source/operators/deploy-yarn-cluster.md index dc51895a..5ebfc70f 100644 --- a/docs/source/operators/deploy-yarn-cluster.md +++ b/docs/source/operators/deploy-yarn-cluster.md @@ -56,9 +56,9 @@ We recommend installing kernel specifications into a shared folder like `/usr/lo Considering we would like to enable the IPython kernel to run on YARN Cluster and Client mode we would have to copy the sample configuration folder **spark_python_yarn_cluster** to where the Jupyter kernels are installed (e.g. jupyter kernelspec list) ```bash -wget https://github.com/jupyter-server/enterprise_gateway/releases/download/v3.2.1/jupyter_enterprise_gateway_kernelspecs-3.2.1.tar.gz +wget https://github.com/jupyter-server/enterprise_gateway/releases/download/v3.2.2/jupyter_enterprise_gateway_kernelspecs-3.2.2.tar.gz KERNELS_FOLDER=/usr/local/share/jupyter/kernels -tar -zxvf jupyter_enterprise_gateway_kernelspecs-3.2.1.tar.gz --strip 1 --directory $KERNELS_FOLDER/spark_python_yarn_cluster/ spark_python_yarn_cluster/ +tar -zxvf jupyter_enterprise_gateway_kernelspecs-3.2.2.tar.gz --strip 1 --directory $KERNELS_FOLDER/spark_python_yarn_cluster/ spark_python_yarn_cluster/ ``` For more information about the IPython kernel, please visit the [IPython kernel](https://ipython.readthedocs.io/en/stable/) page. @@ -68,9 +68,9 @@ For more information about the IPython kernel, please visit the [IPython kernel] Considering we would like to enable the Scala Kernel to run on YARN Cluster and Client mode we would have to copy the sample configuration folder **spark_scala_yarn_cluster** to where the Jupyter kernels are installed (e.g. jupyter kernelspec list) ```bash -wget https://github.com/jupyter-server/enterprise_gateway/releases/download/v3.2.1/jupyter_enterprise_gateway_kernelspecs-3.2.1.tar.gz +wget https://github.com/jupyter-server/enterprise_gateway/releases/download/v3.2.2/jupyter_enterprise_gateway_kernelspecs-3.2.2.tar.gz KERNELS_FOLDER=/usr/local/share/jupyter/kernels -tar -zxvf jupyter_enterprise_gateway_kernelspecs-3.2.1.tar.gz --strip 1 --directory $KERNELS_FOLDER/spark_scala_yarn_cluster/ spark_scala_yarn_cluster/ +tar -zxvf jupyter_enterprise_gateway_kernelspecs-3.2.2.tar.gz --strip 1 --directory $KERNELS_FOLDER/spark_scala_yarn_cluster/ spark_scala_yarn_cluster/ ``` For more information about the Scala kernel, please visit the [Apache Toree](https://toree.apache.org/) page. @@ -80,9 +80,9 @@ For more information about the Scala kernel, please visit the [Apache Toree](htt Considering we would like to enable the IRkernel to run on YARN Cluster and Client mode we would have to copy the sample configuration folder **spark_R_yarn_cluster** to where the Jupyter kernels are installed (e.g. jupyter kernelspec list) ```Bash -wget https://github.com/jupyter-server/enterprise_gateway/releases/download/v3.2.1/jupyter_enterprise_gateway_kernelspecs-3.2.1.tar.gz +wget https://github.com/jupyter-server/enterprise_gateway/releases/download/v3.2.2/jupyter_enterprise_gateway_kernelspecs-3.2.2.tar.gz KERNELS_FOLDER=/usr/local/share/jupyter/kernels -tar -zxvf jupyter_enterprise_gateway_kernelspecs-3.2.1.tar.gz --strip 1 --directory $KERNELS_FOLDER/spark_R_yarn_cluster/ spark_R_yarn_cluster/ +tar -zxvf jupyter_enterprise_gateway_kernelspecs-3.2.2.tar.gz --strip 1 --directory $KERNELS_FOLDER/spark_R_yarn_cluster/ spark_R_yarn_cluster/ ``` For more information about the iR kernel, please visit the [IRkernel](https://irkernel.github.io/) page. diff --git a/docs/source/other/troubleshooting.md b/docs/source/other/troubleshooting.md index c54412f9..cb9c86b6 100644 --- a/docs/source/other/troubleshooting.md +++ b/docs/source/other/troubleshooting.md @@ -33,8 +33,8 @@ a "Kernel error" and State: 'FAILED'.** 1. Check the output from Enterprise Gateway for an error message. If an applicationId was generated, make a note of it. For example, you can locate the applicationId - `application_15065522733.2.1011` from the following snippet of message: - `[D 2017-09-28 17:13:22.675 EnterpriseGatewayApp] 13: State: 'ACCEPTED', Host: 'burna2.yourcompany.com', KernelID: '28a5e827-4676-4415-bbfc-ac30a0dcc4c3', ApplicationID: 'application_15065522733.2.1011' 17/09/28 17:13:22 INFO YarnClientImpl: Submitted application application_15065522733.2.1011 17/09/28 17:13:22 INFO Client: Application report for application_15065522733.2.1011 (state: ACCEPTED) 17/09/28 17:13:22 INFO Client: client token: N/A diagnostics: AM container is launched, waiting for AM container to Register with RM ApplicationMaster host: N/A ApplicationMaster RPC port: -1 queue: default start time: 1506644002471 final status: UNDEFINED tracking URL: http://burna1.yourcompany.com:8088/proxy/application_15065522733.2.1011/` + `application_15065522733.2.2011` from the following snippet of message: + `[D 2017-09-28 17:13:22.675 EnterpriseGatewayApp] 13: State: 'ACCEPTED', Host: 'burna2.yourcompany.com', KernelID: '28a5e827-4676-4415-bbfc-ac30a0dcc4c3', ApplicationID: 'application_15065522733.2.2011' 17/09/28 17:13:22 INFO YarnClientImpl: Submitted application application_15065522733.2.2011 17/09/28 17:13:22 INFO Client: Application report for application_15065522733.2.2011 (state: ACCEPTED) 17/09/28 17:13:22 INFO Client: client token: N/A diagnostics: AM container is launched, waiting for AM container to Register with RM ApplicationMaster host: N/A ApplicationMaster RPC port: -1 queue: default start time: 1506644002471 final status: UNDEFINED tracking URL: http://burna1.yourcompany.com:8088/proxy/application_15065522733.2.2011/` 1. Lookup the YARN log for that applicationId in the YARN ResourceManager UI: ![YARN ResourceManager UI](../images/yarnui.jpg) 1. Drill down from the applicationId to find logs for the failed attempts and take appropriate actions. For example, for the error below, diff --git a/etc/docker/docker-compose.yml b/etc/docker/docker-compose.yml index 5a17c5ae..f932a1b7 100644 --- a/etc/docker/docker-compose.yml +++ b/etc/docker/docker-compose.yml @@ -10,7 +10,7 @@ version: "3.5" # 3. We only use one replica since session affinity is another point of investigation in Swarm services: enterprise-gateway: - image: elyra/enterprise-gateway:dev + image: elyra/enterprise-gateway:3.2.2 user: root volumes: - "/var/run/docker.sock:/var/run/docker.sock" diff --git a/etc/kubernetes/helm/enterprise-gateway/Chart.yaml b/etc/kubernetes/helm/enterprise-gateway/Chart.yaml index 69b84d80..0d898b14 100644 --- a/etc/kubernetes/helm/enterprise-gateway/Chart.yaml +++ b/etc/kubernetes/helm/enterprise-gateway/Chart.yaml @@ -4,7 +4,7 @@ description: A helm chart to deploy Jupyter Enterprise Gateway # This is the chart version. This version number should be incremented each time you make changes # to the chart and its templates, including the app version. # Versions are expected to follow Semantic Versioning (https://semver.org/) -version: 3.3.0-dev0 +version: 3.2.2 # This is the version number of the application being deployed. This version number should be # incremented each time you make changes to the application. Versions are not expected to diff --git a/etc/kubernetes/helm/enterprise-gateway/values.yaml b/etc/kubernetes/helm/enterprise-gateway/values.yaml index 493bb3eb..7ed308bc 100644 --- a/etc/kubernetes/helm/enterprise-gateway/values.yaml +++ b/etc/kubernetes/helm/enterprise-gateway/values.yaml @@ -23,7 +23,7 @@ imagePullSecretsCreate: # --set imagePullSecretsCreate.secrets[1].data="UHJvZCBTZWNyZXQgSW5mb3JtYXRpb24K" # Enterprise Gateway image name and tag to use. -image: elyra/enterprise-gateway:dev +image: elyra/enterprise-gateway:3.2.2 # Enterprise Gateway image pull policy. imagePullPolicy: IfNotPresent # K8s Enterprise Gateway Service @@ -156,7 +156,7 @@ kip: create: false annotations: {} # Kernel Image Puller image name and tag to use. - image: elyra/kernel-image-puller:dev + image: elyra/kernel-image-puller:3.2.2 # Kernel Image Puller image pull policy. imagePullPolicy: IfNotPresent # Determines whether the Kernel Image Puller will pull kernel images it has previously pulled