Reset the deployment of Dremio that is bundled with the Data Frame Service (DFS).

Each deployment of the DFS comes with a dedicated deployment of Dremio. The DFS and Dremio are deployed to the same Kubernetes cluster by the Helm chart of the DFS.

Resetting Dremio might help resolve the following situations.

  • Resolve issues with queries in the DFS after other debugging steps have failed.
  • Restore Dremio from a bad state.
  • Restore Dremio after changing the directory used for its distributed storage cache.
  • Reinitialize Dremio when the S3 credentials change.
  • Recover from the failure mode where one of the Dremio volumes is full.
Before you begin, ensure you have permission to perform the following actions in the Kubernetes cluster that the DFS is deployed to.
  • Delete pods.
  • Delete Persistent Volume Claims (PVCs).
To reset Dremio, you must delete all Dremio PVCs, all Dremio pods, and one DFS pod.
  1. Open the command prompt and run the following command to get a list of the PVCs in the cluster.

    kubectl get pvc

  2. Note the PVCs with dremio in their name.
  3. Delete the Dremio PVCs you noted by running the following command. Include all Dremio PVCs in the command.

    kubectl delete pvc <dremio pvc 1> <dremio pvc 2>...<dremio pvc n>

  4. Run the following command to get a list of the deployed pods.

    kubectl get pods

  5. Note pods with dremio in their name.
  6. Delete the Dremio pods you noted by running the following command. Include all Dremio pods in the command.

    kubectl delete pod <dremio pod 1> <dremio pod 2>...<dremio pod n>

    After deleting the old pods, Kubernetes creates new pods.
  7. Run the following command to get information about one of the Dremio pods.

    kubectl describe pod <dremio pod>

  8. Verify that the value in the Age field is less than a few minutes. If the PVC is older, repeat steps 3-8.
  9. To get a list of the deployed pods, run the following command.

    kubectl get pods

  10. Find a pod that belongs to the DFS C# service.
    Pods that belong to the DFS C# service have both of the following characteristics.
    • Include dataframeservice in their name.
    • Exclude mongodb, dremio, or zk from their name.
  11. Delete the DFS pod by running the following command.

    kubectl delete pod <DFS pod>

    Kubernetes creates a new DFS pod. The new pod starts up in approximately one minute.
When the new DFS pod is ready, you have reset Dremio.