Hello Team,
I have run out of Space on the Zeebe Data PVCs, due to which getting the following issues.
[raft-server-1-raft-partition-partition-3] ERROR io.atomix.raft.roles.LeaderRole - RaftServer{raft-partition-partition-3}{role=LEADER} - Error on appending entry InitializeEntry{term=5837, timestamp=2020-12-23 07:55:27,240}, retry.
io.atomix.storage.StorageException: java.io.IOException: No space left on device
I reconfirmed by logging into the pods and running the “df” command
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/nvme4n1 10190100 10173716 0 100% /usr/local/zeebe/data
I have also tried editing the PVC associated with the same and getting the below error.
$ kubectl edit pvc data-zeebe-zeebe-0 -n zeebe-test
error: persistentvolumeclaims “data-zeebe-zeebe-0” could not be patched: persistentvolumeclaims “data-zeebe-zeebe-0” is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
So, wanted your help into two things
- To be able to resize the PVC if possible.
- While newly deploying Zeebe is there a configuration which can be changed so that a PVC with higher capacity is created.
Thanks.