Riak pod error in Kubernetes deployment
hpthai7 opened this issue · 11 comments
Hello,
During the deployment to kubernetes, riak component sees a problem.
Context
$ k get deploy
NAME READY UP-TO-DATE AVAILABLE AGE
nx-mfn 1/1 1 1 3d
$ k get statefulset
NAME READY AGE
dl-mfn 2/2 3d
es-mfn 1/1 3d
rk-mfn 1/2 3d
$ k get pods
NAME READY STATUS RESTARTS AGE
dl-mfn-0 1/1 Running 0 2d23h
dl-mfn-1 1/1 Running 0 154m
es-mfn-0 1/1 Running 0 3d
mgr-mfn-r59zt 0/1 Completed 0 2d23h
nx-mfn-77865d48b8-lwkbz 2/2 Running 0 2d23h
rk-mfn-0 1/1 Running 0 2d23h
rk-mfn-1 0/1 CrashLoopBackOff 10 35m
When the riak statefulset has more than one replica, new replicas, i.e. rk-mfn-1
will try to join/connect to the first replica, i.e. rk-mfn-0
, as the shell script 10-join-cluster.sh
does.
However, rk-mfn-1
encounters the CrashLoopBackOff error. Here you can see the full logs:
$ k describe pods rk-mfn-1
Name: rk-mfn-1
Namespace: knix-test
Priority: 0
Node: nokia-k8s-worker-01/172.16.1.11
Start Time: Fri, 12 Jun 2020 15:50:49 +0200
Labels: app=microfunctions-riak
controller-revision-hash=rk-mfn-64bd75fc48
release=mfn
statefulset.kubernetes.io/pod-name=rk-mfn-1
Annotations: kubernetes.io/psp: restricted
seccomp.security.alpha.kubernetes.io/pod: docker/default
Status: Running
IP: 192.168.87.52
IPs:
IP: 192.168.87.52
Controlled By: StatefulSet/rk-mfn
Containers:
riak:
Container ID: docker://9da32e9b62d6117245d71980de59b0483d18cd211942836b671d1155d0e44b57
Image: slfg92.rcs.de.alcatel-lucent.com:443/microfn/riak:latest
Image ID: docker-pullable://slfg92.rcs.de.alcatel-lucent.com:443/microfn/riak@sha256:f2cfcca5bcdef8d92a396a7b1f1c09d79a1a9c1a49e88b3ec9f1fb646fc4519d
Ports: 8098/TCP, 8087/TCP, 4369/TCP, 8099/TCP, 6000/TCP, 6001/TCP, 6002/TCP, 6003/TCP, 6004/TCP, 6005/TCP, 6006/TCP, 6007/TCP, 6008/TCP, 6009/TCP, 6010/TCP, 6011/ TCP, 6012/TCP, 6013/TCP, 6014/TCP, 6015/TCP, 6016/TCP, 6017/TCP, 6018/TCP, 6019/TCP, 6020/TCP, 6021/TCP, 6022/TCP, 6023/TCP, 6024/TCP, 6025/TCP, 6026/TCP, 6027/TCP, 6028/TCP, 6029/TCP, 6030/TCP, 6031/TCP, 6032/TCP, 6033/TCP, 6034/TCP, 6035/TCP, 6036/TCP, 6037/TCP, 6038/TCP, 6039/TCP, 6040/TCP, 6041/TCP, 6042/TCP, 6043/TCP, 6044/TCP, 6045/TCP, 6046/ TCP, 6047/TCP, 6048/TCP, 6049/TCP, 6050/TCP, 6051/TCP, 6052/TCP, 6053/TCP, 6054/TCP, 6055/TCP, 6056/TCP, 6057/TCP, 6058/TCP, 6059/TCP, 6060/TCP, 6061/TCP, 6062/TCP, 6063/TCP, 6064/TCP, 6065/TCP, 6066/TCP, 6067/TCP, 6068/TCP, 6069/TCP, 6070/TCP, 6071/TCP, 6072/TCP, 6073/TCP, 6074/TCP, 6075/TCP, 6076/TCP, 6077/TCP, 6078/TCP, 6079/TCP, 6080/TCP, 6081/ TCP, 6082/TCP, 6083/TCP, 6084/TCP, 6085/TCP, 6086/TCP, 6087/TCP, 6088/TCP, 6089/TCP, 6090/TCP, 6091/TCP, 6092/TCP, 6093/TCP, 6094/TCP, 6095/TCP, 6096/TCP, 6097/TCP, 6098/TCP, 6099/TCP, 6100/TCP, 6101/TCP, 6102/TCP, 6103/TCP, 6104/TCP, 6105/TCP, 6106/TCP, 6107/TCP, 6108/TCP, 6109/TCP, 6110/TCP, 6111/TCP, 6112/TCP, 6113/TCP, 6114/TCP, 6115/TCP, 6116/ TCP, 6117/TCP, 6118/TCP, 6119/TCP, 6120/TCP, 6121/TCP, 6122/TCP, 6123/TCP, 6124/TCP, 6125/TCP, 6126/TCP, 6127/TCP, 6128/TCP, 6129/TCP, 6130/TCP, 6131/TCP, 6132/TCP, 6133/TCP, 6134/TCP, 6135/TCP, 6136/TCP, 6137/TCP, 6138/TCP, 6139/TCP, 6140/TCP, 6141/TCP, 6142/TCP, 6143/TCP, 6144/TCP, 6145/TCP, 6146/TCP, 6147/TCP, 6148/TCP, 6149/TCP, 6150/TCP, 6151/ TCP, 6152/TCP, 6153/TCP, 6154/TCP, 6155/TCP, 6156/TCP, 6157/TCP, 6158/TCP, 6159/TCP, 6160/TCP, 6161/TCP, 6162/TCP, 6163/TCP, 6164/TCP, 6165/TCP, 6166/TCP, 6167/TCP, 6168/TCP, 6169/TCP, 6170/TCP, 6171/TCP, 6172/TCP, 6173/TCP, 6174/TCP, 6175/TCP, 6176/TCP, 6177/TCP, 6178/TCP, 6179/TCP, 6180/TCP, 6181/TCP, 6182/TCP, 6183/TCP, 6184/TCP, 6185/TCP, 6186/ TCP, 6187/TCP, 6188/TCP, 6189/TCP, 6190/TCP, 6191/TCP, 6192/TCP, 6193/TCP, 6194/TCP, 6195/TCP, 6196/TCP, 6197/TCP, 6198/TCP, 6199/TCP, 6200/TCP, 6201/TCP, 6202/TCP, 6203/TCP, 6204/TCP, 6205/TCP, 6206/TCP, 6207/TCP, 6208/TCP, 6209/TCP, 6210/TCP, 6211/TCP, 6212/TCP, 6213/TCP, 6214/TCP, 6215/TCP, 6216/TCP, 6217/TCP, 6218/TCP, 6219/TCP, 6220/TCP, 6221/ TCP, 6222/TCP, 6223/TCP, 6224/TCP, 6225/TCP, 6226/TCP, 6227/TCP, 6228/TCP, 6229/TCP, 6230/TCP, 6231/TCP, 6232/TCP, 6233/TCP, 6234/TCP, 6235/TCP, 6236/TCP, 6237/TCP, 6238/TCP, 6239/TCP, 6240/TCP, 6241/TCP, 6242/TCP, 6243/TCP, 6244/TCP, 6245/TCP, 6246/TCP, 6247/TCP, 6248/TCP, 6249/TCP, 6250/TCP, 6251/TCP, 6252/TCP, 6253/TCP, 6254/TCP, 6255/TCP, 6256/ TCP, 6257/TCP, 6258/TCP, 6259/TCP, 6260/TCP, 6261/TCP, 6262/TCP, 6263/TCP, 6264/TCP, 6265/TCP, 6266/TCP, 6267/TCP, 6268/TCP, 6269/TCP, 6270/TCP, 6271/TCP, 6272/TCP, 6273/TCP, 6274/TCP, 6275/TCP, 6276/TCP, 6277/TCP, 6278/TCP, 6279/TCP, 6280/TCP, 6281/TCP, 6282/TCP, 6283/TCP, 6284/TCP, 6285/TCP, 6286/TCP, 6287/TCP, 6288/TCP, 6289/TCP, 6290/TCP, 6291/ TCP, 6292/TCP, 6293/TCP, 6294/TCP, 6295/TCP, 6296/TCP, 6297/TCP, 6298/TCP, 6299/TCP, 6300/TCP, 6301/TCP, 6302/TCP, 6303/TCP, 6304/TCP, 6305/TCP, 6306/TCP, 6307/TCP, 6308/TCP, 6309/TCP, 6310/TCP, 6311/TCP, 6312/TCP, 6313/TCP, 6314/TCP, 6315/TCP, 6316/TCP, 6317/TCP, 6318/TCP, 6319/TCP, 6320/TCP, 6321/TCP, 6322/TCP, 6323/TCP, 6324/TCP, 6325/TCP, 6326/ TCP, 6327/TCP, 6328/TCP, 6329/TCP, 6330/TCP, 6331/TCP, 6332/TCP, 6333/TCP, 6334/TCP, 6335/TCP, 6336/TCP, 6337/TCP, 6338/TCP, 6339/TCP, 6340/TCP, 6341/TCP, 6342/TCP, 6343/TCP, 6344/TCP, 6345/TCP, 6346/TCP, 6347/TCP, 6348/TCP, 6349/TCP, 6350/TCP, 6351/TCP, 6352/TCP, 6353/TCP, 6354/TCP, 6355/TCP, 6356/TCP, 6357/TCP, 6358/TCP, 6359/TCP, 6360/TCP, 6361/ TCP, 6362/TCP, 6363/TCP, 6364/TCP, 6365/TCP, 6366/TCP, 6367/TCP, 6368/TCP, 6369/TCP, 6370/TCP, 6371/TCP, 6372/TCP, 6373/TCP, 6374/TCP, 6375/TCP, 6376/TCP, 6377/TCP, 6378/TCP, 6379/TCP, 6380/TCP, 6381/TCP, 6382/TCP, 6383/TCP, 6384/TCP, 6385/TCP, 6386/TCP, 6387/TCP, 6388/TCP, 6389/TCP, 6390/TCP, 6391/TCP, 6392/TCP, 6393/TCP, 6394/TCP, 6395/TCP, 6396/ TCP, 6397/TCP, 6398/TCP, 6399/TCP, 6400/TCP, 6401/TCP, 6402/TCP, 6403/TCP, 6404/TCP, 6405/TCP, 6406/TCP, 6407/TCP, 6408/TCP, 6409/TCP, 6410/TCP, 6411/TCP, 6412/TCP, 6413/TCP, 6414/TCP, 6415/TCP, 6416/TCP, 6417/TCP, 6418/TCP, 6419/TCP, 6420/TCP, 6421/TCP, 6422/TCP, 6423/TCP, 6424/TCP, 6425/TCP, 6426/TCP, 6427/TCP, 6428/TCP, 6429/TCP, 6430/TCP, 6431/ TCP, 6432/TCP, 6433/TCP, 6434/TCP, 6435/TCP, 6436/TCP, 6437/TCP, 6438/TCP, 6439/TCP, 6440/TCP, 6441/TCP, 6442/TCP, 6443/TCP, 6444/TCP, 6445/TCP, 6446/TCP, 6447/TCP, 6448/TCP, 6449/TCP, 6450/TCP, 6451/TCP, 6452/TCP, 6453/TCP, 6454/TCP, 6455/TCP, 6456/TCP, 6457/TCP, 6458/TCP, 6459/TCP, 6460/TCP, 6461/TCP, 6462/TCP, 6463/TCP, 6464/TCP, 6465/TCP, 6466/ TCP, 6467/TCP, 6468/TCP, 6469/TCP, 6470/TCP, 6471/TCP, 6472/TCP, 6473/TCP, 6474/TCP, 6475/TCP, 6476/TCP, 6477/TCP, 6478/TCP, 6479/TCP, 6480/TCP, 6481/TCP, 6482/TCP, 6483/TCP, 6484/TCP, 6485/TCP, 6486/TCP, 6487/TCP, 6488/TCP, 6489/TCP, 6490/TCP, 6491/TCP, 6492/TCP, 6493/TCP, 6494/TCP, 6495/TCP, 6496/TCP, 6497/TCP, 6498/TCP, 6499/TCP, 6500/TCP, 6501/ TCP, 6502/TCP, 6503/TCP, 6504/TCP, 6505/TCP, 6506/TCP, 6507/TCP, 6508/TCP, 6509/TCP, 6510/TCP, 6511/TCP, 6512/TCP, 6513/TCP, 6514/TCP, 6515/TCP, 6516/TCP, 6517/TCP, 6518/TCP, 6519/TCP, 6520/TCP, 6521/TCP, 6522/TCP, 6523/TCP, 6524/TCP, 6525/TCP, 6526/TCP, 6527/TCP, 6528/TCP, 6529/TCP, 6530/TCP, 6531/TCP, 6532/TCP, 6533/TCP, 6534/TCP, 6535/TCP, 6536/ TCP, 6537/TCP, 6538/TCP, 6539/TCP, 6540/TCP, 6541/TCP, 6542/TCP, 6543/TCP, 6544/TCP, 6545/TCP, 6546/TCP, 6547/TCP, 6548/TCP, 6549/TCP, 6550/TCP, 6551/TCP, 6552/TCP, 6553/TCP, 6554/TCP, 6555/TCP, 6556/TCP, 6557/TCP, 6558/TCP, 6559/TCP, 6560/TCP, 6561/TCP, 6562/TCP, 6563/TCP, 6564/TCP, 6565/TCP, 6566/TCP, 6567/TCP, 6568/TCP, 6569/TCP, 6570/TCP, 6571/ TCP, 6572/TCP, 6573/TCP, 6574/TCP, 6575/TCP, 6576/TCP, 6577/TCP, 6578/TCP, 6579/TCP, 6580/TCP, 6581/TCP, 6582/TCP, 6583/TCP, 6584/TCP, 6585/TCP, 6586/TCP, 6587/TCP, 6588/TCP, 6589/TCP, 6590/TCP, 6591/TCP, 6592/TCP, 6593/TCP, 6594/TCP, 6595/TCP, 6596/TCP, 6597/TCP, 6598/TCP, 6599/TCP, 6600/TCP, 6601/TCP, 6602/TCP, 6603/TCP, 6604/TCP, 6605/TCP, 6606/ TCP, 6607/TCP, 6608/TCP, 6609/TCP, 6610/TCP, 6611/TCP, 6612/TCP, 6613/TCP, 6614/TCP, 6615/TCP, 6616/TCP, 6617/TCP, 6618/TCP, 6619/TCP, 6620/TCP, 6621/TCP, 6622/TCP, 6623/TCP, 6624/TCP, 6625/TCP, 6626/TCP, 6627/TCP, 6628/TCP, 6629/TCP, 6630/TCP, 6631/TCP, 6632/TCP, 6633/TCP, 6634/TCP, 6635/TCP, 6636/TCP, 6637/TCP, 6638/TCP, 6639/TCP, 6640/TCP, 6641/ TCP, 6642/TCP, 6643/TCP, 6644/TCP, 6645/TCP, 6646/TCP, 6647/TCP, 6648/TCP, 6649/TCP, 6650/TCP, 6651/TCP, 6652/TCP, 6653/TCP, 6654/TCP, 6655/TCP, 6656/TCP, 6657/TCP, 6658/TCP, 6659/TCP, 6660/TCP, 6661/TCP, 6662/TCP, 6663/TCP, 6664/TCP, 6665/TCP, 6666/TCP, 6667/TCP, 6668/TCP, 6669/TCP, 6670/TCP, 6671/TCP, 6672/TCP, 6673/TCP, 6674/TCP, 6675/TCP, 6676/ TCP, 6677/TCP, 6678/TCP, 6679/TCP, 6680/TCP, 6681/TCP, 6682/TCP, 6683/TCP, 6684/TCP, 6685/TCP, 6686/TCP, 6687/TCP, 6688/TCP, 6689/TCP, 6690/TCP, 6691/TCP, 6692/TCP, 6693/TCP, 6694/TCP, 6695/TCP, 6696/TCP, 6697/TCP, 6698/TCP, 6699/TCP, 6700/TCP, 6701/TCP, 6702/TCP, 6703/TCP, 6704/TCP, 6705/TCP, 6706/TCP, 6707/TCP, 6708/TCP, 6709/TCP, 6710/TCP, 6711/ TCP, 6712/TCP, 6713/TCP, 6714/TCP, 6715/TCP, 6716/TCP, 6717/TCP, 6718/TCP, 6719/TCP, 6720/TCP, 6721/TCP, 6722/TCP, 6723/TCP, 6724/TCP, 6725/TCP, 6726/TCP, 6727/TCP, 6728/TCP, 6729/TCP, 6730/TCP, 6731/TCP, 6732/TCP, 6733/TCP, 6734/TCP, 6735/TCP, 6736/TCP, 6737/TCP, 6738/TCP, 6739/TCP, 6740/TCP, 6741/TCP, 6742/TCP, 6743/TCP, 6744/TCP, 6745/TCP, 6746/ TCP, 6747/TCP, 6748/TCP, 6749/TCP, 6750/TCP, 6751/TCP, 6752/TCP, 6753/TCP, 6754/TCP, 6755/TCP, 6756/TCP, 6757/TCP, 6758/TCP, 6759/TCP, 6760/TCP, 6761/TCP, 6762/TCP, 6763/TCP, 6764/TCP, 6765/TCP, 6766/TCP, 6767/TCP, 6768/TCP, 6769/TCP, 6770/TCP, 6771/TCP, 6772/TCP, 6773/TCP, 6774/TCP, 6775/TCP, 6776/TCP, 6777/TCP, 6778/TCP, 6779/TCP, 6780/TCP, 6781/ TCP, 6782/TCP, 6783/TCP, 6784/TCP, 6785/TCP, 6786/TCP, 6787/TCP, 6788/TCP, 6789/TCP, 6790/TCP, 6791/TCP, 6792/TCP, 6793/TCP, 6794/TCP, 6795/TCP, 6796/TCP, 6797/TCP, 6798/TCP, 6799/TCP, 6800/TCP, 6801/TCP, 6802/TCP, 6803/TCP, 6804/TCP, 6805/TCP, 6806/TCP, 6807/TCP, 6808/TCP, 6809/TCP, 6810/TCP, 6811/TCP, 6812/TCP, 6813/TCP, 6814/TCP, 6815/TCP, 6816/ TCP, 6817/TCP, 6818/TCP, 6819/TCP, 6820/TCP, 6821/TCP, 6822/TCP, 6823/TCP, 6824/TCP, 6825/TCP, 6826/TCP, 6827/TCP, 6828/TCP, 6829/TCP, 6830/TCP, 6831/TCP, 6832/TCP, 6833/TCP, 6834/TCP, 6835/TCP, 6836/TCP, 6837/TCP, 6838/TCP, 6839/TCP, 6840/TCP, 6841/TCP, 6842/TCP, 6843/TCP, 6844/TCP, 6845/TCP, 6846/TCP, 6847/TCP, 6848/TCP, 6849/TCP, 6850/TCP, 6851/ TCP, 6852/TCP, 6853/TCP, 6854/TCP, 6855/TCP, 6856/TCP, 6857/TCP, 6858/TCP, 6859/TCP, 6860/TCP, 6861/TCP, 6862/TCP, 6863/TCP, 6864/TCP, 6865/TCP, 6866/TCP, 6867/TCP, 6868/TCP, 6869/TCP, 6870/TCP, 6871/TCP, 6872/TCP, 6873/TCP, 6874/TCP, 6875/TCP, 6876/TCP, 6877/TCP, 6878/TCP, 6879/TCP, 6880/TCP, 6881/TCP, 6882/TCP, 6883/TCP, 6884/TCP, 6885/TCP, 6886/ TCP, 6887/TCP, 6888/TCP, 6889/TCP, 6890/TCP, 6891/TCP, 6892/TCP, 6893/TCP, 6894/TCP, 6895/TCP, 6896/TCP, 6897/TCP, 6898/TCP, 6899/TCP, 6900/TCP, 6901/TCP, 6902/TCP, 6903/TCP, 6904/TCP, 6905/TCP, 6906/TCP, 6907/TCP, 6908/TCP, 6909/TCP, 6910/TCP, 6911/TCP, 6912/TCP, 6913/TCP, 6914/TCP, 6915/TCP, 6916/TCP, 6917/TCP, 6918/TCP, 6919/TCP, 6920/TCP, 6921/ TCP, 6922/TCP, 6923/TCP, 6924/TCP, 6925/TCP, 6926/TCP, 6927/TCP, 6928/TCP, 6929/TCP, 6930/TCP, 6931/TCP, 6932/TCP, 6933/TCP, 6934/TCP, 6935/TCP, 6936/TCP, 6937/TCP, 6938/TCP, 6939/TCP, 6940/TCP, 6941/TCP, 6942/TCP, 6943/TCP, 6944/TCP, 6945/TCP, 6946/TCP, 6947/TCP, 6948/TCP, 6949/TCP, 6950/TCP, 6951/TCP, 6952/TCP, 6953/TCP, 6954/TCP, 6955/TCP, 6956/ TCP, 6957/TCP, 6958/TCP, 6959/TCP, 6960/TCP, 6961/TCP, 6962/TCP, 6963/TCP, 6964/TCP, 6965/TCP, 6966/TCP, 6967/TCP, 6968/TCP, 6969/TCP, 6970/TCP, 6971/TCP, 6972/TCP, 6973/TCP, 6974/TCP, 6975/TCP, 6976/TCP, 6977/TCP, 6978/TCP, 6979/TCP, 6980/TCP, 6981/TCP, 6982/TCP, 6983/TCP, 6984/TCP, 6985/TCP, 6986/TCP, 6987/TCP, 6988/TCP, 6989/TCP, 6990/TCP, 6991/ TCP, 6992/TCP, 6993/TCP, 6994/TCP, 6995/TCP, 6996/TCP, 6997/TCP, 6998/TCP, 6999/TCP
Host Ports: 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/ TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP
State: Waiting
Reason: CrashLoopBackOff
Last State: Terminated
Reason: Error
Exit Code: 2
Started: Fri, 12 Jun 2020 15:54:27 +0200
Finished: Fri, 12 Jun 2020 15:55:00 +0200
Ready: False
Restart Count: 4
Limits:
cpu: 1
memory: 2Gi
Requests:
cpu: 1
memory: 1Gi
Readiness: exec [/usr/sbin/riak-admin test] delay=45s timeout=30s period=10s #success=1 #failure=10
Environment:
COORDINATOR_NODE: rk-mfn-0.rk-mfn.knix-test.svc
WAIT_FOR_ERLANG: 180
CLUSTER_NAME: riak
PB_PORT: 8087
HTTP_PORT: 8098
ERLANG_DISTRIBUTION_PORT_RANGE_MINIMUM: 6000
ERLANG_DISTRIBUTION_PORT_RANGE_MAXIMUM: 6999
LOG_CONSOLE_LEVEL: debug
BITCASK_MERGE_POLICY: always
BITCASK_MERGE_TRIGGERS_FRAGMENTATION: 20
BITCASK_MERGE_TRIGGERS_DEAD_BYTES: 2MB
BITCASK_MERGE_THRESHOLDS_FRAGMENTATION: 10
BITCASK_MERGE_THRESHOLDS_DEAD_BYTES: 1MB
BITCASK_MERGE_THRESHOLDS_SMALL_FILE: 512GB
BITCASK_MERGE_CHECK_INTERVAL: 1m
BITCASK_MAX_FILE_SIZE: 100MB
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from default-token-vbh6g (ro)
Conditions:
Type Status
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
default-token-vbh6g:
Type: Secret (a volume populated by a Secret)
SecretName: default-token-vbh6g
Optional: false
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: <none>
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled <unknown> default-scheduler Successfully assigned knix-test/rk-mfn-1 to nokia-k8s-worker-01
Normal Started 3m5s (x4 over 5m23s) kubelet, nokia-k8s-worker-01 Started container riak
Normal Pulling 108s (x5 over 5m24s) kubelet, nokia-k8s-worker-01 Pulling image "slfg92.rcs.de.alcatel-lucent.com:443/microfn/riak:latest"
Normal Pulled 108s (x5 over 5m23s) kubelet, nokia-k8s-worker-01 Successfully pulled image "slfg92.rcs.de.alcatel-lucent.com:443/microfn/riak:latest"
Normal Created 108s (x5 over 5m23s) kubelet, nokia-k8s-worker-01 Created container riak
Warning BackOff 10s (x12 over 4m15s) kubelet, nokia-k8s-worker-01 Back-off restarting failed container
$ k logs rk-mfn-1
+ [[ -x /usr/sbin/riak ]]
+ export RIAK=/usr/sbin/riak
+ RIAK=/usr/sbin/riak
+ export RIAK_CONF=/etc/riak/riak.conf
+ RIAK_CONF=/etc/riak/riak.conf
+ export USER_CONF=/etc/riak/user.conf
+ USER_CONF=/etc/riak/user.conf
+ export RIAK_ADVANCED_CONF=/etc/riak/advanced.config
+ RIAK_ADVANCED_CONF=/etc/riak/advanced.config
+ [[ -x /usr/sbin/riak-admin ]]
+ export RIAK_ADMIN=/usr/sbin/riak-admin
+ RIAK_ADMIN=/usr/sbin/riak-admin
+ export SCHEMAS_DIR=/etc/riak/schemas/
+ SCHEMAS_DIR=/etc/riak/schemas/
+ export PB_PORT=8087
+ PB_PORT=8087
+ export HTTP_PORT=8098
+ HTTP_PORT=8098
++ hostname -f
+ HOSTNAME=rk-mfn-1.rk-mfn.knix-test.svc.cluster.local
++ hostname -i
+ export HOST=192.168.87.52
+ HOST=192.168.87.52
+ export CLUSTER_NAME=riak
+ CLUSTER_NAME=riak
+ export COORDINATOR_NODE=rk-mfn-0.rk-mfn.knix-test.svc
+ COORDINATOR_NODE=rk-mfn-0.rk-mfn.knix-test.svc
++ python -c 'import socket; print(socket.gethostbyname("rk-mfn-0.rk-mfn.knix-test.svc") or "127.0.0.1");'
+ export COORDINATOR_NODE_HOST=192.168.195.37
+ COORDINATOR_NODE_HOST=192.168.195.37
+ export ERLANG_DISTRIBUTION_PORT_RANGE_MINIMUM=6000
+ ERLANG_DISTRIBUTION_PORT_RANGE_MINIMUM=6000
+ export ERLANG_DISTRIBUTION_PORT_RANGE_MAXIMUM=6999
+ ERLANG_DISTRIBUTION_PORT_RANGE_MAXIMUM=6999
+ export LOG_CONSOLE_LEVEL=debug
+ LOG_CONSOLE_LEVEL=debug
+ export BITCASK_MERGE_POLICY=always
+ BITCASK_MERGE_POLICY=always
+ export BITCASK_MERGE_CHECK_INTERVAL=1m
+ BITCASK_MERGE_CHECK_INTERVAL=1m
+ export BITCASK_MERGE_TRIGGERS_FRAGMENTATION=20
+ BITCASK_MERGE_TRIGGERS_FRAGMENTATION=20
+ export BITCASK_MERGE_TRIGGERS_DEAD_BYTES=2MB
+ BITCASK_MERGE_TRIGGERS_DEAD_BYTES=2MB
+ export BITCASK_MERGE_THRESHOLDS_FRAGMENTATION=10
+ BITCASK_MERGE_THRESHOLDS_FRAGMENTATION=10
+ export BITCASK_MERGE_THRESHOLDS_DEAD_BYTES=1MB
+ BITCASK_MERGE_THRESHOLDS_DEAD_BYTES=1MB
+ export BITCASK_MERGE_THRESHOLDS_SMALL_FILE=512GB
+ BITCASK_MERGE_THRESHOLDS_SMALL_FILE=512GB
+ export BITCASK_MAX_FILE_SIZE=100MB
+ BITCASK_MAX_FILE_SIZE=100MB
++ find /etc/riak/prestart.d -name '*.sh' -print
++ sort
+ PRESTART='/etc/riak/prestart.d/00-update-riak-conf.sh
/etc/riak/prestart.d/01-advanced-config.sh
/etc/riak/prestart.d/77-mfn.sh'
+ for s in '$PRESTART'
+ . /etc/riak/prestart.d/00-update-riak-conf.sh
++ sed -i -r 's/^nodename .*$//' /etc/riak/riak.conf
++ sed -i -r 's/^distributed_cookie .*$//' /etc/riak/riak.conf
++ sed -i -r 's/^listener\.protobuf\.internal .*$//' /etc/riak/riak.conf
++ sed -i -r 's/^listener\.http\.internal .*$//' /etc/riak/riak.conf
++ sed -i -r 's/^erlang\.distribution\.port_range\.minimum .*$//' /etc/riak/riak.conf
++ sed -i -r 's/^erlang\.distribution\.port_range\.maximum .*$//' /etc/riak/riak.conf
++ sed -i -r 's/^log\.console\.level .*$//' /etc/riak/riak.conf
++ sed -i -r 's/^bitcask\.merge\.policy .*$//' /etc/riak/riak.conf
++ sed -i -r 's/^bitcask\.merge\.triggers\.fragmentation .*$//' /etc/riak/riak.conf
++ sed -i -r 's/^bitcask\.merge\.triggers\.dead_bytes .*$//' /etc/riak/riak.conf
++ sed -i -r 's/^bitcask\.merge\.thresholds\.fragmentation .*$//' /etc/riak/riak.conf
++ sed -i -r 's/^bitcask\.merge\.thresholds\.dead_bytes .*$//' /etc/riak/riak.conf
++ sed -i -r 's/^bitcask\.merge\.thresholds\.small_file .*$//' /etc/riak/riak.conf
++ sed -i -r 's/^bitcask\.merge_check_interval .*$//' /etc/riak/riak.conf
++ sed -i -r 's/^bitcask\.max_file_size .*$//' /etc/riak/riak.conf
++ cat
++ '[' -s /etc/riak/user.conf ']'
+ for s in '$PRESTART'
+ . /etc/riak/prestart.d/01-advanced-config.sh
+++ awk -F= '/ring_size/{print $2}' /etc/riak/riak.conf
+++ sed 's/[ ]//'
++ RING_SIZE=64
++ CLUSTER_CONVERGENCE=standard
++ [[ ! -e /etc/riak/advanced.config ]]
+ for s in '$PRESTART'
+ . /etc/riak/prestart.d/77-mfn.sh
++ DIR=/usr/lib/riak/lib/mfn_counter_triggers
++ FILE=mfn_counter_triggers.erl
++ echo 'Compiling triggers in /usr/lib/riak/lib/mfn_counter_triggers/mfn_counter_triggers.erl'
++ cd /usr/lib/riak/lib/mfn_counter_triggers
Compiling triggers in /usr/lib/riak/lib/mfn_counter_triggers/mfn_counter_triggers.erl
+++ dpkg -L riak
+++ grep '/erlc$'
++ /usr/lib/riak/erts-5.10.3/bin/erlc mfn_counter_triggers.erl
mfn_counter_triggers.erl:58: Warning: a term is constructed, but never used
mfn_counter_triggers.erl:72: Warning: variable 'Headers' is unused
mfn_counter_triggers.erl:72: Warning: variable 'HttpProtocol' is unused
mfn_counter_triggers.erl:115: Warning: a term is constructed, but never used
++ chmod 664 mfn_counter_triggers.beam
++ cd -
++ DIR=/usr/lib/riak/lib/workflow_triggers
++ FILE=workflow_triggers.erl
++ echo 'Compiling triggers in /usr/lib/riak/lib/workflow_triggers/workflow_triggers.erl'
++ cd /usr/lib/riak/lib/workflow_triggers
/var/lib/riak
Compiling triggers in /usr/lib/riak/lib/workflow_triggers/workflow_triggers.erl
+++ grep '/erlc$'
+++ dpkg -L riak
++ /usr/lib/riak/erts-5.10.3/bin/erlc workflow_triggers.erl
workflow_triggers.erl:63: Warning: a term is constructed, but never used
workflow_triggers.erl:91: Warning: a term is constructed, but never used
workflow_triggers.erl:106: Warning: a term is constructed, but never used
workflow_triggers.erl:131: Warning: variable 'Value' is unused
workflow_triggers.erl:145: Warning: variable 'Headers' is unused
workflow_triggers.erl:145: Warning: variable 'HttpProtocol' is unused
++ chmod 664 workflow_triggers.beam
++ cd -
/var/lib/riak
+ WAIT_FOR_ERLANG=180
+ WAIT_FOR_ERLANG=180
+ /usr/sbin/riak start
+ /usr/sbin/riak-admin wait-for-service riak_kv
riak_kv is not up: []
riak_kv is up
++ sort
++ find /etc/riak/poststart.d -name '*.sh' -print
+ POSTSTART='/etc/riak/poststart.d/01-bootstrap-schemas.sh
/etc/riak/poststart.d/02-bootstrap-datatypes.sh
/etc/riak/poststart.d/10-join-cluster.sh
/etc/riak/poststart.d/77-mfn.sh'
+ for s in '$POSTSTART'
+ . /etc/riak/poststart.d/01-bootstrap-schemas.sh
++ '[' '' == TS ']'
+ for s in '$POSTSTART'
+ . /etc/riak/poststart.d/02-bootstrap-datatypes.sh
++ echo 'Looking for datatypes in /etc/riak/schemas/...'
Looking for datatypes in /etc/riak/schemas/...
+++ find /etc/riak/schemas/ -name '*.dt' -print
+ for s in '$POSTSTART'
+ . /etc/riak/poststart.d/10-join-cluster.sh
+++ /usr/sbin/riak-admin cluster status
+++ grep rk-mfn-0.rk-mfn.knix-test.svc
++ [[ -z '' ]]
++ [[ rk-mfn-0.rk-mfn.knix-test.svc != rk-mfn-1.rk-mfn.knix-test.svc.cluster.local* ]]
++ [[ rk-mfn-1.rk-mfn.knix-test.svc.cluster.local != rk-mfn-0.rk-mfn.knix-test.svc* ]]
++ echo 'Connecting to cluster coordinator rk-mfn-0.rk-mfn.knix-test.svc'
++ ping -c 1 rk-mfn-0.rk-mfn.knix-test.svc
Connecting to cluster coordinator rk-mfn-0.rk-mfn.knix-test.svc
ping: icmp open socket: Operation not permitted
Expected behavior
All replicas of riak statefulset should be running.
Thanks for filing this issue!
Just a few more pieces of information from your end: does the cluster you’re using allow ‘ping’?
Yes. I can ping a public domain from the cluster but cannot from a riak pod.
Thanks! That sounds like a name resolution error.
Is rk-mfn-0.rk-mfn.knix-test.svc.cluster.local
reachable via ping from another riak pod?
@manuelstein, do you have any suggestions?
The ping does not work out in any pods, data-layer, Nginx, frontend, riak. The message was always ping: socket: Operation not permitted
or ping: icmp open socket: Operation not permitted
.
This question in stackoverflow seems relevant.
Perhaps we should use curl
or wget
inside the 10-join-cluster.sh script instead of ping, @manuelstein?
FYI. The ping to rk-mfn-0.rk-mfn.knix-test.svc.cluster.local
works from an arbitrary pod of istio.
Yes, it seems to be a security limitation that prevents a non-root user in the pod to create a raw socket for ICMP. I've opened a PR that uses curl instead.
I'm sorry I can't test if the quick fix works reliably. It does run in our setup. @hpthai7 could you check #42 and test in your environment if this solves your issue?
Latest release: https://github.com/knix-microfunctions/knix/releases/tag/0.8.4.1
A new deployment still incurs an error. The logs do not show what error happens behind the scene.
$ k get pods
NAME READY STATUS RESTARTS AGE
dl-mfn-0 1/1 Running 0 27m
dl-mfn-1 1/1 Running 0 27m
es-mfn-0 1/1 Running 0 27m
mfn-predel-job-5lc2p 0/1 Error 0 25m
mfn-predel-job-6cm9n 0/1 Error 0 27m
mfn-predel-job-8h8tm 0/1 Error 0 26m
mfn-predel-job-8pjrl 0/1 Error 0 26m
mfn-predel-job-f97nq 0/1 Error 0 24m
mfn-predel-job-g2zp8 0/1 Error 0 26m
mfn-predel-job-wn5rp 0/1 Error 0 21m
mgr-mfn-n76vk 0/1 Completed 0 27m
nx-mfn-7858745f87-zgbz6 1/2 CrashLoopBackOff 10 27m
rk-mfn-0 1/1 Running 0 27m
rk-mfn-1 0/1 CrashLoopBackOff 8 25m
$ k describe pods rk-mfn-1
Name: rk-mfn-1
Namespace: knix-test
Priority: 0
Node: nokia-k8s-worker-02/172.16.1.8
Start Time: Tue, 16 Jun 2020 16:48:21 +0200
Labels: app=microfunctions-riak
controller-revision-hash=rk-mfn-b69676bdf
release=mfn
statefulset.kubernetes.io/pod-name=rk-mfn-1
Annotations: kubernetes.io/psp: restricted
seccomp.security.alpha.kubernetes.io/pod: docker/default
Status: Running
IP: 192.168.195.19
IPs:
IP: 192.168.195.19
Controlled By: StatefulSet/rk-mfn
Containers:
riak:
Container ID: docker://6864b12a973ec271e12b944a28efd00ab510448adb7c5261667374dccb986b2a
Image: slfg92.rcs.de.alcatel-lucent.com:443/microfn/riak:latest
Image ID: docker-pullable://slfg92.rcs.de.alcatel-lucent.com:443/microfn/riak@sha256:19bb7c7521482f0c2e31e2d57959bb3f633bef3784a6032a8d4473ac7e3f5fb9
Ports: 8098/TCP, 8087/TCP, 4369/TCP, 8099/TCP, 6000/TCP, 6001/TCP, 6002/TCP, 6003/TCP, 6004/TCP, 6005/TCP, 6006/TCP, 6007/TCP, 6008/TCP, 6009/TCP, 6010/TCP, 6011/TCP, 6012/TCP, 6013/TCP, 6014/TCP, 6015/TCP, 6016/TCP, 6017/TCP, 6018/TCP, 6019/TCP, 6020/TCP, 6021/TCP, 6022/TCP, 6023/TCP, 6024/TCP, 6025/TCP, 6026/TCP, 6027/TCP, 6028/TCP, 6029/TCP, 6030/TCP, 6031/TCP, 6032/TCP, 6033/TCP, 6034/TCP, 6035/TCP, 6036/TCP, 6037/TCP, 6038/TCP, 6039/TCP, 6040/TCP, 6041/TCP, 6042/TCP, 6043/TCP, 6044/TCP, 6045/TCP, 6046/TCP, 6047/TCP, 6048/TCP, 6049/TCP, 6050/TCP, 6051/TCP, 6052/TCP, 6053/TCP, 6054/TCP, 6055/TCP, 6056/TCP, 6057/TCP, 6058/TCP, 6059/TCP, 6060/TCP, 6061/TCP, 6062/TCP, 6063/TCP, 6064/TCP, 6065/TCP, 6066/TCP, 6067/TCP, 6068/TCP, 6069/TCP, 6070/TCP, 6071/TCP, 6072/TCP, 6073/TCP, 6074/TCP, 6075/TCP, 6076/TCP, 6077/TCP, 6078/TCP, 6079/TCP, 6080/TCP, 6081/TCP, 6082/TCP, 6083/TCP, 6084/TCP, 6085/TCP, 6086/TCP, 6087/TCP, 6088/TCP, 6089/TCP, 6090/TCP, 6091/TCP, 6092/TCP, 6093/TCP, 6094/TCP, 6095/TCP, 6096/TCP, 6097/TCP, 6098/TCP, 6099/TCP, 6100/TCP, 6101/TCP, 6102/TCP, 6103/TCP, 6104/TCP, 6105/TCP, 6106/TCP, 6107/TCP, 6108/TCP, 6109/TCP, 6110/TCP, 6111/TCP, 6112/TCP, 6113/TCP, 6114/TCP, 6115/TCP, 6116/TCP, 6117/TCP, 6118/TCP, 6119/TCP, 6120/TCP, 6121/TCP, 6122/TCP, 6123/TCP, 6124/TCP, 6125/TCP, 6126/TCP, 6127/TCP, 6128/TCP, 6129/TCP, 6130/TCP, 6131/TCP, 6132/TCP, 6133/TCP, 6134/TCP, 6135/TCP, 6136/TCP, 6137/TCP, 6138/TCP, 6139/TCP, 6140/TCP, 6141/TCP, 6142/TCP, 6143/TCP, 6144/TCP, 6145/TCP, 6146/TCP, 6147/TCP, 6148/TCP, 6149/TCP, 6150/TCP, 6151/TCP, 6152/TCP, 6153/TCP, 6154/TCP, 6155/TCP, 6156/TCP, 6157/TCP, 6158/TCP, 6159/TCP, 6160/TCP, 6161/TCP, 6162/TCP, 6163/TCP, 6164/TCP, 6165/TCP, 6166/TCP, 6167/TCP, 6168/TCP, 6169/TCP, 6170/TCP, 6171/TCP, 6172/TCP, 6173/TCP, 6174/TCP, 6175/TCP, 6176/TCP, 6177/TCP, 6178/TCP, 6179/TCP, 6180/TCP, 6181/TCP, 6182/TCP, 6183/TCP, 6184/TCP, 6185/TCP, 6186/TCP, 6187/TCP, 6188/TCP, 6189/TCP, 6190/TCP, 6191/TCP, 6192/TCP, 6193/TCP, 6194/TCP, 6195/TCP, 6196/TCP, 6197/TCP, 6198/TCP, 6199/TCP, 6200/TCP, 6201/TCP, 6202/TCP, 6203/TCP, 6204/TCP, 6205/TCP, 6206/TCP, 6207/TCP, 6208/TCP, 6209/TCP, 6210/TCP, 6211/TCP, 6212/TCP, 6213/TCP, 6214/TCP, 6215/TCP, 6216/TCP, 6217/TCP, 6218/TCP, 6219/TCP, 6220/TCP, 6221/TCP, 6222/TCP, 6223/TCP, 6224/TCP, 6225/TCP, 6226/TCP, 6227/TCP, 6228/TCP, 6229/TCP, 6230/TCP, 6231/TCP, 6232/TCP, 6233/TCP, 6234/TCP, 6235/TCP, 6236/TCP, 6237/TCP, 6238/TCP, 6239/TCP, 6240/TCP, 6241/TCP, 6242/TCP, 6243/TCP, 6244/TCP, 6245/TCP, 6246/TCP, 6247/TCP, 6248/TCP, 6249/TCP, 6250/TCP, 6251/TCP, 6252/TCP, 6253/TCP, 6254/TCP, 6255/TCP, 6256/TCP, 6257/TCP, 6258/TCP, 6259/TCP, 6260/TCP, 6261/TCP, 6262/TCP, 6263/TCP, 6264/TCP, 6265/TCP, 6266/TCP, 6267/TCP, 6268/TCP, 6269/TCP, 6270/TCP, 6271/TCP, 6272/TCP, 6273/TCP, 6274/TCP, 6275/TCP, 6276/TCP, 6277/TCP, 6278/TCP, 6279/TCP, 6280/TCP, 6281/TCP, 6282/TCP, 6283/TCP, 6284/TCP, 6285/TCP, 6286/TCP, 6287/TCP, 6288/TCP, 6289/TCP, 6290/TCP, 6291/TCP, 6292/TCP, 6293/TCP, 6294/TCP, 6295/TCP, 6296/TCP, 6297/TCP, 6298/TCP, 6299/TCP, 6300/TCP, 6301/TCP, 6302/TCP, 6303/TCP, 6304/TCP, 6305/TCP, 6306/TCP, 6307/TCP, 6308/TCP, 6309/TCP, 6310/TCP, 6311/TCP, 6312/TCP, 6313/TCP, 6314/TCP, 6315/TCP, 6316/TCP, 6317/TCP, 6318/TCP, 6319/TCP, 6320/TCP, 6321/TCP, 6322/TCP, 6323/TCP, 6324/TCP, 6325/TCP, 6326/TCP, 6327/TCP, 6328/TCP, 6329/TCP, 6330/TCP, 6331/TCP, 6332/TCP, 6333/TCP, 6334/TCP, 6335/TCP, 6336/TCP, 6337/TCP, 6338/TCP, 6339/TCP, 6340/TCP, 6341/TCP, 6342/TCP, 6343/TCP, 6344/TCP, 6345/TCP, 6346/TCP, 6347/TCP, 6348/TCP, 6349/TCP, 6350/TCP, 6351/TCP, 6352/TCP, 6353/TCP, 6354/TCP, 6355/TCP, 6356/TCP, 6357/TCP, 6358/TCP, 6359/TCP, 6360/TCP, 6361/TCP, 6362/TCP, 6363/TCP, 6364/TCP, 6365/TCP, 6366/TCP, 6367/TCP, 6368/TCP, 6369/TCP, 6370/TCP, 6371/TCP, 6372/TCP, 6373/TCP, 6374/TCP, 6375/TCP, 6376/TCP, 6377/TCP, 6378/TCP, 6379/TCP, 6380/TCP, 6381/TCP, 6382/TCP, 6383/TCP, 6384/TCP, 6385/TCP, 6386/TCP, 6387/TCP, 6388/TCP, 6389/TCP, 6390/TCP, 6391/TCP, 6392/TCP, 6393/TCP, 6394/TCP, 6395/TCP, 6396/TCP, 6397/TCP, 6398/TCP, 6399/TCP, 6400/TCP, 6401/TCP, 6402/TCP, 6403/TCP, 6404/TCP, 6405/TCP, 6406/TCP, 6407/TCP, 6408/TCP, 6409/TCP, 6410/TCP, 6411/TCP, 6412/TCP, 6413/TCP, 6414/TCP, 6415/TCP, 6416/TCP, 6417/TCP, 6418/TCP, 6419/TCP, 6420/TCP, 6421/TCP, 6422/TCP, 6423/TCP, 6424/TCP, 6425/TCP, 6426/TCP, 6427/TCP, 6428/TCP, 6429/TCP, 6430/TCP, 6431/TCP, 6432/TCP, 6433/TCP, 6434/TCP, 6435/TCP, 6436/TCP, 6437/TCP, 6438/TCP, 6439/TCP, 6440/TCP, 6441/TCP, 6442/TCP, 6443/TCP, 6444/TCP, 6445/TCP, 6446/TCP, 6447/TCP, 6448/TCP, 6449/TCP, 6450/TCP, 6451/TCP, 6452/TCP, 6453/TCP, 6454/TCP, 6455/TCP, 6456/TCP, 6457/TCP, 6458/TCP, 6459/TCP, 6460/TCP, 6461/TCP, 6462/TCP, 6463/TCP, 6464/TCP, 6465/TCP, 6466/TCP, 6467/TCP, 6468/TCP, 6469/TCP, 6470/TCP, 6471/TCP, 6472/TCP, 6473/TCP, 6474/TCP, 6475/TCP, 6476/TCP, 6477/TCP, 6478/TCP, 6479/TCP, 6480/TCP, 6481/TCP, 6482/TCP, 6483/TCP, 6484/TCP, 6485/TCP, 6486/TCP, 6487/TCP, 6488/TCP, 6489/TCP, 6490/TCP, 6491/TCP, 6492/TCP, 6493/TCP, 6494/TCP, 6495/TCP, 6496/TCP, 6497/TCP, 6498/TCP, 6499/TCP, 6500/TCP, 6501/TCP, 6502/TCP, 6503/TCP, 6504/TCP, 6505/TCP, 6506/TCP, 6507/TCP, 6508/TCP, 6509/TCP, 6510/TCP, 6511/TCP, 6512/TCP, 6513/TCP, 6514/TCP, 6515/TCP, 6516/TCP, 6517/TCP, 6518/TCP, 6519/TCP, 6520/TCP, 6521/TCP, 6522/TCP, 6523/TCP, 6524/TCP, 6525/TCP, 6526/TCP, 6527/TCP, 6528/TCP, 6529/TCP, 6530/TCP, 6531/TCP, 6532/TCP, 6533/TCP, 6534/TCP, 6535/TCP, 6536/TCP, 6537/TCP, 6538/TCP, 6539/TCP, 6540/TCP, 6541/TCP, 6542/TCP, 6543/TCP, 6544/TCP, 6545/TCP, 6546/TCP, 6547/TCP, 6548/TCP, 6549/TCP, 6550/TCP, 6551/TCP, 6552/TCP, 6553/TCP, 6554/TCP, 6555/TCP, 6556/TCP, 6557/TCP, 6558/TCP, 6559/TCP, 6560/TCP, 6561/TCP, 6562/TCP, 6563/TCP, 6564/TCP, 6565/TCP, 6566/TCP, 6567/TCP, 6568/TCP, 6569/TCP, 6570/TCP, 6571/TCP, 6572/TCP, 6573/TCP, 6574/TCP, 6575/TCP, 6576/TCP, 6577/TCP, 6578/TCP, 6579/TCP, 6580/TCP, 6581/TCP, 6582/TCP, 6583/TCP, 6584/TCP, 6585/TCP, 6586/TCP, 6587/TCP, 6588/TCP, 6589/TCP, 6590/TCP, 6591/TCP, 6592/TCP, 6593/TCP, 6594/TCP, 6595/TCP, 6596/TCP, 6597/TCP, 6598/TCP, 6599/TCP, 6600/TCP, 6601/TCP, 6602/TCP, 6603/TCP, 6604/TCP, 6605/TCP, 6606/TCP, 6607/TCP, 6608/TCP, 6609/TCP, 6610/TCP, 6611/TCP, 6612/TCP, 6613/TCP, 6614/TCP, 6615/TCP, 6616/TCP, 6617/TCP, 6618/TCP, 6619/TCP, 6620/TCP, 6621/TCP, 6622/TCP, 6623/TCP, 6624/TCP, 6625/TCP, 6626/TCP, 6627/TCP, 6628/TCP, 6629/TCP, 6630/TCP, 6631/TCP, 6632/TCP, 6633/TCP, 6634/TCP, 6635/TCP, 6636/TCP, 6637/TCP, 6638/TCP, 6639/TCP, 6640/TCP, 6641/TCP, 6642/TCP, 6643/TCP, 6644/TCP, 6645/TCP, 6646/TCP, 6647/TCP, 6648/TCP, 6649/TCP, 6650/TCP, 6651/TCP, 6652/TCP, 6653/TCP, 6654/TCP, 6655/TCP, 6656/TCP, 6657/TCP, 6658/TCP, 6659/TCP, 6660/TCP, 6661/TCP, 6662/TCP, 6663/TCP, 6664/TCP, 6665/TCP, 6666/TCP, 6667/TCP, 6668/TCP, 6669/TCP, 6670/TCP, 6671/TCP, 6672/TCP, 6673/TCP, 6674/TCP, 6675/TCP, 6676/TCP, 6677/TCP, 6678/TCP, 6679/TCP, 6680/TCP, 6681/TCP, 6682/TCP, 6683/TCP, 6684/TCP, 6685/TCP, 6686/TCP, 6687/TCP, 6688/TCP, 6689/TCP, 6690/TCP, 6691/TCP, 6692/TCP, 6693/TCP, 6694/TCP, 6695/TCP, 6696/TCP, 6697/TCP, 6698/TCP, 6699/TCP, 6700/TCP, 6701/TCP, 6702/TCP, 6703/TCP, 6704/TCP, 6705/TCP, 6706/TCP, 6707/TCP, 6708/TCP, 6709/TCP, 6710/TCP, 6711/TCP, 6712/TCP, 6713/TCP, 6714/TCP, 6715/TCP, 6716/TCP, 6717/TCP, 6718/TCP, 6719/TCP, 6720/TCP, 6721/TCP, 6722/TCP, 6723/TCP, 6724/TCP, 6725/TCP, 6726/TCP, 6727/TCP, 6728/TCP, 6729/TCP, 6730/TCP, 6731/TCP, 6732/TCP, 6733/TCP, 6734/TCP, 6735/TCP, 6736/TCP, 6737/TCP, 6738/TCP, 6739/TCP, 6740/TCP, 6741/TCP, 6742/TCP, 6743/TCP, 6744/TCP, 6745/TCP, 6746/TCP, 6747/TCP, 6748/TCP, 6749/TCP, 6750/TCP, 6751/TCP, 6752/TCP, 6753/TCP, 6754/TCP, 6755/TCP, 6756/TCP, 6757/TCP, 6758/TCP, 6759/TCP, 6760/TCP, 6761/TCP, 6762/TCP, 6763/TCP, 6764/TCP, 6765/TCP, 6766/TCP, 6767/TCP, 6768/TCP, 6769/TCP, 6770/TCP, 6771/TCP, 6772/TCP, 6773/TCP, 6774/TCP, 6775/TCP, 6776/TCP, 6777/TCP, 6778/TCP, 6779/TCP, 6780/TCP, 6781/TCP, 6782/TCP, 6783/TCP, 6784/TCP, 6785/TCP, 6786/TCP, 6787/TCP, 6788/TCP, 6789/TCP, 6790/TCP, 6791/TCP, 6792/TCP, 6793/TCP, 6794/TCP, 6795/TCP, 6796/TCP, 6797/TCP, 6798/TCP, 6799/TCP, 6800/TCP, 6801/TCP, 6802/TCP, 6803/TCP, 6804/TCP, 6805/TCP, 6806/TCP, 6807/TCP, 6808/TCP, 6809/TCP, 6810/TCP, 6811/TCP, 6812/TCP, 6813/TCP, 6814/TCP, 6815/TCP, 6816/TCP, 6817/TCP, 6818/TCP, 6819/TCP, 6820/TCP, 6821/TCP, 6822/TCP, 6823/TCP, 6824/TCP, 6825/TCP, 6826/TCP, 6827/TCP, 6828/TCP, 6829/TCP, 6830/TCP, 6831/TCP, 6832/TCP, 6833/TCP, 6834/TCP, 6835/TCP, 6836/TCP, 6837/TCP, 6838/TCP, 6839/TCP, 6840/TCP, 6841/TCP, 6842/TCP, 6843/TCP, 6844/TCP, 6845/TCP, 6846/TCP, 6847/TCP, 6848/TCP, 6849/TCP, 6850/TCP, 6851/TCP, 6852/TCP, 6853/TCP, 6854/TCP, 6855/TCP, 6856/TCP, 6857/TCP, 6858/TCP, 6859/TCP, 6860/TCP, 6861/TCP, 6862/TCP, 6863/TCP, 6864/TCP, 6865/TCP, 6866/TCP, 6867/TCP, 6868/TCP, 6869/TCP, 6870/TCP, 6871/TCP, 6872/TCP, 6873/TCP, 6874/TCP, 6875/TCP, 6876/TCP, 6877/TCP, 6878/TCP, 6879/TCP, 6880/TCP, 6881/TCP, 6882/TCP, 6883/TCP, 6884/TCP, 6885/TCP, 6886/TCP, 6887/TCP, 6888/TCP, 6889/TCP, 6890/TCP, 6891/TCP, 6892/TCP, 6893/TCP, 6894/TCP, 6895/TCP, 6896/TCP, 6897/TCP, 6898/TCP, 6899/TCP, 6900/TCP, 6901/TCP, 6902/TCP, 6903/TCP, 6904/TCP, 6905/TCP, 6906/TCP, 6907/TCP, 6908/TCP, 6909/TCP, 6910/TCP, 6911/TCP, 6912/TCP, 6913/TCP, 6914/TCP, 6915/TCP, 6916/TCP, 6917/TCP, 6918/TCP, 6919/TCP, 6920/TCP, 6921/TCP, 6922/TCP, 6923/TCP, 6924/TCP, 6925/TCP, 6926/TCP, 6927/TCP, 6928/TCP, 6929/TCP, 6930/TCP, 6931/TCP, 6932/TCP, 6933/TCP, 6934/TCP, 6935/TCP, 6936/TCP, 6937/TCP, 6938/TCP, 6939/TCP, 6940/TCP, 6941/TCP, 6942/TCP, 6943/TCP, 6944/TCP, 6945/TCP, 6946/TCP, 6947/TCP, 6948/TCP, 6949/TCP, 6950/TCP, 6951/TCP, 6952/TCP, 6953/TCP, 6954/TCP, 6955/TCP, 6956/TCP, 6957/TCP, 6958/TCP, 6959/TCP, 6960/TCP, 6961/TCP, 6962/TCP, 6963/TCP, 6964/TCP, 6965/TCP, 6966/TCP, 6967/TCP, 6968/TCP, 6969/TCP, 6970/TCP, 6971/TCP, 6972/TCP, 6973/TCP, 6974/TCP, 6975/TCP, 6976/TCP, 6977/TCP, 6978/TCP, 6979/TCP, 6980/TCP, 6981/TCP, 6982/TCP, 6983/TCP, 6984/TCP, 6985/TCP, 6986/TCP, 6987/TCP, 6988/TCP, 6989/TCP, 6990/TCP, 6991/TCP, 6992/TCP, 6993/TCP, 6994/TCP, 6995/TCP, 6996/TCP, 6997/TCP, 6998/TCP, 6999/TCP
Host Ports: 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP
State: Waiting
Reason: CrashLoopBackOff
Last State: Terminated
Reason: Error
Exit Code: 7
Started: Tue, 16 Jun 2020 16:54:36 +0200
Finished: Tue, 16 Jun 2020 16:55:04 +0200
Ready: False
Restart Count: 5
Limits:
cpu: 1
memory: 3Gi
Requests:
cpu: 1
memory: 1Gi
Readiness: exec [/usr/sbin/riak ping] delay=45s timeout=30s period=10s #success=1 #failure=10
Environment:
COORDINATOR_NODE: rk-mfn-0.rk-mfn.knix-test.svc.cluster.local
WAIT_FOR_ERLANG: 180
CLUSTER_NAME: riak
PB_PORT: 8087
HTTP_PORT: 8098
ERLANG_DISTRIBUTION_PORT_RANGE_MINIMUM: 6000
ERLANG_DISTRIBUTION_PORT_RANGE_MAXIMUM: 6999
LOG_CONSOLE_LEVEL: debug
BITCASK_MERGE_POLICY: always
BITCASK_MERGE_TRIGGERS_FRAGMENTATION: 20
BITCASK_MERGE_TRIGGERS_DEAD_BYTES: 2MB
BITCASK_MERGE_THRESHOLDS_FRAGMENTATION: 10
BITCASK_MERGE_THRESHOLDS_DEAD_BYTES: 1MB
BITCASK_MERGE_THRESHOLDS_SMALL_FILE: 512GB
BITCASK_MERGE_CHECK_INTERVAL: 1m
BITCASK_MAX_FILE_SIZE: 100MB
Mounts:
/var/lib/riak from riak-data-dir (rw)
/var/run/secrets/kubernetes.io/serviceaccount from default-token-t7pxt (ro)
Conditions:
Type Status
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
riak-data-dir:
Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)
ClaimName: riak-data-dir-rk-mfn-1
ReadOnly: false
default-token-t7pxt:
Type: Secret (a volume populated by a Secret)
SecretName: default-token-t7pxt
Optional: false
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: <none>
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning FailedScheduling <unknown> default-scheduler pod has unbound immediate PersistentVolumeClaims (repeated 2 times)
Normal Scheduled <unknown> default-scheduler Successfully assigned knix-test/rk-mfn-1 to nokia-k8s-worker-02
Normal SuccessfulAttachVolume 7m43s attachdetach-controller AttachVolume.Attach succeeded for volume "pvc-e2aa2cfe-5672-48a2-bca6-baed145c8fde"
Normal Created 5m8s (x4 over 7m31s) kubelet, nokia-k8s-worker-02 Created container riak
Normal Started 5m8s (x4 over 7m31s) kubelet, nokia-k8s-worker-02 Started container riak
Normal Pulling 3m39s (x5 over 7m33s) kubelet, nokia-k8s-worker-02 Pulling image "slfg92.rcs.de.alcatel-lucent.com:443/microfn/riak:latest"
Normal Pulled 3m39s (x5 over 7m32s) kubelet, nokia-k8s-worker-02 Successfully pulled image "slfg92.rcs.de.alcatel-lucent.com:443/microfn/riak:latest"
Warning BackOff 2m32s (x11 over 6m27s) kubelet, nokia-k8s-worker-02 Back-off restarting failed container
$ k logs -f rk-mfn-1
+ [[ -x /usr/sbin/riak ]]
+ export RIAK=/usr/sbin/riak
+ RIAK=/usr/sbin/riak
+ export RIAK_CONF=/etc/riak/riak.conf
+ RIAK_CONF=/etc/riak/riak.conf
+ export USER_CONF=/etc/riak/user.conf
+ USER_CONF=/etc/riak/user.conf
+ export RIAK_ADVANCED_CONF=/etc/riak/advanced.config
+ RIAK_ADVANCED_CONF=/etc/riak/advanced.config
+ [[ -x /usr/sbin/riak-admin ]]
+ export RIAK_ADMIN=/usr/sbin/riak-admin
+ RIAK_ADMIN=/usr/sbin/riak-admin
+ export SCHEMAS_DIR=/etc/riak/schemas/
+ SCHEMAS_DIR=/etc/riak/schemas/
+ export PB_PORT=8087
+ PB_PORT=8087
+ export HTTP_PORT=8098
+ HTTP_PORT=8098
++ hostname -f
+ HOSTNAME=rk-mfn-1.rk-mfn.knix-test.svc.cluster.local
++ hostname -i
+ export HOST=192.168.195.19
+ HOST=192.168.195.19
+ export CLUSTER_NAME=riak
+ CLUSTER_NAME=riak
+ export COORDINATOR_NODE=rk-mfn-0.rk-mfn.knix-test.svc.cluster.local
+ COORDINATOR_NODE=rk-mfn-0.rk-mfn.knix-test.svc.cluster.local
++ python -c 'import socket; print(socket.gethostbyname("rk-mfn-0.rk-mfn.knix-test.svc.cluster.local") or "127.0.0.1");'
+ export COORDINATOR_NODE_HOST=192.168.87.46
+ COORDINATOR_NODE_HOST=192.168.87.46
+ export ERLANG_DISTRIBUTION_PORT_RANGE_MINIMUM=6000
+ ERLANG_DISTRIBUTION_PORT_RANGE_MINIMUM=6000
+ export ERLANG_DISTRIBUTION_PORT_RANGE_MAXIMUM=6999
+ ERLANG_DISTRIBUTION_PORT_RANGE_MAXIMUM=6999
+ export LOG_CONSOLE_LEVEL=debug
+ LOG_CONSOLE_LEVEL=debug
+ export BITCASK_MERGE_POLICY=always
+ BITCASK_MERGE_POLICY=always
+ export BITCASK_MERGE_CHECK_INTERVAL=1m
+ BITCASK_MERGE_CHECK_INTERVAL=1m
+ export BITCASK_MERGE_TRIGGERS_FRAGMENTATION=20
+ BITCASK_MERGE_TRIGGERS_FRAGMENTATION=20
+ export BITCASK_MERGE_TRIGGERS_DEAD_BYTES=2MB
+ BITCASK_MERGE_TRIGGERS_DEAD_BYTES=2MB
+ export BITCASK_MERGE_THRESHOLDS_FRAGMENTATION=10
+ BITCASK_MERGE_THRESHOLDS_FRAGMENTATION=10
+ export BITCASK_MERGE_THRESHOLDS_DEAD_BYTES=1MB
+ BITCASK_MERGE_THRESHOLDS_DEAD_BYTES=1MB
+ export BITCASK_MERGE_THRESHOLDS_SMALL_FILE=512GB
+ BITCASK_MERGE_THRESHOLDS_SMALL_FILE=512GB
+ export BITCASK_MAX_FILE_SIZE=100MB
+ BITCASK_MAX_FILE_SIZE=100MB
++ find /etc/riak/prestart.d -name '*.sh' -print
++ sort
+ PRESTART='/etc/riak/prestart.d/00-update-riak-conf.sh
/etc/riak/prestart.d/01-advanced-config.sh
/etc/riak/prestart.d/77-mfn.sh'
+ for s in '$PRESTART'
+ . /etc/riak/prestart.d/00-update-riak-conf.sh
++ sed -i -r 's/^nodename .*$//' /etc/riak/riak.conf
++ sed -i -r 's/^distributed_cookie .*$//' /etc/riak/riak.conf
++ sed -i -r 's/^listener\.protobuf\.internal .*$//' /etc/riak/riak.conf
++ sed -i -r 's/^listener\.http\.internal .*$//' /etc/riak/riak.conf
++ sed -i -r 's/^erlang\.distribution\.port_range\.minimum .*$//' /etc/riak/riak.conf
++ sed -i -r 's/^erlang\.distribution\.port_range\.maximum .*$//' /etc/riak/riak.conf
++ sed -i -r 's/^log\.console\.level .*$//' /etc/riak/riak.conf
++ sed -i -r 's/^bitcask\.merge\.policy .*$//' /etc/riak/riak.conf
++ sed -i -r 's/^bitcask\.merge\.triggers\.fragmentation .*$//' /etc/riak/riak.conf
++ sed -i -r 's/^bitcask\.merge\.triggers\.dead_bytes .*$//' /etc/riak/riak.conf
++ sed -i -r 's/^bitcask\.merge\.thresholds\.fragmentation .*$//' /etc/riak/riak.conf
++ sed -i -r 's/^bitcask\.merge\.thresholds\.dead_bytes .*$//' /etc/riak/riak.conf
++ sed -i -r 's/^bitcask\.merge\.thresholds\.small_file .*$//' /etc/riak/riak.conf
++ sed -i -r 's/^bitcask\.merge_check_interval .*$//' /etc/riak/riak.conf
++ sed -i -r 's/^bitcask\.max_file_size .*$//' /etc/riak/riak.conf
++ cat
++ '[' -s /etc/riak/user.conf ']'
+ for s in '$PRESTART'
+ . /etc/riak/prestart.d/01-advanced-config.sh
+++ awk -F= '/ring_size/{print $2}' /etc/riak/riak.conf
+++ sed 's/[ ]//'
++ RING_SIZE=64
++ CLUSTER_CONVERGENCE=standard
++ [[ ! -e /etc/riak/advanced.config ]]
+ for s in '$PRESTART'
+ . /etc/riak/prestart.d/77-mfn.sh
++ DIR=/usr/lib/riak/lib/mfn_counter_triggers
++ FILE=mfn_counter_triggers.erl
++ echo 'Compiling triggers in /usr/lib/riak/lib/mfn_counter_triggers/mfn_counter_triggers.erl'
Compiling triggers in /usr/lib/riak/lib/mfn_counter_triggers/mfn_counter_triggers.erl
++ cd /usr/lib/riak/lib/mfn_counter_triggers
+++ dpkg -L riak
+++ grep '/erlc$'
++ /usr/lib/riak/erts-5.10.3/bin/erlc mfn_counter_triggers.erl
mfn_counter_triggers.erl:58: Warning: a term is constructed, but never used
mfn_counter_triggers.erl:72: Warning: variable 'Headers' is unused
mfn_counter_triggers.erl:72: Warning: variable 'HttpProtocol' is unused
mfn_counter_triggers.erl:115: Warning: a term is constructed, but never used
++ chmod 664 mfn_counter_triggers.beam
++ cd -
/var/lib/riak
++ DIR=/usr/lib/riak/lib/workflow_triggers
++ FILE=workflow_triggers.erl
++ echo 'Compiling triggers in /usr/lib/riak/lib/workflow_triggers/workflow_triggers.erl'
++ cd /usr/lib/riak/lib/workflow_triggers
Compiling triggers in /usr/lib/riak/lib/workflow_triggers/workflow_triggers.erl
+++ dpkg -L riak
+++ grep '/erlc$'
++ /usr/lib/riak/erts-5.10.3/bin/erlc workflow_triggers.erl
workflow_triggers.erl:63: Warning: a term is constructed, but never used
workflow_triggers.erl:91: Warning: a term is constructed, but never used
workflow_triggers.erl:106: Warning: a term is constructed, but never used
workflow_triggers.erl:131: Warning: variable 'Value' is unused
workflow_triggers.erl:145: Warning: variable 'Headers' is unused
workflow_triggers.erl:145: Warning: variable 'HttpProtocol' is unused
++ chmod 664 workflow_triggers.beam
/var/lib/riak
++ cd -
+ WAIT_FOR_ERLANG=180
+ WAIT_FOR_ERLANG=180
+ /usr/sbin/riak start
+ /usr/sbin/riak-admin wait-for-service riak_kv
riak_kv is not up: []
riak_kv is up
++ sort
++ find /etc/riak/poststart.d -name '*.sh' -print
+ POSTSTART='/etc/riak/poststart.d/01-bootstrap-schemas.sh
/etc/riak/poststart.d/02-bootstrap-datatypes.sh
/etc/riak/poststart.d/10-join-cluster.sh
/etc/riak/poststart.d/77-mfn.sh'
+ for s in '$POSTSTART'
+ . /etc/riak/poststart.d/01-bootstrap-schemas.sh
++ '[' '' == TS ']'
+ for s in '$POSTSTART'
+ . /etc/riak/poststart.d/02-bootstrap-datatypes.sh
++ echo 'Looking for datatypes in /etc/riak/schemas/...'
Looking for datatypes in /etc/riak/schemas/...
+++ find /etc/riak/schemas/ -name '*.dt' -print
+ for s in '$POSTSTART'
+ . /etc/riak/poststart.d/10-join-cluster.sh
++ [[ rk-mfn-0.rk-mfn.knix-test.svc.cluster.local != rk-mfn-1.rk-mfn.knix-test.svc.cluster.local* ]]
++ [[ rk-mfn-1.rk-mfn.knix-test.svc.cluster.local != rk-mfn-0.rk-mfn.knix-test.svc.cluster.local* ]]
Connecting to cluster coordinator rk-mfn-0.rk-mfn.knix-test.svc.cluster.local
++ echo 'Connecting to cluster coordinator rk-mfn-0.rk-mfn.knix-test.svc.cluster.local'
++ curl -s http://rk-mfn-0.rk-mfn.knix-test.svc.cluster.local:
Sorry, @hpthai7, my bad. I forgot that shell variable names change with the specified helm release. The curl command should have said
curl -s http://rk-mfn-0.rk-mfn.knix-test.svc.cluster.local:8098
and you'll find I'm using RK_MFN1_SERVICE_PORT_HTTP where MFN1 is a presumed release name. I've added a fix in last commit to bug/40
Should be resolved with 0.8.5. Please re-open if not.