Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Crashloop while running as sidecar for initial minutes #46

Open
sijuu opened this issue Dec 5, 2023 · 1 comment
Open

Crashloop while running as sidecar for initial minutes #46

sijuu opened this issue Dec 5, 2023 · 1 comment
Labels
bug Something isn't working

Comments

@sijuu
Copy link

sijuu commented Dec 5, 2023

I am running cosmos-validator-watcher as sidecar with my cosmos node. The cosmos-validator-watcher container crashloops till the node is synced with following error.

11:00PM WRN node http://localhost:26657/ is catching up at block 2688992
11:00PM WRN connected to http://localhost:26657/ (but node is catching up) chainID=athens_7001-1 height=2688992
11:00PM ERR error="no nodes synced"

This causes panic as the container is crashlooping. When a pod restarts, its understandable that it will take some time for the node to be synced. It would be better if cosmos-validator has a while condition check ( as a flag atleast ) which checks for the node to be available and then start the watcher rather than just crashlooping.

@MattKetmo
Copy link
Member

Hello, yes indeed, this watcher will fail at startup if no node is up to date in the 5s after launch.

One question though is why you want to run as sidecar instead of running as separate deployment?

The main goal of the watcher is mainly watching validator status on-chain but using several endpoints so it doesn't rely only on 1 rpc endpoint.

@MattKetmo MattKetmo added the bug Something isn't working label Jan 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants