I just bought the Cat 4 router yesterday and the power bank zlt ups50 is not indicating that it’s charging.

It's same result for every first users. The directive of using is direct power - UPS - CAT router. This means, your router is needed to plugged and switched on as if you'll want to use it as backup before the charging works. You'll will have to switch the ups on when plugged before the charging status displays.