Since 2020-03-25 18:40:17, cxserver is alerting in icinga for
/v2/suggest/sections/{title}/{from}/{to} (Suggest source sections to translate) is CRITICAL: Test Suggest source sections to translate returned the unexpected status 404 (expecting: 200)
Looking at the spec this seems to be https://gerrit.wikimedia.org/r/plugins/gitiles/mediawiki/services/cxserver/+/refs/heads/master/spec.yaml#441 but it's unclear to me why this fails
Root cause is: https://github.com/wikimedia/restbase/commit/82565490ffe9c670fc57f43d4c400cbb23e1b55f where experimental endpoints were removed (Deployed on 03/25: https://tools.wmflabs.org/sal/log/AXES8HAy0fjmsHBaqHQ6 )
Change 584554 had a related patch set uploaded (by Santhosh; owner: Santhosh):
[mediawiki/services/cxserver@master] section suggestions: Fix the broken page metadata api
Change 584554 merged by jenkins-bot:
[mediawiki/services/cxserver@master] section suggestions: Fix the broken page metadata api
Change 584618 had a related patch set uploaded (by KartikMistry; owner: KartikMistry):
[operations/deployment-charts@master] Update cxserver to 2020-03-30-145349-production
Change 584618 merged by jenkins-bot:
[operations/deployment-charts@master] Update cxserver to 2020-03-30-145349-production
Mentioned in SAL (#wikimedia-operations) [2020-03-31T05:55:42Z] <kart_> Updated cxserver to 2020-03-30-145349-production (T248578)
I checked Icinga too and the alert is gone. Just wondering, should we get alerts delivered directly to us rather than waiting from someone to file tasks about them?
@santhosh, @kartik Thanks for handling this.
YES! We have a couple of options, namely IRC channel, team inbox email, personal emails and we might soon be able to have mobile notifications as well. Other teams already receive alerts for their services in one of those ways, so we can definitely set that up. Let me know what you prefer and I 'll get it working.