lemmy.cafe seems down. it returns a 502, indicating that something behind nginx went wrong. i checked !general@lemmy.cafe, but the last post is ~2 years ago. does anybody know whether .cafe has some planned downtime, or something else announced?

just prodding around, i also typed https://status.lemmy.cafe/ into my browser. that leads to their grafana login :-)

thanks to everyone contributing. but especially @Illecors@lemmy.cafe for not only maintaining the instance but also swiftly bringing it back up!

  • Illecors@lemmy.cafe
    link
    fedilink
    English
    arrow-up
    7
    ·
    3 hours ago

    Things should be back.

    There’s a problem I never got to figure out where the internal nginx container - sitting between anubis and UI containers - does not come back up after a restart.

    The VM this was running on had a fault on DigitalOcean side and got moved to another host. This included booting it back up, which did not bring that nginx container up. API worked, so all apps worked. It’s just the standard, photon and voyager UIs were down.

    Apologies.

    • tofu
      link
      fedilink
      English
      arrow-up
      3
      ·
      2 hours ago

      Does the container not start at all or does it crash? I forgot the specifics but nginx is kinda fragile when the site it’s supposed to proxy to is not ready

        • tofu
          link
          fedilink
          English
          arrow-up
          6
          ·
          2 hours ago

          Seems like it’s missing ‘restart: always’ in both green and blue. Anubis is lacking those as well though?

    • bretton.dev@coves.social
      link
      fedilink
      arrow-up
      2
      ·
      3 hours ago

      FWIW I’ve had multiple DigitalOcean VMs die seemingly out of nowhere.

      Never had a problem with OVH nor Hetzner.

      • Illecors@lemmy.cafe
        link
        fedilink
        English
        arrow-up
        2
        ·
        3 hours ago

        This was a first for me in ~7 years I’ve been using them. I’ve always found them really good, albeit expensive. And with the ever growing database for lemmy - I’m starting to consider other options.

  • Illecors@lemmy.cafe
    link
    fedilink
    English
    arrow-up
    10
    ·
    3 hours ago

    Ui seems to have gone down. API is still functional. Gimme a minute, will have a look at what’s going on.

  • tal@lemmy.today
    link
    fedilink
    English
    arrow-up
    8
    ·
    4 hours ago

    I hit archive.org’s Wayback Machine—learned in the process, that apparently use of Anubis breaks the Wayback Machine, which is…a little concerning. I don’t know how many websites out there aren’t being archived now…

    Anyway, from a pre-Anubis page Archive.org page, the admins appear to be:

    Looking at lemmy.world’s view of their user pages (which is still accessible):

    I don’t know whether user pages on remote instances than a user’s home instance are complete; I’m a little suspicious that they might only display comments and posts to communities to which at least one user who subscribes to the community with the post/comment on the home instance. But with lemmy.world the largest instance, my guess is that that’s the most-complete record of comments one might get.

    On lemvotes.org, looking for vote activity (which is probably at least-as-current):

    They might have non-admin accounts and use those for everything, but I’d guess that Illecors is likely going to be the only “active” admin, from that.

    Based on the view of the lemmy.world user page for him, he does follow !asklemmy@lemmy.world and a number of other major communities, so he might see something you post there if the instance is down and he’s using an account on another home instance to get on. He does not list any non-lemmy.cafe contact information in his user bio.

    The archive.org page I listed above does have:

    Lemmy Cafe Chatroom

    In case there’s a need for a chat-like environment, a SimpleX chat is now available.

    I’m not familiar with SimpleX, and I don’t know if that’s still active or if it’s possible to get to it through Archive.org’s archived page, but it does show a page with a QR code, which you might be able to scan with a mobile client to reach it.