Skip to content

All machines at nearform are offline #2451

Closed

Description

@mhdawson

Looks like all the machines hosted by nearform are offline in jenkins. I could still ssh into test-nearform_intel-ubuntu1604-x64-1 eariler

I'd tried restarting the agent earlier when I thought it was just one, and the failure was that it could not connect to the CI.

I checked that the IP was in the firewall so thinking its a problem on the nearform network side.

@jasnell can you check if there is something going on?

Activity

  1. mhdawson commented on Oct 5, 2020

    @mhdawson
    MemberAuthor

    @jasnell, @mcollina can you see if there is any known issue on the Nearform side

  2. jasnell commented on Oct 5, 2020

    @jasnell
    Member

    Checking... Will get back once I hear from our sysadmin

  3. mcollina commented on Oct 5, 2020

    @mcollina
    SponsorMember

    We are undergoing some maintenance on our own network.

  4. jasnell commented on Oct 6, 2020

    @jasnell
    Member

    Ok, so... it is sounding like the fans on the intel benchmarking machine may be going out. The machine was shutdown, possibly due to overheating. We're going to continue to monitor it but it should be up now if you can give it a try.

    The mac minis appear to be running fine. Please let me know if you're having issues with those.

  5. jasnell commented on Oct 7, 2020

    @jasnell
    Member

    Can someone confirm if they are able to access the servers now

  6. AshCripps commented on Oct 8, 2020

    @AshCripps
    Member

    @jasnell I can log in to the systems however none of them can connect to our jenkins server - they are in the firewall so they should connect just fine.

  7. jasnell commented on Oct 8, 2020

    @jasnell
    Member

    hmmm... ok... let me connect you directly with our sysops.... expect an email soon

  8. mhdawson commented on Oct 8, 2020

    @mhdawson
    MemberAuthor

    @AshCripps thanks for following up. What you reported was the same as I saw. We could ssh in, but they could not connect to the CI despite being in the firewall config.

  9. AshCripps commented on Oct 9, 2020

    @AshCripps
    Member

    Eamonn restarted the firewall at nearform's end and the machines are back up and now connecting to the CI 🎉 I also checked and brought the release mac back online. Closing.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions