ServePath System Status

UPS Maintenance Feb 1st and 2nd 2010

noreply@blogger.com (Support) — Thu, 28 Jan 2010 15:12:10 PST

Please review the following information for upcoming scheduled maintenance details.

Maintenance Window:

Monday, February 1, 2010, 10:00 - 17:00 PST
(Monday, February 1, 2010, 18:00 - 01:00 GMT)
Tuesday, February 2, 2010, 10:00 - 17:00 PST
(Tuesday, February 2, 2010, 18:00 - 01:00 GMT)

Customer Impact:

There should be no impact to the power in the facility and no down time is expected.
This notice is for advisory purposes only.

Maintenance Details :

UPS 1,2,3 and 4 are being tested to ensure operational reliability.

We apologize for any inconvenience as we work hard to maintain the best data center practices and procedures required to ensure contingent power in case of an outage.

If there are any additional questions before, during, or following the maintenance, please direct them to the ServePath Support Center via phone or open a case online at http://my.ServePath.com or http://my.ColoServe.com.

UPS Maintenance and Generator Run - Completed

noreply@blogger.com (Support) — Fri, 15 Jan 2010 20:48:51 PST

**Update @ 8:00PM**

The maintenance has been completed and all customers have been moved off of contingent power supply. No issues have been reported as a result of this transfer. Customers that were impacted by last night's event and opened a case will receive an RFO.

**Update @ 8:18AM**

At approximately 20:00 PST last night while we were performing our scheduled monthly building power testing we experienced a failure with UPS 1, the UPS system blew a fuse and some customers on UPS 1 experienced a power reboot. At this time our main priority is to bring the UPS system back online and move off of generator power.

We have extended our maintenance window until this issue has been resolved, at that time our status updates will reflect this. We are sorry for the inconvenience this may have caused you.

**Update @ 1:16AM**

The UPS maintenance and generator run is still ongoing until further notice for both ColoServe and ServePath.

Brief Power Outage

noreply@blogger.com (Support) — Thu, 14 Jan 2010 23:29:43 PST

During a scheduled generator run, one of our UPS went off line causing a small subset of our customers to lose power. Our technicians are currently working on getting the UPS back online. More detailed information will be coming, including an official Reason For Outage (RFO), within the next day.

blog.servepath.com down for maintenance

noreply@blogger.com (GoGrid Systems Team) — Mon, 21 Dec 2009 14:46:37 PST

Maintenance Window:
Monday, December 21st, 2009 8:00

Customer Impact:
The Servepath "blog.servepath.com" website is currently unavailable.

Maintenance Details:
Servepath is making software improvements to the blogging website.

If there are any additional questions before, during, or following the maintenance please direct them to ServePath Support at 1-866-321-PATH or 415-869-7000 option 2. You may also open a support case at http://my.servepath.com.

Resolved -- Network Issues

noreply@blogger.com (Support) — Mon, 21 Dec 2009 15:37:15 PST

**Update @ 15:32 PST**

The network issues has been resolved by our Engineering team. If you have any questions please call ServePath Support (866-321-7284 or 415-869-7000) and we will be glad to help you.

UPS Maintenance and Generator Run

noreply@blogger.com (Support) — Thu, 01 Oct 2009 16:15:21 PDT

** Update @ 16:00 PDT **
Generator run for Oct 1st has been canceled. Scheduled maintenance is not affected for Oct 13th

Maintenance Window:

Thursday, October 1st, 10:00 to 17:00 PDT
(Thursday, October 1st, 17:00 to 02:00 GMT)

And

Tuesday, October 13th, 10:00 to 17:00 PDT
(Tuesday, October 13th, 17:00 to 02:00 GMT)

Customer Impact:
There should be no down time. This notice is for advisory purposes only.

Maintenance Details:
Tuesday, October 13th we will be performing maintenance on the UPS system. No downtime is expected as this is regularly scheduled preventative maintenance.

Thursday, October 1st we will be performing a generator run required to ensure contingent power in case of an outage. No downtime is expected as this is a regularly scheduled test.

If there are any additional questions before, during, or following the maintenance please direct them to ServePath Support at 1-866-321-PATH or 415-869-7000 option 2. You may also open a support case at http://my.servepath.com.

Resolved -- Level3 Network Issue

noreply@blogger.com (Support) — Fri, 31 Jul 2009 16:36:36 PDT

At approximately 01:10 PDT we noticed a sharp decline in traffic on our Level3 connection. Traffic returned at approximately 01:30 PDT and we are currently investigating the cause.

RFO
Level 3 was performing a scheduled maintenance in their internal network during which they inadvertently black-holed all our inbound and outbound traffic for around 20 minutes. Our traffic didn’t get automatically re-routed through other carriers because our BGP session with our next-hop router at Level 3 stayed up.

Completed -- ServePath Emergency Border Router Maintenance

noreply@blogger.com (Support) — Wed, 29 Jul 2009 15:57:22 PDT

We've discovered a failed power supply on our second border router which will be replaced tonight at 21:00 PDT.

No downtime is expected.

Completed -- UPS Maintenance

noreply@blogger.com (Support) — Wed, 29 Jul 2009 19:26:31 PDT

*** Update 7/29 @ 16:00 PDT ***
The UPS maintenance has been extended to 19:00 PDT.

Maintenance Windows:
Monday, July, 27 2009 10:00 - 17:00 PDT
(Monday, July, 27 2009 17:00 - 00:00 GMT)

Tuesday, July, 28 2009 10:00 - 17:00 PDT
(Tuesday, July, 28 2009 17:00 - 00:00 GMT)

Wednesday, July, 29 2009 10:00 - 17:00 PDT
(Wednesday, July, 29 2009 17:00 - 00:00 GMT)

Customer Impact:
There should be no impact to the power in the facility and no down time is expected. This is an advisory notice

Maintenance Details:
UPS systems will be undergoing standard quarterly maintenance.

Firewall Outage

noreply@blogger.com (Support) — Tue, 30 Jun 2009 23:41:12 PDT

At approximately 7:45 PM PDT, we experienced a failure on one of our blades on the Fortinet Firewall. As of 8:45 PM PDT, the blade on the firewall has been restored to service.

Completed -- Private Network Maintenance

noreply@blogger.com (Support) — Fri, 26 Jun 2009 16:21:44 PDT

Maintenance Window:
Thursday, June 25, 2009 19:00 - 20:00 PDT
(Friday, June 26, 2008 02:00 - 03:00 GMT)

Customer Impact:

The following Services may be affected:

1. GoGrid Cloud Connect
Your dedicated servers will lose connectivity with GoGrid servers

2. Managed Backups & NAS
Your dedicated servers on the private network will lose connectivity to the NAS

3. Managed Server Load balancer
Your real servers may lose connectivity with the load balancer

4. Managed Firewall
Servers behind the firewall may lose connectivity with the firewall

Maintenance Details:
ServePath is replacing a private network core switch.

If there are any additional questions before, during or following the maintenance, please direct them to the ServePath Support Center at 866-321-PATH (866-321-7284), or you may open a case at https://my.servepath.com.

Completed -- Support case system maintenance

noreply@blogger.com (Support) — Sat, 13 Jun 2009 14:26:32 PDT

** Update @ 6/13 14:15 PDT **
Our support system is back online. Customers can once again view existing support cases and submit new ones from the portal.

Customer Impact
Our support case system became unavailable due to maintenance by the vendor. Customers were unable to submit new cases or view existing cases from the customer portal, and ServePath support staff were unable to view or receive updates to existing cases, but phone support was still available

Reschedule Pending -- Private Network Maintenance

noreply@blogger.com (Support) — Mon, 08 Jun 2009 16:54:47 PDT

** Update @ 16:00 PDT 6/8 **
Maintenance has been canceled for 6/8. We will be rescheduling this for the future.

Maintenance Window:
Monday, June 08, 2009 19:00 - 20:00 PDT
(Tuesday, June 09, 2008 02:00 - 03:00 GMT)

Customer Impact:
Your server(s) may lose network connectivity on the private network for up to 30 seconds.

Maintenance Details:
ServePath is replacing a private network core switch.

Completed -- Generator Run

noreply@blogger.com (Support) — Mon, 08 Jun 2009 16:54:26 PDT

Maintenance Window:
Thursday, June 4, 2009 19:00 - 23:59 PDT
(Friday, June 5, 2009 02:00 - 07:00 GMT)

Maintenance Details:
Generators are undergoing standard monthly testing.

Customer Impact:
There should be no impact to the power in the facility and no down time is expected. This notice is for advisory purposes only.

If there are any additional questions before, during, or following the maintenance, please direct them to ServePath Support Center via phone or open a case online at http://my.ServePath.com.

For the latest details on ServePath's systems, datacenter status, and status of this maintenance item, please visit http://www.gogridstatus.com. Thank You for your continuing support of ServePath and ColoServe.

Remote Power Cycling System Issue

noreply@blogger.com (Support) — Wed, 06 May 2009 18:04:08 PDT

Maintenance Window:

Started: Wednesday May 6, 2009 6:00 pm PST

Customer Impact:
This is a low impact issue. It may affect some customers with a short time delay.

Maintenance Details:

We are currently experiencing an intermittent issue for some customers preventing them from seeing their Power Outlets from the portal for quick power cycling.

If you find this to be a issue for your company please call us at 1-800-979-Colo (2656) or 1-866-321-Path (7284) and a technician will be happy to power cycle your system(s) for you as quickly as possible.

Thank you for your patience while we fix this issue and continue to improve our service for you.

Completed - Emergency Load Balancer Maintenance

noreply@blogger.com (Support) — Mon, 27 Apr 2009 20:08:05 PDT

Maintenance Window: Monday, April 27th, 2009 18:00 - 19:00 PDT
(Tuesday, April 28th, 2009 01:00 - 02:00 GMT)

Customer Impact:
Your load-balanced server(s) will be unreachable for less than 5 seconds as fail over occurs.

Maintenance Details:
Our hardware load balancing vendor has identified a new bug that causes one of the critical processes to fail causing a fail over from the active to the standby unit. They have created a hotfix, which will be applied during the maintenance window.

If there are any additional questions please direct them to ServePath Support at 1-866-321-Path or 415-869-7000 option 2. You may also open a support case at https://my.servepath.com.

Resolved -- Localized Power/Cooling Issue

noreply@blogger.com (Support) — Wed, 15 Apr 2009 09:47:56 PDT

Window:
Wednesday, April 15, 2009 07:13 - 09:30 PDT
(Wednesday, April 15, 2009 14:13 - 16:30 GMT)

Customer Impact:
Some services were interrupted

Details:
There was a brief utility power incident at approximately 07:13 PDT and our backup power system worked as it should. The cooling system which is managed by the building did not come back online properly and temperatures began to rise. At this time the cooling system is fixed and the temperature in the data center has stabilized.

If there are any additional questions please direct them to ServePath Support at 1-866-321-Path or 415-869-7000 option 2. You may also open a support case at https://my.servepath.com.

Completed -- System Maintenance

noreply@blogger.com (Support) — Wed, 15 Apr 2009 09:46:54 PDT

** Update @ 4/13 19:30 PDT **
The maintenance window has been updated. The new end time is 06:00 PDT.

Maintenance Window:
Tuesday, April 14, 01:00 - 06:00 PDT
(Tuesday, April 14, 08:00 - 01:00 GMT)

Customer Impact:
The customer service portal my.servepath.com, my.coloserve.com, my.upstreamnetworks.com, and order/billing systems will be unavailable.

Maintenance Details:
We are upgrading a core database layer to provide additional capacity to the service.

If there are any additional questions before, during, or following the maintenance please direct them to ServePath Support at 1-866-321-PATH (7284) or 415-869-7000 option 2.

Resolved -- Verio Offline

noreply@blogger.com (Support) — Fri, 10 Apr 2009 20:53:17 PDT

** Update @ 4/10 17:00 PDT **
Verio service has been restored, and traffic is being balanced. No customers were affected.

Customer Impact
At 05:34 PDT (GMT -7) our BGP session with Verio disconnected. We're presently working with Verio to resolve the problem. All traffic automatically failed over to our other transit providers.

Resolved -- Scheduled UPS Maintenance

noreply@blogger.com (Support) — Wed, 08 Apr 2009 16:38:40 PDT

Maintenance Window:
Tuesday, April 7, 2009, 10:00 - 17:00 PDT
(Tuesday, April 7, 2009, 17:00 - 24:00 GMT)

And

Wednesday, April 8, 2009, 10:00 - 17:00 PST
(Wednesday, April 8, 2009, 17:00 - 24:00 GMT)

Customer Impact:
There should be no down time. This notice is for advisory purposes only.

Maintenance Details:
Tuesday, April 7, 2009. We will be performing maintenance on the battery cabinets for UPS 1 and 2. No unit will be put into bypass, but we will have limited battery backup during the maintenance.

Wednesday, April 8, 2009. We will be performing battery maintenance and full diagnostic maintenance on UPS 3 and 4. Both units will be placed in bypass (1 at a time) during the maintenance.

If there are any additional questions please direct them to ServePath Support at 1-866-321-Path or 415-869-7000 option 2. You may also open a support case at https://my.servepath.com.

RFO - Network Service Disruption 3/27 @ 19:05 PDT (GMT -7)

noreply@blogger.com (Support) — Sat, 28 Mar 2009 18:04:15 PDT

Window
Friday, March 27, 2009 19:05 - 19:13 PDT
(Saturday, March 28, 2009 02:05 - 02:13 GMT)

Customer Impact
This event affected many customers

Details
While performing a proactive maintenance on the infrastructure to increase security and improve resilience to malicious attacks against our network, an incorrect configuration command was entered on the border routers which started to gradually block legitimate traffic. As soon as the maintenance engineer was notified by our monitoring tool, the erroneous configuration was reverted, and connectivity was restored.

Completed -- System Maintenance

noreply@blogger.com (Support) — Mon, 23 Mar 2009 07:37:22 PDT

Maintenance Window (Re-scheduled):
Friday, March 20th, 01:00 - 06:00 PDT
(Friday, March 20th, 08:00 - 13:00 GMT)

Customer Impact:
The customer service portal my.servepath.com, my.coloserve.com, my.upstreamnetworks.com, and order/billing systems will be unavailable.

Maintenance Details:
We will be performing internal system upgrades to improve the customer experience.

If there are any additional questions before, during, or following the maintenance please direct them to ServePath Support at 1-866-321-PATH (7284) or 415-869-7000 option 2.

Completed -- Generator Run

noreply@blogger.com (Support) — Fri, 06 Mar 2009 10:42:33 PST

Maintenance Window:
Thursday, March 5, 2009 20:00 - 00:00 PDT
(Friday, March 6, 2009 04:00 - 08:00 UTC)

Customer Impact:
There will be no customer impact.

Maintenance Details:
ServePath will be performing a generator run and all power will be swapped over from city utility to our generators for up to four hours.

If there are any additional questions before, during, or following the maintenance please direct them to ServePath Support at 1-866-321-PATH (7284) or 415-869-7000 option 2. You may also open a support case at http://my.servepath.com.

Completed -- Private Switch Maintenance

noreply@blogger.com (Support) — Wed, 10 Dec 2008 16:45:38 PST

Maintenance Window:
Tuesday, December 9th, 2008 21:00 - 22:00 PDT
(Wednesday, December 10th, 2008 04:00 - 05:00 GMT)

Customer Impact:
Servers on private switches 3 and 51 will have disrupted connectivity for up to 2 minutes

Maintenance Details:
ServePath is doing some maintenance work on the private network to improve performance.

If there are any additional questions before, during or following the maintenance, please direct them to the ServePath Support Center at +1-866-321-PATH (7284) or 1-415-869-7000, or open a case on-line at https://my.ServePath.com .

Completed -- Fortinet Maintenance

noreply@blogger.com (Support) — Thu, 16 Oct 2008 11:26:10 PDT

Maintenance Window:
Tuesday, October 14th, 2008 21:00 - 22:00 PDT
(Wednesday, October 15th, 2008 04:00 - 05:00 GMT)

Customer Impact:
Your servers will become unavailable up to 5 minutes.

Maintenance Details:
Operating system will be upgraded on the Fortinet firewall. ServePath is performing this pro-active maintenance to upgrade to a more stable release of FortiOS.