Duration: 3 minutes

Affected Components: UK Core Router

Mar 10, 01:51:42 GMT+0
Investigating - AS136582 UK Core Router cannot be accessed at the moment. This incident was created by an automated monitoring service..

Mar 10, 01:54:22 GMT+0
Resolved - AS136582 UK Core Router is now operational! This update was created by an automated monitoring service..

Duration: 6 minutes

Affected Components: UK 02

Feb 27, 00:06:43 GMT+0
Investigating - UK 02 cannot be accessed at the moment. This incident was created by an automated monitoring service..

Feb 27, 00:12:23 GMT+0
Resolved - UK 02 is now operational! This update was created by an automated monitoring service..

Duration: 6 minutes

Affected Components: UK Core Router

Feb 27, 00:06:25 GMT+0
Investigating - AS136582 UK Core Router cannot be accessed at the moment. This incident was created by an automated monitoring service..

Feb 27, 00:12:32 GMT+0
Resolved - AS136582 UK Core Router is now operational! This update was created by an automated monitoring service..

Duration: 1 hour and 4 minutes

Affected Components: Sydney 03

Feb 13, 21:43:33 GMT+0
Investigating - Sydney 03 cannot be accessed at the moment. This incident was created by an automated monitoring service..

Feb 13, 22:47:40 GMT+0
Resolved - Sydney 03 is now operational! This update was created by an automated monitoring service..

Duration: 1 minute

Affected Components: AU Core Router

Jan 27, 23:50:37 GMT+0
Investigating - AS136582 Core Router cannot be accessed at the moment. This incident was created by an automated monitoring service..

Jan 27, 23:51:41 GMT+0
Resolved - AS136582 Core Router is now operational! This update was created by an automated monitoring service..

Duration: 7 minutes

Affected Components: UK Core Router

Jan 20, 09:42:26 GMT+0
Investigating - AS136582 UK Core Router cannot be accessed at the moment. This incident was created by an automated monitoring service..

Jan 20, 09:49:32 GMT+0
Resolved - AS136582 UK Core Router is now operational! This update was created by an automated monitoring service..

Jan 20, 11:53:07 GMT+0
Postmortem - This intermittent downtime was due to a carpet bombing DDoS Attack. We have worked closely with our amazing UK network partners to prevent this in the future..

Duration: 1 minute

Affected Components: Dedicated Control Panel

Dec 14, 06:45:55 GMT+0
Investigating - Dedicated Control Panel cannot be accessed at the moment. This incident was created by an automated monitoring service..

Dec 14, 06:46:27 GMT+0
Resolved - Dedicated Control Panel is now operational! This update was created by an automated monitoring service..

Duration: 2 minutes

Affected Components: AU Core Router

Dec 14, 04:58:41 GMT+0
Investigating - AS136582 Core Router cannot be accessed at the moment. This incident was created by an automated monitoring service..

Dec 14, 05:00:37 GMT+0
Resolved - AS136582 Core Router is now operational! This update was created by an automated monitoring service..

Duration: 42 minutes

Affected Components: Sydney 03

Dec 13, 16:32:43 GMT+0
Investigating - Sydney 03 cannot be accessed at the moment. This incident was created by an automated monitoring service..

Dec 13, 17:14:33 GMT+0
Resolved - Sydney 03 is now operational! This update was created by an automated monitoring service..

Duration: 3 hours and 54 minutes

Affected Components: Sydney 02

Dec 8, 23:30:00 GMT+0
Identified - We will be upgrading our Sydney 02 VPS Hypervisor to an NVMe-based SSD. This will allow for a significant performance and reliability increase. Because of the nature of hardware changes, all services will have to be offline for a period of time. We will work to minimize this as much as possible, and then schedule individual times to move services to the new drive. **For anything mission-critical, reach out to us, and we can migrate your service to another hypervisor.**.

Dec 8, 23:30:01 GMT+0
Identified - Maintenance is now in progress.

Dec 9, 01:23:07 GMT+0
Identified - Our new disk has been installed and we are running some performance tests to ensure it performs as expected. We are then going to begin migrating customer services over, which will take some time..

Dec 9, 03:24:14 GMT+0
Completed - VPS's are now being booted on the new disk. We appreciate your patience, and hope you will enjoy the new performance improvement..

Duration: 1 minute

Affected Components: Dedicated Control Panel

Dec 4, 13:03:36 GMT+0
Investigating - Dedicated Control Panel cannot be accessed at the moment. This incident was created by an automated monitoring service..

Dec 4, 13:04:35 GMT+0
Resolved - Dedicated Control Panel is now operational! This update was created by an automated monitoring service..

Duration: 6 minutes

Affected Components: Sydney 03

Dec 3, 12:30:19 GMT+0
Identified - We are investigating our Sydney 03 hypervisor becoming unresponsive. Our initial analysis shows this is due to an improper automatic allocation of resources. We are working on restoring services ASAP. In the case VPS's have shutdown, we will restart them..

Dec 3, 12:36:33 GMT+0
Resolved - The unresponsiveness was caused by a failed ram stick and an autoallocation issue. Our system has been rebooted with the stick disabled to restore functionality back to the hypervisor. We will continue to monitor and arrange for replacement parts..

Duration: 1 minute

Affected Components: AU Core Router

Nov 29, 21:17:48 GMT+0
Investigating - AS136582 Core Router cannot be accessed at the moment. This incident was created by an automated monitoring service..

Nov 29, 21:18:30 GMT+0
Resolved - AS136582 Core Router is now operational! This update was created by an automated monitoring service..

Affected Components: UK Core Router

Nov 28, 04:30:36 GMT+0
Investigating - AS136582 UK Core Router cannot be accessed at the moment. This incident was created by an automated monitoring service..

Nov 28, 04:30:41 GMT+0
Resolved - AS136582 UK Core Router is now operational! This update was created by an automated monitoring service..

Duration: 1 minute

Affected Components: UK 02

Nov 28, 04:20:41 GMT+0
Investigating - UK 02 cannot be accessed at the moment. This incident was created by an automated monitoring service..

Nov 28, 04:21:35 GMT+0
Resolved - UK 02 is now operational! This update was created by an automated monitoring service..

Duration: 1 minute

Affected Components: UK Core Router

Nov 28, 04:20:32 GMT+0
Investigating - AS136582 UK Core Router cannot be accessed at the moment. This incident was created by an automated monitoring service..

Nov 28, 04:21:39 GMT+0
Resolved - AS136582 UK Core Router is now operational! This update was created by an automated monitoring service..

Duration: 4 minutes

Affected Components: AU Core Router

Nov 24, 05:25:41 GMT+0
Investigating - AS136582 Core Router cannot be accessed at the moment. This incident was created by an automated monitoring service..

Nov 24, 05:29:45 GMT+0
Resolved - AS136582 Core Router is now operational! This update was created by an automated monitoring service..

Duration: 5 minutes

Affected Components: AU Core Router

Nov 10, 07:20:54 GMT+0
Investigating - AS136582 Core Router cannot be accessed at the moment. This incident was created by an automated monitoring service..

Nov 10, 07:25:36 GMT+0
Resolved - AS136582 Core Router is now operational! This update was created by an automated monitoring service..

Duration: 5 minutes

Nov 9, 05:44:38 GMT+0
Investigating - Our automated systems have detected our Sydney 01 server is currently offline. Our team has been notified and we are investigating the incident LiftUp Hosting services that may be impacted: - Web Hosting - Billing Portal.

Nov 9, 05:49:39 GMT+0
Resolved - Our automated monitoring has detected the server is back online. If you continue to have any issues, please contact us..

Duration: 20 minutes

Affected Components: Dedicated Control Panel

Nov 8, 22:01:35 GMT+0
Investigating - Dedicated Control Panel cannot be accessed at the moment. This incident was created by an automated monitoring service..

Nov 8, 22:21:33 GMT+0
Resolved - Dedicated Control Panel is now operational! This update was created by an automated monitoring service..

Duration: 1 minute

Affected Components: AU Core Router

Nov 8, 13:51:40 GMT+0
Investigating - AS136582 Core Router cannot be accessed at the moment. This incident was created by an automated monitoring service..

Nov 8, 13:52:36 GMT+0
Resolved - AS136582 Core Router is now operational! This update was created by an automated monitoring service..

Duration: 8 hours and 20 minutes

Affected Components: VPS Control Panel

Nov 8, 13:25:57 GMT+0
Investigating - VPS Control Panel cannot be accessed at the moment. This incident was created by an automated monitoring service..

Nov 8, 21:45:38 GMT+0
Resolved - VPS Control Panel is now operational! This update was created by an automated monitoring service..

Duration: 1 minute

Affected Components: VPS Control Panel

Sep 10, 06:02:57 GMT+0
Investigating - VPS Control Panel cannot be accessed at the moment. This incident was created by an automated monitoring service..

Sep 10, 06:03:35 GMT+0
Resolved - VPS Control Panel is now operational! This update was created by an automated monitoring service..

Duration: 1 minute

Affected Components: VPS Control Panel

Sep 10, 05:32:55 GMT+0
Investigating - VPS Control Panel cannot be accessed at the moment. This incident was created by an automated monitoring service..

Sep 10, 05:33:38 GMT+0
Resolved - VPS Control Panel is now operational! This update was created by an automated monitoring service..

Duration: 1 hour and 46 minutes

Affected Components: VPS Control Panel

Sep 10, 03:37:44 GMT+0
Investigating - VPS Control Panel cannot be accessed at the moment. This incident was created by an automated monitoring service..

Sep 10, 05:23:41 GMT+0
Resolved - VPS Control Panel is now operational! This update was created by an automated monitoring service..

Duration: 3 hours and 31 minutes

Affected Components: Dedicated Control Panel

Sep 10, 06:45:36 GMT+0
Resolved - Dedicated Control Panel is now operational! This update was created by an automated monitoring service..

Sep 10, 03:14:40 GMT+0
Investigating - Dedicated Control Panel cannot be accessed at the moment. This incident was created by an automated monitoring service..

Duration: 1 hour and 30 minutes

Affected Components: VPS Control Panel, Dedicated Control Panel, Sydney, Australia, Billing Portal

Sep 10, 00:30:01 GMT+0
Identified - Maintenance is now in progress.

Sep 10, 02:00:00 GMT+0
Completed - Maintenance has completed successfully.

Sep 10, 00:30:00 GMT+0
Identified - We are going to be completing updates on the hypervisor that hosts various panels and software we use, including both the hypervisor and VMs hosting them. We are expecting minimal customer impact other than being unable to access these services in short intervals as they are restarted. If any customers intend to complete work during this window, including an hour before and after the scheduled times, please reach out via our support channels so we can best minimise the impact..

Sep 10, 01:43:43 GMT+0
Identified - We have identified a software issue in our hypervisor requiring it to be reinstalled. We're moving some of our critical services to another hypervisor to keep online as best as possible, and other services will become or remain offline..

Duration: 3 hours

Affected Components: Billing Portal, Sydney 03, On-Site Backups, Sydney, Australia, AU Core Router, UK 02, VPS Control Panel, Dedicated Control Panel

May 18, 00:00:00 GMT+0
Identified - We are moving from a shared rack to our dedicated half rack within the same datacenter. We're expecting an estimated downtime of under 2 hours, but have allowed additional time to bring up the rest of our services. We will be prioritising bringing online Dedicated Servers & VPSs before any of the relevant control panels..

May 18, 02:45:15 GMT+0
Identified - Most of our services our beginning to restore now. There may be some instability in networking as we continue to reconfigure and move cables around. .

May 18, 03:00:00 GMT+0
Completed - Maintenance has completed successfully.

May 18, 00:00:01 GMT+0
Identified - Maintenance is now in progress.

Duration: 1 hour

Affected Components: UK 02, UK Core Router

Aug 30, 05:00:00 GMT+0
Completed - Maintenance has completed successfully.

Aug 30, 04:00:01 GMT+0
Identified - Maintenance is now in progress.

Aug 30, 04:00:00 GMT+0
Identified - Our UK Upstream is conducting essential maintenance on a core router in response to an outage around the time we began migrating customers to our new infrastructure. This will allow them to proactively prevent this same issue re-occurring in the future. This maintenance means that we will have a brief period of network outage (around 10 mins) whilst they re-configure that router. They expect the actual duration to be less though..

Affected Components: VPS Control Panel, Billing Portal, AU Core Router, Sydney 02, Sydney 03

May 17, 12:00:00 GMT+0
Identified - We’ll be upgrading our core network’s equipment alongside our secondary network partner who are also doing the same. We’ll attempt to minimise the amount of downtime caused, and make a best effort to do it as late as possible..

May 17, 13:14:31 GMT+0
Identified - We're beginning work on the swapover. At some point, we will have some downtime to start swapping links between the switches. We'll try to minimize how long the downtime is for and work on swapping over our secondary network, then our primary one.

May 17, 13:15:00 GMT+0
Completed - Long story short, we were unable to complete our configuration and establish a link on our new equipment, and as such will reschedule for another day when we've got it working :).

Duration: 6 hours

Affected Components: AU Core Router

Mar 8, 11:00:01 GMT+0
Identified - Maintenance is now in progress.

Mar 8, 11:00:00 GMT+0
Identified - Our secondary upstream is planning maintenance for the 8th overnight to do some network upgrades and configuration. We'll be on standby and at the data center during the maintenance and are ensuring our primary upstream will pick up the network..

Mar 8, 17:00:00 GMT+0
Completed - Maintenance has completed successfully.

Duration: 1 hour and 45 minutes

Feb 22, 14:10:36 GMT+0
Identified - Maintenance is now in progress. Apologies for the doubled-up emails.

Feb 22, 12:50:00 GMT+0
Identified - Maintenance is now in progress.

Feb 22, 15:55:38 GMT+0
Completed - Maintenance has been completed. Apologies for the late completion, we've been monitoring to ensure network stability.

Duration: 7 hours and 56 minutes

Affected Components: On-Site Backups, VPS Control Panel, Billing Portal, Sydney 02, AU Core Router

Feb 2, 13:16:21 GMT+0
Identified - Now in progress.

Feb 2, 10:30:00 GMT+0
Identified - Our co-location partner is upgrading the rack to a full rack from a half, and as such we will have to move our equipment. This is directly across and should be a relatively quick and straightforward process. We are allowing upto 4 hours of total downtime during the move in case we have unexpected issues or we start/finish later, however, expect to be done within an hour.

Feb 2, 16:08:59 GMT+0
Identified - We've got all of our hardware moved accross and have networking restored. We are in the process of turning all of our servers back on.

Feb 2, 21:12:33 GMT+0
Completed - We've completed our rack move. We do have some growing pains to work though, such as our limited network capacity due to some issues that occurred. We'll work through them proactively and without interruption to your service.

Duration: 5 hours and 47 minutes

Feb 2, 10:00:00 GMT+0
Identified - Our hardware-based raid card for SYD03 has arrived. We'll also be setting up a 10gig network card to ensure quicker on-site backups We'll be doing the following: - Before the maintenance, we'll manually initiate backups during the day as a failsafe - We'll fill capacity on our other servers, prioritizing Shark & Kangaroo and any remainder we don't have capacity for will be temporarily suspended with SLA Credit if requested - Hardware will be installed and a fresh OS will be installed with RAID10 - Clients will be migrated back onto the server, prioritizing anyone who is temporarily suspended There's a chance the overall process of moving people will run overtime but we will minimize any impact working during late night/early morning hours.

Feb 2, 10:21:00 GMT+0
Identified - Maintenance has begun on SYD03\. All clients were moved off during the week.

Feb 3, 10:00:00 GMT+0
Identified - Maintenance time and date have been updated and pushed back to be in line with our already upcoming maintenance.

Feb 2, 16:07:56 GMT+0
Completed - Hardware has been swapped.

Duration: 6 hours and 10 minutes

Jan 10, 09:00:01 GMT+0
Identified - Maintenance is now in progress.

Jan 10, 15:09:40 GMT+0
Completed - Hypervisor has been re-provisioned and servers are being moved onto this to balance the load.

Jan 10, 12:08:53 GMT+0
Identified - All VPS's have been moved to other hypervisors. We are now re-installing our OS with Software RAID10 as a temporary solution until our dedicated hardware for RAID arrives..

Jan 10, 10:44:24 GMT+0
Identified - Everyone has almost been moved off and we are preparing to reinstall the OS. We'll be installing without RAID but backing up nightly. We were planning on waiting for our raid card to arrive but are rushing this to fix present issues affecting everyone. Once it arrives, maintenance will be scheduled well in advance to fix it permantly. .

Jan 10, 09:00:00 GMT+0
Identified - Both our SYD02 and SYD03 node are having major performance issue with our disks. This seems to be due to the high amount of clients running Windows and high-operation setups (ie FiveM servers) which ultimately has the entire hypervisor in a limbo state during peak usage. As our SYD03 node has the least clients on it, we are going to be migrating everyone to other hypervisors temporarily and rebuilding the disk setup. Once this is done and we have stable disk performance, I'm going to balance out VPS's between the nodes and performance should then sort itself out This can take anywhere from 10 mins to a few hours, and i'll provide regular updates where possible.

Duration: 2 hours and 10 minutes

Affected Components: On-Site Backups, VPS Control Panel, Billing Portal, Sydney 02, AU Core Router

Dec 30, 11:00:01 GMT+0
Identified - Maintenance is now in progress.

Dec 30, 12:53:27 GMT+0
Identified - Unfortunately, our Upstream's maintenance is running severely over what we were informed us due to an unknown issue on their end. Like all of you, we are awaiting further updates from them..

Dec 30, 11:00:00 GMT+0
Identified - Our upstream provider has a planned network maintenence starting at 30/12/2023 10PM Sydney Time and concluding at 31/12/2023 2AM Sydney Time. Downtime should be less than 1 hour..

Dec 30, 13:10:02 GMT+0
Completed - The network has come back online. We were informed that the extended delay was due to route convergence..

Duration: 4 days, 21 hours and 54 minutes

Affected Components: On-Site Backups, VPS Control Panel, Billing Portal, Sydney 02, AU Core Router

Dec 19, 08:33:53 GMT+0
Completed - We’re confident that all of our networking is back online. Services have been brought back online fully. Web Hosting is expected to come back online around midnight. We will have a full post-mortem available tommorow morning for full transparency about the issues..

Dec 18, 07:00:00 GMT+0
Identified - We are moving all of our equipment from NextDC S1 to Equinix SY5. During this time, All VPS's will be shut down & Web Hosting will be taken offline during the move. .

Dec 18, 07:00:01 GMT+0
Identified - Maintenance is now in progress.

Dec 18, 11:09:26 GMT+0
Identified - Still in progress - Running a bit over. Currently troubleshooting network configuration. Will update ASAP.

Dec 18, 21:40:54 GMT+0
Identified - To say we are currently disappointed in our current network situation is an understatement. Everything is connected at our new data center, however, our IP range getting filtered via EdgeIX. We believe this is due to a typo from our upstream. We are awaiting IRR changes to be picked up globally, and hope this won't be much longer .

Duration: 1 day, 12 hours and 46 minutes

Affected Components: Sydney 02

Aug 28, 11:29:54 GMT+0
Identified - We are aware that most customers are receiving errors with their backups stating they have failed. This is caused by the massive amount being done at once, and are currently being staggered more to allow them to complete fully..

Aug 28, 20:28:39 GMT+0
Completed - Unfortunately, we were unable to complete the backup within a time frame that we were happy with and as such we have stopped our maintenance. We will revisit the issue at some point in the very near future and work on ways to minimize the potential downtime next time we attempt this..

Aug 28, 20:02:34 GMT+0
Identified - It seems that taking the backup of data is currently taking a lot more time than initially anticipated. We will update you as soon as we get any new information/when it has completed..

Aug 27, 07:43:00 GMT+0
Identified - In order to fix a partitioning mistake from when our cluster was first set up, we will perform maintenance to repair this. The process for our maintenance will be as follows: 1. Anytime between 7-11pm we will be taking a snapshot of your vps via the backup system as a redundancy 2. At 11pm, we will safely shut down all VPS's and begin copying the data onto our backup server 3. One data has been moved and integrity is verified, we will reset and recreate the partition with the correct settings 4. Data will then be moved back onto our hypervisor and VPS's will be booted back up. We estimate that this may take up to 6 hours to complete but will work to make it as quick as possible Any customers who are hosting critical systems can reach out to our support team and be moved to a temporary server. This request should be done as soon as possible. Other customers are eligible for SLA Credit..

Aug 28, 13:00:00 GMT+0
Identified - Maintenance is now in progress..

Duration: 3 hours and 35 minutes

Affected Components: Sydney 02

Jul 18, 06:38:08 GMT+0
Identified - Maintenance is now in progress..

Jul 18, 06:00:00 GMT+0
Identified - We are upgrading our core network's routing and as such some downtime will occur. We will ensure that we minimize this as much as possible, however, server's may lose connectivity for multiple brief periods.

Jul 18, 09:35:16 GMT+0
Completed - Maintenance has completed successfully. Gateway for our network has changed. For most customers, it has been automatically updated for you. Please reach out to us via our billing/support panel if you encounter any issues..

Jul 18, 07:17:18 GMT+0
Identified - We are currently experiencing some complications with the network configuration and are working through them currently. To allow us to do this easier, We are shutting down VPS's and out infrastructure to recable and re-rack some of our servers. .

Duration: 30 minutes

Affected Components: Sydney 02

Mar 21, 03:21:01 GMT+0
Completed - Maintenance has been completed successfully. All VPS's are booting back online..

Mar 21, 02:30:00 GMT+0
Identified - Maintenance is now in progress. During this time, VPS's will turn off and back on..

Mar 21, 02:30:00 GMT+0
Identified - We are upgrading our hardware to increase capacity over our VPS Node. This maintenance will be relatively quick and consist of shutting servers and services down, installing the new hardware, and booting everything back up. This should take no longer than 15 mins if there are no issues .

Duration: 50 minutes

Affected Components: Sydney 02

Jan 12, 02:53:39 GMT+0
Completed - The hardware swap and upgrade has been completed. We are monitoring and expect no further issues.

Jan 12, 02:04:07 GMT+0
Identified - Our team is at the datacenter and performing the hardware swap. This should take no longer than 10-15 mins..

Jan 10, 02:10:00 GMT+0
Identified - In relation to our previous issues around hardware failure, we expect the hardware to arrive on Monday and be ready to deploy on Tuesday. The exact time during the day is still TBD and affected clients will be contacted with the exact details of the maintenance. The expected time this should take is ~15 minutes however a full hour has been allocated in the severe case that issues arise during deployment.