Notice of Network Performance Issues Resolvido
Prioridade - Critica Afectando Outro - Routing Issues

Dear Valued Customers,

We want to inform you that we have identified intermittent network performance issues affecting our hosting facility in Manchester today. Our technical team, upon conducting detailed diagnostics and traceroutes, has traced the source of these disruptions to our DDoS protection service provider, Voxility.

Understanding the importance of reliability and uninterrupted service, we have promptly opened a case with our uplink provider to thoroughly investigate this issue. We are actively working with them to diagnose and resolve the underlying cause to prevent further impact on your services.

Please be assured that we are treating this matter with the utmost priority and are committed to restoring normal service levels as swiftly as possible. We are currently awaiting further feedback from our uplink provider and will provide updates as soon as more information becomes available.

We understand the critical nature of these services to your operations and apologize for any inconvenience this may have caused.

Thank you for your patience and understanding as we work to resolve this issue. Your trust and satisfaction are paramount to us, and we are dedicated to ensuring the reliability and performance of our services.

---------------------------------------------------

5:58pm

The network seems to have improved. We're still monitoring while the network team investigate.

cPanel Server Migration - CP-US-101 Resolvido
Prioridade - Média Afectando Servidor - UK cPanel Reseller 8 (uk-cp-rs-8)

Start: Sunday 18th Feb 2024, 6:00 PM
Finish: Monday 19th Feb 2024, 2:00 AM

We're excited to announce an upcoming enhancement to our hosting infrastructure. On the 19th Feb , we will be transitioning our Reseller services from the current server (CP-US-101) to our new, state-of-the-art server, designated as UK-RS-8.

Why Are We Migrating?

  1. Software Compatibility: The existing server CP-US-101 runs on CloudLinux version 7, which is no longer supported by cPanel. To ensure optimal performance and security, we're upgrading to CloudLinux 8.
  2. Up-to-Date Technology: CP-US-101 is lagging behind in several software versions compared to our other servers. The move to UK-RS-8 ensures you get the best and latest in web hosting technology.

What Changes to Expect:

  • IP Address Update: For those hosted on CP-US-101, your website IP will change from 162.252.83.203 to 91.232.125.3. If you use a third-party DNS provider like CloudFlare, please update your A records accordingly.
  • PHP and Database Enhancements: The default PHP version on UK-RS-8 will be 8.1. However, you have the flexibility to choose between PHP versions 7.2 to 8.3 via the cPanel PHP manager. Additionally, we're upgrading to MariaDB 10.6 from 10.3.
  • Consistent Features: Rest assured, all other services like Acronis Cyber Protect, Litespeed, MailChannels, etc., will continue as usual.

Migration Process:

  • Seamless Transition: We will utilize the cPanel migration tool for a smooth transfer. This process is largely automated and designed to prevent downtime, ensuring your sites and emails continue to operate normally.
  • User Experience: Most users won't notice any disruption, thanks to our 99% automated and highly reliable migration process.

Frequently Asked Questions (FAQs):

  1. Post-Migration Website Issues (PHP Errors, White Pages, etc.): This could be due to older PHP code incompatibility with PHP 8.1. You can revert to PHP 7.4 following this guide and subsequently update your site for higher PHP versions.

  2. Website Displaying "This Site is Moving": This indicates your DNS isn't hosted with us. Please update your DNS A records from IP 162.252.83.203 to 91.232.125.3 at your DNS provider's platform.

  3. Email Issues Post-Migration: Ensure both incoming and outgoing server settings in your email application are set to mail.your-domain-name. For those using external DNS services, update your mail DNS A record as mentioned above.

  4. Accessing WHM or cPanel Post-Migration: There's no change in accessing WHM or cPanel. Continue using your-domain-name/whm for WHM and your-domain-name/cpanel for cPanel.

We appreciate your cooperation during this transition and are committed to making this process as smooth as possible. Should you have any concerns or need assistance, our support team is ready to assist you.

Thank you for your continued trust in our services.

 

--------------------------------------------------------------------------------

18th Feb 2024 5:35pm

Our pre-migration checks completed early and we're starting the migration 25 minutes ahead of schedule.
we will update this thread again later this evening.

--------------------------------------------------------------------------------

18th Feb 2024 11:35pm

The migration is now approx 75% complete.

------------------------------------------------------------------------------

19th Feb 2024 02:40am

The migration is now finished.

 

Mail Delivery Delay & Roundcube PHP issue on DirectAdmin 3 [RESOLVED] Resolvido
Prioridade - Critica Afectando Servidor - DirectAdmin Reseller DA3

2:42pm

We're currently addressing a technical problem impacting DirectAdmin services, including Roundcube Webmail and PHPMyAdmin, stemming from an internal PHP issue within DirectAdmin. Updates will be provided in this space as new information becomes available.

-----------------------------------------------------
2:45pm

We've escalated the situation by submitting an urgent ticket to DirectAdmin's support team over three hours ago but have yet to receive a response. Our team is actively investigating alternative solutions in the meantime.

-----------------------------------------------------

As of 6:00 PM, it has been 2 hours since our initial report to DirectAdmin regarding this bug, and we have not yet received any feedback. Despite our best efforts and thorough investigation, we are unable to rectify the issue independently.

-----------------------------------------------------

DirectAdmin support responded to us at 8:32pm saying they are looking in to this issue and will come back to us soon.

-----------------------------------------------------

9:00pm The internal PHP issue is now resolved and roundcube is now working.

the update performed to Exim mail server has caused issues with the anti-spam not delivering emails to the inbox.

no email has been lost they're just queued on the server. We're running a reinstall of the mail components now which will take approx 1 hour to see if this fixes the issue.

-----------------------------------------------------

10:01pm we have disabled Mailscanner Anti-spam service. Any delayed emails from today will be delivered tomorrow once the MailScanner support department have provided us with a new version that works with the latest Exim.

We spoke to them just now and the update should be available in approx 11-12 hours and all queued mail will flow to the inbox.

As of right now all new email will arrive in your inbox and will NOT be spam checked, spam checking will return for new emails from tomorrow morning.

-----------------------------------------------------

11:25pm

The issue is now resolved and all queued mail has arrived in the inbox, the anti-spam queue is now zero.

 

cPanel Server Migration - CP2 Resolvido
Prioridade - Média

COMPLETED.

 

Start: Monday, 22nd January, 9:00 PM
Finish: Tuesday, 23rd January, 4:00 AM

We're excited to announce an upcoming enhancement to our hosting infrastructure. On the 21st of January, we will be transitioning our Reseller services from the current server (CP2) to our new, state-of-the-art server, designated as UK-RS-7.

Why Are We Migrating?

  1. Software Compatibility: The existing server CP2 runs on CloudLinux version 7, which is no longer supported by cPanel. To ensure optimal performance and security, we're upgrading to CloudLinux 8.
  2. Up-to-Date Technology: CP2 is lagging behind in several software versions compared to our other servers. The move to UK-RS-7 ensures you get the best and latest in web hosting technology.

What Changes to Expect:

  • IP Address Update: For those hosted on CP2, your website IP will change from 95.215.224.43 to 91.232.125.66. If you use a third-party DNS provider like CloudFlare, please update your A records accordingly.
  • PHP and Database Enhancements: The default PHP version on UK-RS-7 will be 8.1. However, you have the flexibility to choose between PHP versions 7.2 to 8.3 via the cPanel PHP manager. Additionally, we're upgrading to MariaDB 10.6 from 10.3.
  • Consistent Features: Rest assured, all other services like Acronis Cyber Protect, Litespeed, MailChannels, etc., will continue as usual.

Migration Process:

  • Seamless Transition: We will utilize the cPanel migration tool for a smooth transfer. This process is largely automated and designed to prevent downtime, ensuring your sites and emails continue to operate normally.
  • User Experience: Most users won't notice any disruption, thanks to our 99% automated and highly reliable migration process.

Frequently Asked Questions (FAQs):

  1. Post-Migration Website Issues (PHP Errors, White Pages, etc.): This could be due to older PHP code incompatibility with PHP 8.1. You can revert to PHP 7.4 following this guide and subsequently update your site for higher PHP versions.

  2. Website Displaying "This Site is Moving": This indicates your DNS isn't hosted with us. Please update your DNS A records from IP 95.215.224.43 to 91.232.125.66 at your DNS provider's platform.

  3. Email Issues Post-Migration: Ensure both incoming and outgoing server settings in your email application are set to mail.your-domain-name. For those using external DNS services, update your mail DNS A record as mentioned above.

  4. Accessing WHM or cPanel Post-Migration: There's no change in accessing WHM or cPanel. Continue using your-domain-name/whm for WHM and your-domain-name/cpanel for cPanel.

We appreciate your cooperation during this transition and are committed to making this process as smooth as possible. Should you have any concerns or need assistance, our support team is ready to assist you.

Thank you for your continued trust in our services.

 


22nd January 9:00pm

 

The migration started on time and is current running.


22nd January 11:08pm

This is now complete.

UK Data Centre Move Resolvido
Prioridade - Critica Afectando Sistema - ALL UK Hosting


After a long ongoing battle with the existing data centre about temperature issues inside our racks and regular network routing issues, we have made the difficult decision to move our servers to a new data centre.
We believe that this move is necessary to ensure the reliability and stability of our hosting services.


The transfer is scheduled to take place on Tuesday 16th May 2023, and we plan to shutdown the existing servers at 6pm. Once the transfer is completed which we expect to take up to 6 hours we will then boot up all servers automatically from our new data centre facility.

Our network team will be working diligently between the old & new network providers to ensure a smooth transition and your existing IP addresses will remain for all of our hosting services as we'll be moving our IP ranges to the new data centre.
We will be posting updates on our Twitter account @hosting_heroes before, during, and after the move so keep an eye on this is you want to monitor the progress of the transition.


We believe that this move will improve network connectivity and speed up routing from many ISPs to our servers.


If you have any questions or concerns, please do not hesitate to contact our support team. We appreciate your understanding and continued support and we look forward to providing you the best network performance yet.

Network Attack on cloud platform Resolvido
Prioridade - Critica

15th May  5:05pm

 

We are aware of a ongoing network attack to our Cloud Server Platform which has grown so large the network in this rack has gone down.

 

We're working on this issue and will update this thread once we have more information.

 


 

5:40pm

We have been unable to fix this remotely and an engineer has been dispatched to the data centre and should be there in 1 hours time.

 


 

7:35pm

 

This issue is now resolved.

 


17th May 00:30

This issue has re-occurred  and we are looking in to it.

 


17th May 03:19am

We are still working on this issue.


17th May 04:00am

We believe this could be an issue with the switch looping traffic which is saturating the network.  Our team are still working on this.


17th May 04:10am

one of our engineers are heading on site


17th May 05:00am

our engineer has factory reset the switch to get traffic moving again and everything is back online.

we will replace the switch and redesign the network over the upcoming weeks so this issue never returns.


21st may

00:01

we are aware of some more network issues causing multiple short periods of downtime, we're working on this and believe its related to the issue we had last weekend.


21st may 09:01

this started happening again and we're working on it.

Issue with Rack D3 Switch Resolvido
Prioridade - Critica Afectando Sistema - Rack D3 Switch

Last Updated:

21st December 2020 1:55pm

 

In one of our shared hosting racks (known as D3) has a new 2020 Cisco Switch that has started rebooting/crashing this happened:

 

Friday 18th December 9:01pm

Saturday 19th December 01:01am

Sunday 20th December 6:48pm

Monday 21st December : 05:28am

Monday 21st December : 09:24am

 

Friday night we contacted our cisco support provider who are investigating the cause and have not yet found the route issue of the problem.

Each time this switch crashes we will update this thread as it causes a 8- 9 minute outage and effects servers:

 

CloudLinux5

Windows Plesk -1 (excluding Mail)

Windows Plesk -2 (excluding Mail)

Windows Plesk -3 (excluding Mail)

 


 

1:55pm

We're replacing the switch with another one as Cisco have requested we send the switch back to them to replace the onboard components. 

We will do this early evening around 5pm today and should cause no outages lasting more than 30 seconds.

[RESOLVED] Windows Mail Server Issues Resolvido
Prioridade - Critica Afectando Sistema - Smartermail

Start time: 8th December 2020 10:28am

Issue Resolved: 9th December 2020 00:20

 

Today we've experienced numerous attacks on our Windows Smartermail service causing the server to refuse new connections due to the network flood of traffic.

 

The attach started at 10:28am UK time on 8th December and has caused multiple outages every hour.

 

We have made strict rules to reduce the number of connections coming in to our server which has helped but its not fixed it.

We are working closely with Smartertools who develop SmarterMail and hoping we can fix the issue today.

we will update this post later today.


10:45pm

We have made multiple changes which seem to of helped and right now all services have been functioning for 45 minutes without issues.

the attack on email is still happening and we are still monitoring the mail service. 


11:25pm

The issue has returned, if you are unable to access your email over IMAP/POP3 try using webmail at https://windows-mail1.ukdns.biz while the investigation continues. 


9th December 00:45

Smartertools the developers of Smartermail believe they have fixed this issue around 00:15, so far everything looks good and we'll continue to monitor and so will they.

We will updating this thread again after 8am in the morning.

Plesk -6 Issue Resolvido
Prioridade - Critica

Last Updated: 245h September 10:25am

 If your website is not working and giving 500 error this will fix itself within a few hours when the plesk repair tool has started repair on your domain.

We will continue to update this post throughout today, the repair tool usually takes <4 hours however this time around its taken over 24 hours and still running.

 


Post from 23rd September:

We have identified a hacking on the Plesk-6 Server (ex ASPNetHosting) which has allowed hackers to create files in multiple website accounts on 21st September.

Our investigation shows the hackers started on 17th September 2020 around midday and have gained system access.

The hackers did similar to what happened in the past when running SolidCP and:

  • Added everyone group to wwwroot folders
  • created files and folders
  • edited index files to inject content

After searching the server over hours we have found lots of old hacked files dating back to 2014 and we believe some of these may of been found by hackers who abused them to gain access to the server.

We cleared up lots of the hacked files on 21st September and did a full system permissions reset on all domains, sadly this didn't fix the issue as we found more hacks today.

So Whats next?

Step 1)   Status: Running as of 9:45pm 23rd September.  This will take some hours due to several TB of data restoring. COMPLETED 5:54am 24th September

We are planning to recover the entire web server back to the evening of 16th September backup which will revert all website files back to 16th September.
this won't effect DNS records, MySQL databases or MS SQL Databases.

Step 2) StatusIn Progress  (may take up to 12 hours)

Once the restore is complete we will keep websites shut down while we do a full file investigation to try to identify hacked files or users who are causing the hack

Step 3) StatusNot Started

Start Websites on server.

 

FAQs:

Q.  What security is on each server?
A. The server runs both AVG Business Anti-Virus,  Malwarebytes Business and Mod_Security runs on every single domain name which is suppose to keep websites safe from hacks.

Q. Hacking issues happened with Windows 2008/2012 ASPNetHosting, then when we moved to MSPControl Windows Server 2016 Hosting when cyberhostpro took over and now again with Plesk/Windows Server 2019 hosting, is their a hacking hosting on the server?
A. We don't believe anyone hosting with us is causing the hack, the cause of the hack is likely a older website thats been hacked and trying to find which website out of almost 1000 domains is very difficult but we are working our hardest to find it.

Q. Can I move my Reseller Account or Hosting Account to my own server so I am not effected by other websites.
A. We have a few options available to you.  If you use wordpress we recommend moving away from Windows to Linux, as linux has the best security. See http://www.cyberhostpro.com/website-hosting (or reseller hosting).  
if you run ASP or ASP.net or .net core then you'll need windows, your best option is your own windows server see https://www.cyberhostpro.com/vps/ if you have a reseller account you can add Plesk Web Host Edition and we can migrate your data from our plesk to your own dedicated plesk server.

Q. What can be done to stop this happening again?
A. Sadly its impossible to stop hackers, however if your website is not running ASP, ASP.net or .Net Core (ie you use html or php or wordpress) then we highly recommend you move away from Windows Hosting to Linux hosting, Linux is much more secure than Windows and we've never ever had issues like this happen on a Linux hosting server.  See https://www.cyberhostpro.com/website-hosting/ for our Linux Plan or if you're a reseller see https://www.cyberhostpro.com/reseller-hosting/ 
pro-rata credit refunds for cancelling windows will be provided too.

 

 

 

Plesk 6 - Websites Not loading Resolvido
Prioridade - Alta

21st September 10:00pm

Earlier today we identified a issue where windows "everyone" user existed on around 20% of websites which we consider a security threat.

We wrote a script to find and remove those permissions however windows timed out doing so.

Tonight we've taken the decision to do a proactive fix to avoid a future potential security risk and removed all permissions from all websites meaning your website will have no read/write permissions causing it to go down.

The script to remove permissions started at 10pm and will take some hours to remove all permissions, once this has finished we will then start another script to recreate the permissions set from inside of plesk. 

We will update this post tomorrow morning with an update on what time the script finished.


22nd September 1:15am

This issue is now resolved.

SolidCP to Plesk Transfer Resolvido
Prioridade - Alta

17th May 07:45am

The upgrade to Plesk is now complete.  Our DNS has been moved to Plesk and all websites should now be resolving to the new server.
If you do not host DNS with us (ie cloudflare or other) then please immediately update your IP for FTP/Website to 91.232.125.207 

New Plesk Control Panel URL is https://plesk-6.ukdns.biz:8443 you can access access http://yourdomain-name:8880
we are also forwarding solidcp.ukdns.biz to the new CP. 

SSL:

SSL Certificates are not automatically migrated.  We have wrote some guides to help you get an SSL Certificate setup on your domain name if you had one previously.

Premium Paid SSL (Support provided if needed)

If you have a premium (paid) SSL certificate then you will need to reinstall it.

If you purchased it from us:

  1. Login to the client area and find your SSL certificate and make a note of the "token id"
  2. Login to Plesk and on the right hand side menu next to your domain name click "auto install SSL" Icon
  3. Re-generate the SSL which will automatically the SSL Certificate for you.

    More information at https://portal.cyberhostpro.com/knowledgebase?id=1630-how-to-installrenew-a-premium-ssl-certificate-in-plesk 

If you purchased your SSL  from from another provider then see this guide to export it from SolidCP and Import it to Plesk.

FREE LetsEncrypt SSL 
If you do not run a e-commerce/business website and prefer to use a free SSL certificate then do the following

  1. login to Plesk Control Panel
  2. Click SSL/TLS Certificate (or maybe shown as SSL IT)
  3. Click GET IT FREE under letsencrypt
  4. Click Include a "www" subdomain for the domain and each selected alias
  5. Press the blue button to start

NOTE: LetsEncrypt only allow 10 requests per hour from our server so you may have to retry if you get an error like this:

One of the Let's Encrypt rate limits has been exceeded for DOMAIN

Sadly this error is coming from LetsEncrypt as they restrict each server to only be able to generate a few SSL Certificates per hour and is not something we can control.

We have wrote this guide which is a workaround to generating a FREE SSL https://portal.cyberhostpro.com/knowledgebase.php?id=1749-how-to-install-a-free-ssl-manually 

If your website is a business website then we recommend considering a premium SSL Certificate from https://www.cyberhostpro.com/ssl-certificates/  

Paid SSL vs FREE SSL comparison Article: https://www.cyberhostpro.com/articles/paid-ssl-vs-free/ 

DATABASES

MS SQL will continue to listen on db1.ukdns.biz and MySQL now uses localhost.  We have attempted to update all scripts to use the correct hostnames for MySQL.

If you need to resync/Re-Migrate your database then please see this guide https://portal.cyberhostpro.com/knowledgebase.php?id=1747-how-to-manually-re-migrate-a-database-from-solidcp-to-plesk

DNS

As mentioned on our email DNS records are not migrated.  See this guide for copying DNS Records https://portal.cyberhostpro.com/knowledgebase?id=1750-how-to-recreate-custom-dns-records-missing-since-moving-to-plesk 

 

 

=============

Previous Log

 

15th May 2020

The Move to Plesk with SQL 2019 will run throughout this weekend starting Friday 15th May.

This Article will be updated several times a day between 15th May until completion (Saturday/Sunday)

The Steps we are taking

SolidCP Control Panel & FTP will go offline at 2pm today in preparation for migration to export the database of SolidCP and convert it to a Recipe we can then feed in to Plesk, this process takes around 9 hours.

During the night we will begin to migrate websites, we have thousands to move and expect this to run through to Saturday.

Once all website files have migrated we will then begin to migrate MariaDB/MySQL & MS SQL Databases + Sync email data across.

Once these final steps have been done we will then switch the DNS to point to the new server.

If you do not host your DNS with us (ie you use cloudflare or another provider) then please update your DNS Records so your website points to new IP 91.232.125.207 and mail IP is 95.215.226.71

This article will be updated around 3pm today.


15th May 2020
3:50pm

SolidCP and FTP are now down and will remain down.

Next update to this post due tomorrow before 12:00pm.


16th May 2020
3:00pm

Website Files have now been copied, next we are starting on databases and mail. 

Updates to follow later today.


16th May

4:30pm

Mail has been switched to the new Smartemail server.  The old Mail IP has been copied over too so mail will continue to resolve with no mail outage.


16th May
11:40pm

Databases are still slowely migrating.  Next update will be around 10am sunday.


17th May
07:25

we have resynced databases and shortly going live.  We will update this post within 30 minutes once completed.

ASPNet Hosting - Disk performance Resolvido
Prioridade - Critica Afectando Sistema - AspNetHosting Customers

UPDATE 6:30pm 15th May:

As of right now Smartermail is now functioning, We are monitoring the situation closely.  The main cause was due to overloaded hardware at ASPNetHosting and during Tuesday Night / Wednesday morning without our consent the server Admins over at ASPNetHosting had consilidated many virtual machines to one hypervisor which could not handle the load which resulted in multiple outages due to Disk write issues.

We planned to migrate you to Cyber Host Pro's business cloud platform within 60 days however due to this issue we are looking to fast forward a mail migration within 7 days.

Once e-mail has been functioning for 12-24 hours we will send out a mass email to all customers about the outage, we will first Get ASP Net Hosting Ltd to write something on their status page accepting the responsability for this as moving the virtual machines last night was not something we knew was happening until after it was done.


 

15th May 2019
09:00am

Today we have been made aware from multiple clients that Smartermail is not functioning as normal, we are trying to work on this issue as quickly as possible, the issue appears to be related to the Smartermail Server being moved in the night (something we were not aware of) and the new server is much slower. 

We have been trying to contact staff over at ASPNetHosting Ltd for several hours to ask why this has been moved without our consent.


Update 10:50am

Sadly we have still had no response from ASPNet Hosting, we can see some disk changes (snapshots) were changed around 5am today.

We are working to try to revert any changes made during the night and once smartermail is functioning we will then plan to move this server to our own platform asap so it performs much better.


Update 11:40am

We still have not heard back from ASPNet Hosting however we have gained access to the hypervisor where this is hosted and doubled the CPU & RAM.  This hasn't fixed the issue yet. 


Update 11:50am

We have now had a response to one of our emails to ASP Net Hosting Ltd, the issue was caused by their backup software Veem that is creating snapshots of the data causing the performance to drastically decrease since 5:25am today.
They are cancelling this now and we will update you again when we have more information.


Update 1:10pm

We now have gained access to the server, smartermail is not functional and using 100% CPU.  We are experienced in smartermail and now diagnosing the issue.


Update: 2:05pm

The cause of todays issues has also effects some web servers and SQL Servers, this was because multiple SolidCP Hosting servers had all been moved to a single physical server that runs SATA disks (slow) which has caused a big bottleneck on disk performance.  This was not something we were aware was happening and only found out this had been done today.

We can see the previous server admins are not moving servers away from this overloaded hypervisor which will fix the Smartermail & SQL issues. 

We will update when we have more information.


update 2:55pm

The Disk IO is still very poor on the server however it is improving as ASPNetHosting Admins undo some of the changes they made in the night.
Mail should be working through email apps such as outlook, macmail etc after we upgraded smartermail as the version on the server was around 9 months old.  
Webmail isn't yet functioning due to the server being stuck at 100% CPU.  We will continue to monitor this and update this thread.

 


update: 3:10pm

we can see ASPNetHosting Admins are moving one of the web servers with IP 109.169.24.85 we are monitoring the situation and we are guestimating based on the status that this should be back online by 7pm.
update: Only 4:30pm


Update: 4:20pm

We have been unable to get smartermail back functional, We have instructed ASPNetHosting to move this Virtual Mail Server to another location where it has access to CPU/RAM and better Disk IO.  This could take them several hours.

Cyber Host Pro will be planning a mail migration for this week/weekend so we can move mail away from slower server as soon as possible.


Update: 5:55pm

ASPNetHosting are still moving other virtual machines away from this hypervisor that is suffering from slow disk performance, once these virtual machines have moved if the disk performance has not improved them smartermail server will only then be moved.

We will be monitoring this throughout the evening and the night to try and have this fully functional again by start of business for all our new customers as soon as possible.


update 6:30pm

We have introduced DOS protection in to Smartermail to match the configuration of Cyber Host Pro which has helped reduce CPU traffic to the server which has brought smartermail back online.  The spool has thousands of queued mails that will filter in to your inbox shortly.

Please monitor this thread... this issue could continue and we will update this thread several times within the next 24 hours,

cPanel Shared Hosting Migration [Complete] Resolvido
Prioridade - Alta

cPanel Shared Hosting Upgrades
Server Name: CloudLinux 4

Cyber Host Pro will be migrating you to a new server as apart of our efforts to always provide the fastest website hosting possible to our customers.

The new server will use the latest CloudLinux-7 Operating system and use 12GBps SSD disks providing the fastest Disk performance.

Website Migrations will begin at 6pm on 19th April 2019 and will take approx 24-36 hours for all accounts to migrate. 

Cyber Host Pro have managed many migrations in the past 20 years and this process is 99% automated thanks to cPanel's advanced migration tools which will make a full backup of your account including email, databases, passwords and then copies this backup to the new server and restores that data.  Once the restore is complete it then sends a message back to the old server's DNS to tell it to forward all new traffic to the new server so you do not loose any emails/website visitors during the server move.

For most users the migration will be simple and no downtime will occur if your domain name DNS/Nameservers are also hosted with us.  If you host your DNS with a 3rd party provider (ie cloudflare) then you may experience some downtime during the migration as we will be migrating to a new server IP address, once the migration is completed the existing shared hosting IP will then be migrated to the new server named CP2.

Technical Information for resellers:

During migration websites will change from IP 95.215.224.43 to 91.232.125.163  this will change back once the migration is completed.
If you host your own name servers (ie ns1.yourdomainname.com) then the private NS IPs will remain 95.215.225.21 & 95.215.225.22  if you use any other IPs then please contact support ASAP to discuss.

SSL hostname cloudlinux4.ukdns.biz will forward to new hostname cp2.ukdns.biz  so email clients using SSL connections will continue to work.

 


19th April 6:05pm

Migration started.  Over 1TB of data to move.
Next update will be tomorrow afternoon/evening (saturday)


20th April 9:10am

The migration is almost finished. All data was transferred and took much less time than we expected.  The shared IP is back 95.215.224.43

we will update this thread again later this morning when everything is confirmed functional.


20th April 10:35am

Migration is complete and everything should be functioning as normal.

MySQL issue on CloudLinux-5 cPanel hosting Resolvido
Prioridade - Critica Afectando Servidor - UK cPanel Reseller 6 (uk-cp-rs-6)

Tuesday 8th January 2019

11:35pm

This evening our MySQL Database server crashed on Cloudlinux-5.

After a long investigations by our Level 3 server administration team,  many errors have been writted to the databases since 5th January approx  8am UK time and since then Databases have been breaking / corrupting.

Because the errors have started on 5th of January, restoring todays backup of the entire MySQL Server wouldn't fix it, it would just start the issue again so we have taken the decision to restore all databases back to 5th January  1am backup.

This restore is running now and will take some hours. 

During the outage tonight all websites will give MySQL Database error during the restore, we expect MySQL to be back online by 8am UK Time tomorrow.

When databases are back online and your website is again running, all of the MySQL Data would of restored data back to 5th January 1am, most databases are not wrote to daily, however  if you have since modified your CMS or its a e-commerce store and have lost information since 5th and you need to recover this data then please do the following:

1) Login to cPanel
2) Go to MySQL Backups (under jetbackup menu)
3) Go to 8th January Backup (taken around 1am) and click restore

Do not attempt the 3 steps above until after 4am on 9th Jan.

cPanel - CloudLinux4 - network card issue Resolvido
Prioridade - Critica

CloudLinux4 - Hardware issue
Friday 26th October 7:00pm

we have rebooted this server to apply firmware updates, software updates and kernel updates.

This has caused a issue with the network card on the server and the operating system is not detecting it.

We are working on this issue and will update this thread before 8pm with the next steps if this issue is not resolved by then.


8pm

We are still working on this issue and have no further updates to provide at this time.

We are working on this issue and will update this thread before 9pm with the next steps if this issue is not resolved by then.


 

8:50pm

We have exorsted all options for fixing this remotely.  We are now dispatching an engineer to the data centre and a replacement part from our liverpool office.

ETA for part delivery is 10pm.

Next update later this evening.


11pm

the issue is now fixed.  We are just performing one final reboot to make sure everything starts up without errors.

All websites & mail will be functioning again at 11:15pm and maybe slow for the first 15 minutes while all background processes complete.

 

Cloud Server & VPS Security Foreshadow At Resolvido
Prioridade - Critica Afectando Sistema - All VPSs/Cloud Servers

We have been notified that our new cloud platform is vrunrable to the new Forshawdow attack effecting KVM Hypervisors.

We have permitted our developers to upgrade all of our HVs, 50% have been done and remaining 50% will be done early hours Thursday Morning and Friday Morning.

As each hypervisor is rebooted some VMs will be shut down as we can not hot-migrate from different hypervisor software versions due to this security issue, the VMs shut down will be booted back up the moment the HV is back online.

More information about the patch can be found on https://docs.onapp.com/rn/foreshadow-attack-issues

Cloud Server & VPS Issues [SUNDAY] Resolvido
Prioridade - Critica

5pm Sunday 5th August

A full RFO will be provided once the issue is fixed, the cause has now been found.

Our cloud platform is built on OnAPP which is one of the best cloud software applications available in the world, we upgrade it usually twice a year (june/december).  The last updates we did was November 2017 and its been running perfect so we've not wanted to upgrade.  The version we had had an explot in it so we needed to upgrade from version 5.5.1 to 5.5.8.  We hired onapp's expert team like we usually do to handle the upgrade process so if anything goes wrong we have the right people at our disposal. 

Only in the last hour they found that version 5.5.8 has a bug in it which has caused all of our issues,
the bug is

  • XFS file-system driver based on the kernel 4.9.86-30.el6.x86_64

We are now being downgraded to 5.5.7 which is still much newer than the version we had previously and has a updated version of XEN.

This is being applied right now and once done all hypervisors will be rebooted in to the 5.5.7 version which should then resolve ALL of the issues.

NOTE:  We have had a unusual high amount of customers asking about dedicated hardware so your not having to ever experience this again.  Although this is shared hardware with other VPS customers the likely chance of this happening again is very small, with the investment we announced to you a few weeks ago this platform is going to only get better, the only time we would recommend dedicated hardware would be if your website costs you money if/when down (ie a large e-commerce site making hundreds/thousands a day).

This has been a very troubling weekend for both you and us, the stress this has put on our engineers and onapp's engineers has been anormous but I can tell you we've had the best engineers working with us who have been working 24x7x365 on shifts and you will see a big difference in your server performance within 48 hours of this issue being resolved which in return will likely give you a increase in search engine rankings as the faster your site is the happier google page speed insights tool will be with your response time!



7:10pm

The downgrade mentioned above is now complete however the issues its caused didn't recover with the downgrade. 
OnAPP Team have now started trying something else and we are awaiting further information from them.

This post will be updated as soon as we have the information provided to us on the current progress of fixing our cloud.



10:30pm

So far we have no further news to share with you, the developers have made lots of fixes to issues caused by the upgrade and continuing to work on the issue. 
This post will be updated as soon as we have the information provided to us on the current progress of fixing our cloud.



11:40pm

We are still working on the issue, 10% of virtual servers are now back online.



12:30am Monday 6th

More than half the servers are online, all servers should be up by 2am.

further information will be posted here in the morning and later this week a RFO (Reason for outage).




Monday 10:20am

A RFO will be available within 7 days once we have a report from the developers of our cloud platform.

Cloud Server Upgrades Resolvido
Prioridade - Alta Afectando Sistema - All VPSs/Cloud Servers

Date: 3rd August 2018
Time: 9:30pm UK Time

At 9:30pm on Friday 3rd August Cyber Host Pro will need to shut down all VMs in order to upgrade our SAN Storage network & All Hypervisors to the latest version on OnAPP Cloudboot with upgraded version of XEN,.

Due to the high number of Virtual machines we've opened a maintenance window of 2 hours 30 to be on the safe side.

Once all VMs are shut down all of the hypervisors and SANs will be rebooted so they boot the new kernels and Storage versions.

All VMs will be booted up immediately after maintenance is complete.

We recommend this week that you SSH to your linux VM and update the OS (ie on centos/cloudlinux run yum update -y) or windows run windows update.  When we reboot your VM it'll apply all of those updates and new kernels upon reboot.

Once all of the upgrades are done we can then introduce some brand new hardware in to the cloud which is apart of our £100,000 investment in to our cloud server platform.



3rd August 9:50pm

Cyber Host Pro had hired our cloud software developers to work with us on tonights software upgrade.  They are currently running late which has delayed us from starting this maintenance by 1 hour.

If we have not heard from the senior engineer by 10:15pm we may cancel tonights maintenance.



3rd August 10:02pm

Engineer has arrived and we will be starting shortly. we are approx 45 minutes behind on schedule.

3rd August 10:20pm

Maintenance is starting however servers wont start shutting down until just after 10:45pm and not 9:30pm like previously advised.


4th August 01:28am

Some VMs are still not online but queued to boot. we will update this post once all Vms are back online.

Network issue causing slow speeds Resolvido
Prioridade - Critica Afectando Outro - Network

Monday 4th December 2017
9:30am

We have identified a network issue causing slow speeds in to the data centre.  We have reported this to the network team at the data centre and provided logs from our global monitoring servers.  The network team believe they have identified the issue on their network and working to resolve it.

We hope this is resolved later this morning.



Issue was resolved 9:52am

Cloud Platform - Outage Resolvido
Prioridade - Critica

1st November 2017
22:30/10:30pm

Due to a serious bug related to our storage devices our system admin's have no choice but to perform some emergency maintenance on our cloud platform which requires all VMs to be shut down and started back up after rebooting each Hypervisor.

This is being done now and we will update this thread once complete.



23:00

the issue is now resolved and VMs are booting back up now and should also be much faster performing too.

Cloud Server Upgrade [1] - October 21st Resolvido
Prioridade - Alta Afectando Sistema - Cloud VPS Servers

Date: 21st October 2017
Start time: 4am (due to delay actual start time 5:15am)
End time: 8am (due to delay actual end time maybe up to  9:15am)

On October 21st 2017 we will be upgrading our cloud platform. During this time we will:

Upgrade the backend software
Shut down all Hypervisors and virtual machines
Boot the servers in to Dell firmware upgrade tool and upgrade the firmware on Raid Card, Network Cards etc + upgrade the bios
Boot them servers back up and boot up all the virtual machines.

We have set an end time of 8am however we expect this to be much sooner, during this time your VM will be down and we recommend you do not attempt to start/reboot your server.

We will update this thread when we start and complete the migration.



05:00

migration has started, we started later than anticpated due to some bugs in our mass VPS server shutdown script.

We'll update this thread later once all physical servers have had firmware/bios upgrades and coming online.



08:30

We are having difficulties with 2 of our storage servers that have developed issues since installing the latest dell updates, this is stopping us from being able to boot any VPSs.  We are working as hard as we can to fix this and will update this post with any further information once available.



09:25

We have 5 out of 6 servers now ready, one server we re reseating all of the components such as RAM, CPU and PCI Cards.  Once done we'll boot the machine which should hopefully allow us to then boot up all VMs.
Next update should be around 10am.


10:03

all hypervisors are online, we are going to start booting all VMs shortly, we've just got to fix a disk issue first on one of the hypervisors, we've booted some random VPSs up and most seem to start sucessfully where a few don't due to a disk issue..


10:30

Most VMs are up and running, we expect all of them to be online before 11am.



10:45
All VPS/VM's are now online.

Plesk - Windows Server 2016 Upgrades Resolvido
Prioridade - Alta

Windows 2012 R2 > 2016 Upgrade
When: Friday 23rd June 2017

Live information will be provided here.

DNS record changes for those hosting DNS elsewhere:

WWW. A RECORD IP: 95.215.224.83
MAIL. CNAME: webmail.bhdns1.com.
WEBMAIL. CNAME: webmail.bhdns1.com.



23rd June 2017
11:20pm

DB migrations have started earlier this evening but the tool is taking simetime to migrate the DBs, It may take days at the current transfer rate.  We'll continue to work as fast as possible to get this migration completed by the end of the weekend.



25th June 2017
08:55am

DB migration is around 80% complete, once all DBs have been recreated we'll resync all changes as this tool has been running since Friday so DBs will be out of sync.  ETA should be around 8pm tonight until migration is completed.


25th June 19:45/7:30pm


We are facing a few strange errors in the migration tool and we can see a conflict of data showing around 100 less accounts migrated.  Due to this issue we will not be switching the DNS to the new server.  We will continue to run the current hosting and switch you over to the new server next week.  We'll update this post within 24 hours with further information.


29th June 9:20pm


Plesk team have fixed numerous bugs in the migration tool, we now have migrated logins but still everything is live on the old Plesk server.  We will be making a Sync of changes tomorrow and should be live tomorrow.



30th June 7pm

Migration has now complete.  Please log any issues to the helpdesk with suject Plesk Migration: YOUR SUBJECT HERE

Cloud Server Upgrade [2] - May 26th Resolvido
Prioridade - Alta Afectando Sistema - Cloud VPS Servers

Date: 26th May 2017
Start Time: 22:00/10pm
End Time:  27th May 01:55/01:55am

We will be replacing our CloudCP management control panel with a new server built on Centos 7, the current server runs centos5 and due to OS no longer being supported this needs replacing, it'll not only improve the performance of the control panel but also introduce some new features like HTML5 console which will replace the Java console which no longer works in Firefox/Chrome.

Update: We'll also be upgrading the network card firmware on all servers to make virtual disks read/write to the storage controllers much faster. Hopefully, this doesn't take up too much additional time.



26th May 22:30/10:30pm

We have started this around 10pm.  We are doing as much of the work before shutting down the VMs.  We'll shut the VMs down later on in the maintenance to upgrade the firmware on the network cards then reboot on to the new PXE boot Control Panel.

We'll add further updates later on.



27th May 00:20

VMs are now going down and then we'll boot them all back up on the new Cloudboot image once all are shut down and firmware upgraded.

Next update around 1:00am



27th May 01:10

VMs will shortly start coming online.  As we have several hundred to boot it could take sometime.  Everyone should be up by 1:30am - 2am.  We'll update this thread once complete.



27th May 01:30

Most VMs are back online. Around 30 more booting up so all VMs should be online by 1:40



27th 02:00

upgrade was smooth and now all complete.  Hopefully no more this year.

Cloud Server Upgrade [1] - May 19th Resolvido
Prioridade - Alta Afectando Sistema - Cloud VPS Servers

Date: 19th May 2017
Start Time: 20:00/8pm
End Time: 23:00/11pm


We will be performing our semi-annual cloud server platform on the 19th of May to perform software upgrades to all of our HyperVisors including performance improvements and some updates to our back end control Panel.

During this time we will shut down and boot back up your virtual machine. 

We expect the maintenance to be completed within 90 minutes however we've opened a 3 hour window just incase something was to go wrong!


8:30pm 19th May 2017

this maintenance has started.  We'll shut down all VMs when required and boot them back up once finished.  During this time do not attempt to start, shutdown or reboot your VPS.



23:00/11:00pm

we had some issues with some OS components that have slowed us down.  It should be complete in 1 hour



11:58pm
software on hypervisors are now up to date and will be rebooted to apply updates. Once all are back online we'll begin booting VMs up. We'll update this thread when that starts which should be in the next 15 - 30 minutes


00:35
VMs will begin booting up shortly. we have almost 300 to boot up we'll update this thread when all are online.



01:15

Most VMs are now back online, It took some time with us having several hundred VMs hosted on the cloud.  If your VM is still not responding by 1:45am please contact support or check your VM power status in your VM control panel.

Plesk Windows Hosting Migrations Resolvido
Prioridade - Média

Scheduled Migration for Plesk Windows Hosting.
Date & Time Start: 05/05/2017 8pm

We will be migrating all Plesk users to even better hardware later this month to take advantage of some new technologies including:

Microsoft Windows Server 2016
IIS 10 with http/2 support
MS SQL 2016 Web Edition

Although the current server is still fairy modern we've had some server management challenges with the OS so we've decided the best option for everyone would be to migrate to the latest operating system for servers which was released a few months ago "Microsoft Windows Server 2016"


All databases will also be upgraded from MS SQL 2014 to MS SQL 2016 and MySQL will go to the latest version of 5.6

We'll also host Smartermail & MS SQL on their own dedicated servers. Currently Web/Mail/Databases services are all on the same server as per Plesk control panel requirements till now. However this has now changed so we will be moving MS SQL & Smartermail to their own servers which will increase performance of web hosting.  Don't worry about having to change your connection strings as we'll setup internal port forwarding so localhost/127.0.0.1  forwards to the internal IP for the ports such as 1433 (MS SQL) or 25 for SMTP etc.

All IPs will change, almost all of our customers currently use our name servers meaning we handle all your DNS and won't require to make any changes as we'll do this for you.

  For the small number of customers who host DNS elsewhere here are the new details:

Old Website Shared IP: 95.215.225.162
new Website Shared IP: 95.215.224.83

Old Mail IP: 95.215.225.162
new Mail IP: 95.215.224.84




Update Sat 10:35am

The migration tool did not start until 1:00am on Saturday.
the tool is running rather slow and has only migrated 70 accounts in 9 hours and there are 960 accounts queued for migration.



Update Saturday 7pm

Migration is currently at 135 of 975 accounts, its clear that this is going to go in to next week until this is complete.
Once all accounts are migrated we will re-migrate all MySQL & MS SQL Databases and Email data then switch over the DNS to the new servers which should make things migrate much more smoothly.



Monday 8th May 11:15

The migration was too slow using the plesk migration tool, even accounts that are 1-2mb in size are taking 30-45 minutes to migrate.
We've now decide we will use another method to migrate accounts which we'll do throughout this week which will involve

1) Run Plesk migration tool and skip copying Mail & Website Data which will then just do Plesk Objects, MySQL & MS SQL Databases & DNS
2) Manually copy over website data (test show this takes 1 hour) + Repair permissions on those files
3) Manually migrate E-mail data over (test show this takes around 20 minutes to complete)

Step 1 is the longest step as this runs on the very slow Plesk migration tool.  However if this works we should have a working migration by Wednesday.
We'll post another update here later tonight.


Monday 8th May 20:35

We are still testing the above theory above.  We'll hopefully start running a production migration within 48 hours.
We'll post another update once tests have completed tomorrow afternoon.


Wednesday 03:00 / 3am

We are today re-starting the migration and hoping things will be completed by weekend.  If things go to plan we'll send out a mass mail later this week once done.


Wednesday 10th May 21:30 / 9:30pm

We are hoping to have a complete migration by Friday evening.  We'll add further updates here tomorrow evening or Friday Morning.


Friday 12th May 2:30pm

Migration is now over half way completed creating accounts in Plesk.   We are expecting the go-live to be on Monday morning.
We'll update this thread over the weekend.


Sunday 22:30 / 10:30pm

Migration is set to finish during the night, however most data will be out of sync as its been running since Tuesday afternoon. 

Monday 10:40am
We are still migrating accounts, we are hoping to go live today/tomrorow

Tuesday 11:30am

We are working with Microsoft to fix a bug we've found with Windows Server 2016, until this is fixed we have put this migration on hold. 
next update will be later this week. 


Friday 19th May 8:30pm

This migration is on hold for now, We opened a paid support request for £400 on Monday morning for a 4 hour response from Microsoft.  At 8:30pm on friday we've still not got a response to our ticket, we've called them many times and speak to level 1 MS support who just keep telling us our ticket has been escalated but we've yet to get a response.

Cloud VPS Network Outage Resolvido
Prioridade - Média

We are aware of some kind of network attack to our Cloud Server platform.

We are working on this now and awaiting a response from our data centre.

We'll update this thread before midnight.



22:55 / 11:55pm 9th May

around 9:30pm tonight we started experincing some network issues in to our rack where we host our cloud VPS servers.  All our systems were showing little information that may make us assume this is some kind of inbound or outbound network attack.

We have got involved our data centre colocation provider who believe their maybe an issue with the fail over network and have just unplugged one of the uplink connections to force fail over to the second connection a few moments ago which so far has a possitive effect.

We are continuing to monitor and will update this post within 1 hour.



00:08

This was working great for 10 minutes but we can see ping is again timing out or very high response times. 
We will continue to investigate this issue.



00:20

This appears to be an issue with the uplinks to the internet in this rack.
Each Rack has 2 connections
Connection 1
Connection 2

when connection 2 is disconnected the issue appears to go away, once re-connected the issue comes back.

We've not had this confirmed yet buy our uplink provider but this is from what we can see while monitoring remotely.
We will continue to investigate this issue and update this post shortly.



00:55

network timeouts and large pings have returned.  We are still in constant communication with our uplink provider and doing everything possible to identify this issue.



03:00

This issue has now been resolved.

VPS outage Resolvido
Prioridade - Média Afectando Sistema - Cloud VPS Platform

23rd April 2017
21:26

We are aware of an issues effecting multiple VPSs on our cloud server platform. We are investigating this issue and will update this thread when we have more information.  Please do not attempt to reboot your VPS at this time.



21:40

from what we can see the disk performance has dramatically dropped between hypervisors and the storage SANs, the syning between our SANs has also started to fail due to the poor performance.
We've now escalarted this to the level 3 support team by our cloud platform developers and awaiting their response.
Next update to this ticket should be around 22:00/10pm



22:03

Unfortunately we have not yet had a response from our developers level 3 storage team although we can see they have logged in to our network so someone from their team is looking in to the issue but not yet responded to us.
next update on or around 22:30/10:30pm



22:15

This issue is now looking to be resolved.  We've found one of the hyper-visors were the cause, we are investigating logs to find why this happened and what we can do to stop it from ever being able to happen again.

MSP Control Panel Resolvido
Prioridade - Média

Hello

The MSP control panel will be unavailable as we are carrying out a much required update to the Control Panel. We expect this process to be completed in an hour or so. If there are tasks you need to perform urgently, you can post a ticket with your requirements.

Thanks for understanding

Cloud VPS Platform Upgrades - 16th December Resolvido
Prioridade - Média

Scheduled Maintenance
Cloud Server Platform Upgrades

When: Friday 2nd December 2016 8pm Re-scheduled: Friday 16th December 2016 8PM

All VPSs will be shut down during the maintenance and automatically and started back up again once the maintenance has finished.

During this time we are doing a OS upgrade to our hypervisors which should improve overall performance of all virtual machines which should make everything much faster including the disks read and write performance.

VPS Resellers who have access to cloudCP will also notice a refreshed interface as the control panel will too be upgrades to the latest version.

So your VPS is booted back up with everything up to date we recommend you do the following:

Linux Centos/CloudLinux VMs:  SSH to your server and run command  yum update -y  (press enter) this will update all components that need upgrading.  when the VM reboots it'll boot in to the updated kernel.
Windows VMs: Start > control panel > windows update.  check for updates and install everything thats available.



22:00

all virtual machines are now shutdown and upgrades have started. 
Next update we will post at 11pm/23:00


23:10

Software has been upgraded and we are shortly going to be rebooting all of the hyper-visors in to their new faster OS.  The next step will be to boot up virtual machines.

Next update will be between 23:45 - 00:15



23:50

Everything upgraded sucessfully and VMs are now booting back up.
VPS resellers will be able to gain access to CloudCP again once the maintenance is complete.

Hyper-V Classic Windows VPS issues [Resolved] Resolvido
Prioridade - Critica

15th December 2016
16:50

Today around 12pm our Classic Windows VPS (Hyper-v via WebsitePanel/MSPControl)  had a disk failurer.  The disk has been replaced and failed to repair itself.
We are now replacing the disk again with another disk in hope the repair will begin.  Once the repair has complete we will boot the windows VPSs back up.
Assuming the repair starts around 5-6pm today, we hope to have VMs back online this evening and running at full speed again by early hours of the morning.



17:01

The rebuild started at 16:55 and appears to be working (slowely).

Once rebuild is complete we'll reboot the Hyper-V Server to apply some windows updates, when it boots back up it'll automatically start up all VPSs.

We'll post on here when everything is complete.



18:50

Repair is currently at 75%  we are hoping everything is back online for 8pm - 8:30pm



19:45
Raid Rebuild is now complete, we've now installed windows updates on the hyper-visor and rebooted it.  VMs should start to come back online around 7:50pm - 8:15pm and intially will be slower than usual while disk I/O on the server is high with all the other servers booting up.

Network Upgrade Resolvido
Prioridade - Critica Afectando Servidor - thesslstore

Cyber Host Pro will be swapping our network connectivity at 22:00 hours (UK time) on friday 30th September, the new connection will also have a fail over network so if one connection goes down it'll fail over to connection 2 coming in from another data centre next door.

During this time we expect around 10-15 minutes network outage however we've opened a 30 minute maintenance window.



22:10

Most Dedicated Servers only had 1-2 minutes outage, some and all VPSs still down due to firewall issues.



22:50
Shared Hosting network back up, this took 48 minutes in total due to issues with hardware firewalls and having multiple networks which took the team a little longer than expected to fix.



22:51
1 Rack left to go effecting CloudVPS, we will replicate what fixed above so we expect this to be online momentarily.


 23:04

All maintenance is complete.

Network issue Resolvido
Prioridade - Critica Afectando Sistema - Network

at 9:32am UK Time on 10th September 2016 our data centre experienced a network outage.
At 10:43am the shared hosting network has came back online however our VPS/Dedicated network is still down.

Our network provider are working on the core network to fix this

Updated we are posting on our twitter page at www.twitter.com/cyberhostpro

MSPControl/WebsitePanel - WEB 1 Migration Resolvido
Prioridade - Critica


This issue is related to websites hosted on IP Address 95.215.224.148

7th August 2016

During this evenign we found that the Windows 2008 server with IP 95.215.224.148 had been comprimised, we identified the issue as a security issue in Windows 2008 which would allow a hacker to gain access to the Administrator password.

The server was our first web server for the MSPControl hosting which was commisioned in 2008 and is 8 years old.  We had planned to migrate all websites to Windows Server 2012 R2 (latest) within 2-3 weeks.

We've now gone ahead and migrated all websites on 95.215.224.148 to the new Windows 2012 R2 Server which will give you the very latest IIS, PHP and web security. 

You shouldn't need to do anything as most websites have migrated with no problems and will remain on the same IP as before.

If you do have any issues, please contact support.


Any known issues are below:

1) Microsoft Access Database Websites
Some users who have ms access databases may find their website does not load or is read only or gives error:
An error occurred on the server when processing the URL. Please contact the system administrator.

 

If you are the system administrator please click here to find out more about this error.

Login to MSPControl at http://cp.dnpserver.com
go to file manager
click your domain
click the padlock next to folder DATA
tick both read and write next to your domain name
Tick the box "Replace permissions on all child objects"
click set permissions

This should fix the issue, if not this means your database maybe in another folder! Follow the same process for the location of your MS Access database


2) File permissions won't set on folder
if you are unable to view/set permissions on a domain in file manager follow the below guide to fix this issue
Login to MSPControl at http://cp.dnpserver.com
Go to web > websites and click your domain
Scroll down and click save changes & Exit
this will fix the issue with file manager with this domain.

Cloud Server Maintenance - 30th May 00:01 Resolvido
Prioridade - Alta Afectando Sistema - ALL CLOUD VPS SERVERS


30th May 2016


00:01

We will be upgrading our cloud server platform starting around midnight on 30th May 2016.  (early hours on a Monday Morning)

We will shut down all virtual servers during the maintenance period

Once the platform has been upgraded and the hypervisors have been rebooted, virtual servers will then be booted back up.

Updates will include:

hypervisor updates to fully support windows 10 virtual machines (template to be added soon)
Disk Performance update - a software bug causing disk write speed not to perform as well as it should for SSD disks
Backup speed improvements
+ over 100 bug fixs



30th May 2016

00:50
VMs are now shut down and maintenance has begun.
We will update this thread around 2am.


1:59am

All Virtual machines are not booted back up

CloudLinux-4 Down Resolvido
Prioridade - Critica

CloudLinux4 / 95.215.224.43 is currently down due to a website on the server is causing both inbound and outbound network attacks.

We are investigating this issue with both our network provider and Cpanel.




14:21

We will be re-routing this servers IP within 5-10 minutes to see if the attack has stopped.



14:54

this is again down as the server brought our network down.  We have some senior firewall engineers working along side our network team now investigating the cause.



15:37

our firewall admin team are still investigating this, so far nothing has logged for us to find which domain is causing the attack to the server.  Once we find the domain we will suspend it and re-activate the shared IP for CloudLinux-4



15:55

the server is back online and firewall tweaks have been put in place to block the type of attack that  was being recieved on the network.

Hyper-V Node 8 down Resolvido
Prioridade - Critica

NODE8 one of our Hyper-V NODEs is currently down.  Today we found one of the hard drives have failed in the server.

We replaced the hard disk immediately within minutes of the disk showing failed.   The Server is now rebuilding its Raid which has slowed the server down that much  that all VMs are now down.

at 12:50 UK Time the raid is on 25% complete on rebuild.  Service should resume back to normal later today.

At this time we have no ETA, however it did get to 25% complete in under 1 hour, we could guesstiamate that it will take another 2 hours, however from experience sometimes it can take much longer.

we will continue to update this thread.



Next update will be on or by 3pm



3:13pm

the rebuild process is 57% complete



16:02

the repair is on 80% complete



This issue was fixed approx 6pm. If you still have issues restart your VPS. 

Cloud Server Network Issue Resolvido
Prioridade - Critica Afectando Sistema - Cloud VPS & VPS Reseller Platform

We are currently investigating a networking issue on our cloud server platform.

We've escalated this to our upstream provider and awaiting feedback from them.

We will update this thread whenever we have updates.



13:20

we've identified the issue to be internal networking from the hyper-visors to the storage network switch causing VMs to either be very slow or not ping at all (or go down in some cases).

We are awaiting feedback from a Dell engineer and will update this thread when we have further information.



15:45

This issue appears to of fixed itself, both our engineers, cloud developers and Dell network engineers so far have found nothing thats helped us identify the cause of this issue.  Once we do we will post information on this post.



16:30
the issue has returned.. we now believe its a customers Virtual machine which is causing the issue.
We are shortly rebooting one of the hypervisors then will boot up the small number of VMs that are down.



18:20

So far we've been unable to idenify what is the cause of the issue.

We are now looking at rebooting all the cloud hardware and run software updates to apply patches and updates to the network card drivers which may fix the networking issue.

Further updates will follow later this evening.



18:30

ALL VMs will shortly be powered down for up to 1 hour which should help to resolve the issue



19:55

All VMs are now either booted up, booting or queued to boot up shortly

we will update this post when all VMs are online.



21:20

all VMs have been booted up for a while.  We are now monitoring the network to make sure the issue is resolved.

CloudLinux -5 Permissions issue Resolvido
Prioridade - Critica Afectando Servidor - UK cPanel Reseller 6 (uk-cp-rs-6)

We have identified an issue with permissions on the CloudLinux-5 Server  causing multiple domains to stop working.

We found a fix around 8:55am and are now applying it to the server, we are hoping this completes within 1 hour.

We will update this thread again between 9:30am - 10am with an update.



9:45am

the restore is only just starting accounts begining with C, we now think this may take several hours to fix the permissions on all accounts.
During this time we recommend making no changes inside of Cpanel to your domain name to avoid causing any issues.

Cyber Host Pro are sorry for any inconvience this may cause.



10:52am

the repair is still running, we are now up to accounts begining with G.



11:53

we are now up to accounts begining with J



13:42


we are now up to accounts begining with P



14:00

we are now up to accounts begining with R



15:25

All permissions have now been corrected, and all websites/emails should be back online and accessible.


Cloud Server Maintenance Resolvido
Prioridade - Alta Afectando Sistema - Cloud VPS & VPS Reseller Platform

Scheduled Maintenance
Cloud Server Platform Upgrade - 3rd January 2016
Starts: 01:00  (GMT/UK)


At 1am on the 3rd January 2016 we will be performing our semi-annual cloud server platform upgrades.

During this time we have to power down all of the virtual machines to apply platform upgrades to all hypervisors and storage devices which will require us to reboot all hardware once completed.

Once the maintenance has been completed we will boot up your virtual machine.

During the maintenance it is important that you do not attempt to boot up your virtual machine as this can lead to permanent data loss.

Due to the number of virtual machines we host on our cloud VPS Platform, we've opened a 5 hour maintenance window.



3rd January 2016
00:30

it appears our overseas developers have started this maintenance one hour before schedule. 
We appologies for any inconvenience this may of caused.



3rd Jan 01:40

Are software upgrade is now complete and VMs will soon start booting back up.  Due to hundreds of servers on our cloud it could take up to 1 hour for all VMs to power up and up to 2-3 hour for full typical performance speeds.



3rd Jan 21:37

it has come to our attention throughout the day that Virtual Machines running Windows 2008 are not working and crashing shortly after the server is booted up.
We are working hard with the developers to try and find a fix for this, so far the process is very slow and we are working hard to try and find a way to have this windows VMs back online.



4th Jan 10:02

All server 2008 machines have been moved to a single physical machine that a custom patch is being applied to now. It will require a reboot of this physical machine - this process usually takes 30-60 minutes, however it may take longer than this for all the virtual machines to be booted back up.



4th Jan 11:33

Most virtual machines have booted back up, with successful results on all the 2008 machines tested so far.



4th Jan 11:49

All Virtual Machines are now back online.


Hyper-V Node 4 issues Resolvido
Prioridade - Critica Afectando Outro - Traditional Windows 2008 Hyper-V VPS

we are experiencing an issue with a Hyper-V Server.

We have sent a engineer down to the data centre and should arrive 18:30 UK time

Plesk Win 1 - Emergency outage 11th December Resolvido
Prioridade - Critica

Date: 11th December 2015
Time: 7pm (UK)

We will be rebooting Plesk Windows Web 1 at 7pm to run a full scan disk to scan and repair any drive errors to fix an issue that has caused multiple outages over the last few days.

The scan disk can take several hours, we are expecting this to complete in 1-2 hours however this is a guestimate and it could take longer.

Plesk Windows - Issues Resolvido
Prioridade - Critica Afectando Sistema - Plesk

10:51am 18th November 2015

We have identified an issue with Plesk windows server causing slow speeds and outages to websites and email.

The cause has been identified as a faulty hard disk causing Raid Failurer which has considerably reduced the disk performance.

We are waiting a same day delivery of a replacement part and will be installed in the server around 1pm today. 

Once the drive is installed, the server will start to rebuild its raid array, it could take a further 12-18 hours before full performance is restored!

We will keep this post updated throughout the day.



10:58am

email now appears to be flowing normally again, We have had to disable the enhanced anti-spam checks which can be quite heavy on disk I/O, this will be re-enabled later today once the disk has been replaced.



14:45

The drive was replaced around 12:45pm. So far the auto repair is showing 32% complete,  some websites are slower than usual and email service will be slow if using webmail.  This will automatically fix itself throughout the day when the repair has finished.

Next update will be posted before 9pm.

CPanel Shared Hosting Server Upgrades [COMPLE Resolvido
Prioridade - Média

This migration completed early hours on 10th October. New Server Name is CloudLinux-5



Cyber Host Pro every few years upgrade our hardware to give our CPanel shared hosting & Reseller Hosting customers the very best possible hosting experience.


CLOUDLINUX-2 / 95.215.225.1 will be migrated 9th October 2015 starting 6pm and will take approx 6-12 hours to complete.

Shared Hosting IP will change from the above IP to 95.215.224.20,
INFO: for the very little number of customers who are NOT hosting DNS/Nameservers with us, you will need to update your IP with your DNS Hosting company.

We expect none or very little downtime during the migration.

Whats new with new servers:

  • Brand new 2015 Dell Servers with Multiple Physical Processors and at least 128GB Ram per server
  • Enterprise Level SSD hard disk drives
  • MariaDB 10 < makes databases much faster than previous MySQL 5.5  (Comparision at https://mariadb.com/blog/mariadb-10-vs-mysql-56-feature-comparison-update Compare tab 1 to the last tab (MySQL 5.5 vs MariaDB 10)
  • Default PHP is PHP 5.6 (previously 5.4)
  • PHP Selector has been added inside CPanel, for those requiring older PHP Versions for apps that are incompatible with latest PHP.
  • OPCache has been enabled on all domains to enhance website performance and SEO
  • CloudLinux 7 (Brand new, only released within last 30 days for CPanel)



Coming over the year:

  • NGINX will replace Apache to further improve performance of websites


NODE7 - Hyper-V Windows VMs - Hypervisor RAM Resolvido
Prioridade - Alta

We are investigating an issue with faulty RAM module on Hyper-V NODE7.
We will be replacing the faulty ram between 12:00 - 15:00 today, during this time VMs will be down for approx 10 - 30 minutes.

HV3 issue on CloudServer Resolvido
Prioridade - Critica Afectando Sistema - Hypervisor HV3 on Cloud Servers

16:30

We are investigating an outage on HV3 on cloudServer control panel, VMs will show online in your client area / CloudCP and console will still work, however it appears internet connectivity is not working.

We are working on this now and awaiting the administrators/developers of our Cloud Server software to fix this now.

we will add an update to this thread at 5:15pm.

16:51

this issue is now resolved. sorry for any inconvienance this may of caused.

CloudCP - Out of hours reboot 02:00 - 04:00 Resolvido
Prioridade - Alta Afectando Outro - Cloud Servers

AT 2AM we will be rebooting all hypervisors to apply a patch to fix all of the issues we've had over the last couple of weeks.



this maintenance was completed sucessfully and we are seeing performance better than we've ever experienced.

We will send an email to customers within 72 hours to confirm if the issues are now finally resolved.

Critial - Some VMs down on Cloud platform Resolvido
Prioridade - Critica Afectando Sistema - Cloud Servers

We are aware of issues with Servers on HV1/HV2 OR servers that do not use SSD hard disks being down.

We've now gone ahead and rebooted those Hypervisors and will start to boot up virtual machines as soon as possible.

We will update this thread once we have more information.




7pm
Most VMs are now back online or booting up.

An email will be sent to all customers within 12-24 hours with further information.

Cloud Server - urgent maintenance - 9:30pm Resolvido
Prioridade - Critica Afectando Sistema - Cloud/VPS Servers

9:30pm

We are rebooting all cloud server hyper-visors to apply a patch to fix the performance issue we've had for the last 10 days.

This should be the final time we have to do this.

next update before 11pm




22:45

All VMs are now pending start-up, 10% of them are already online.  We've configured the cloud to only run 5 boot up tasks at once with over 100VMs queued, so it may take up to 1 hour for all VMs to come back online.

If your server is still down after 11:30pm please contact support.


23:35

VMs are still booting, we've now changed this from booting 5 at once to 15 to speed up the process.  We'll update this thread around midnight with an update if their is still any VMs to boot.


00:21

all VMs are now back online or booting up.  Performance should be back to normal by working hours in the morning.


Cloud Server - urgent maintenance - tonight Resolvido
Prioridade - Critica Afectando Outro - Cloud Server

22:05

we urgently need to perform some high priority maintenance on the cloud server platform.

all VMs will be rebooted shortly and may be offline for up to 2 hours.



00:00

sadly this is taking longer than planned due to a incorrect 10Gbit netwok driver supplied to us.  Our developers are working on this now and we will boot all VMs up as soon as we get a fix during the night.

next update will be before 2am.





3:50am

most VMs are now online.  We've identified an issue where the cloud control panel may say your VM is down however it pings and works.  This issue should be fixed by morning.

CloudServer maintenance 9th July 2015 8pm [ C Resolvido
Prioridade - Alta Afectando Sistema - CloudServer

8:03pm

maintenance has started



8:20pm

VMs are still shutting down, we are about 85% through waiting for shutdowns to complete.  Once done we can reboot the Hypervisors.

next update due before 8:30pm



8:40pm

All VMs are now shut down, this took much longer than we expected due to the slow performance issue on some servers,  we are now about to reboot the hypervisors, we will then begin to boot back up servers once everything is confirmed fixed and working by our team.

Next update due 20:55



20:55

Hypervisors are now back online.  We are just doing some network checks before booting servers back up.



21:00

Virtual servers are not booting back up.  If you are unable to access your server by 10pm please open a ticket at http://portal.cyberhostpro.com/  Login to your account and open a ticket to Technical Support.






Cloud Server Maintenance Resolvido
Prioridade - Alta Afectando Servidor - OnAPP User

Maintenance Start: 3rd July 2015 9pm UK Time
Maintenance Window: 90 minutes (however we hope to have this complete in 60 minutes)

This post will be updated when the maintenance starts.



3rd July
20:55

The maintenance will start at exactly 9pm UK Time.

Please do not attempt to start up your server as this may cause perminant data loss.

Please check this post again at 10pm for our next update.

22:01

We will shortly start booting servers up.
Next update due on or before 11pm


22:51

Most Virtual machines are online, however we have a critical issue with our current SSD Storage stopping virtual machines using SSD Storage from booting up. 
We've contacted our cloud platform technical support for help with this and awaiting to hear back from them.



23:44

We are aware of 2 issues

Servers on HV2 are showing online but not working, this is due to an issue with the wrong internet network port being used, our developers are working on this now.

Issue 2 is as above the servers that use SSD Storage not booting up,  we are still working on this.




23:57

the issue with HV2 internet has been fixed.  We are now contining to work on the SSD issue.


00:50

at 00:36 all VMs are now back online.  Any slow speed issues will automatically fix itself within 12 hours.

CloudLinux-4 < down 01:00 - 01:15 Resolvido
Prioridade - Critica

CloudLinux 4 will be down 1am - 1:15am to fix some "power management" options in the bios which maybe the cause of PHP not running as fast as it should be when talking to MySQL.

WSPWEB-6 issue < websitepanel [FIXED] Resolvido
Prioridade - Critica

at 13:45 GMT on 4th April we identified an issue with WSP-WEB6 with IP Address 95.215.224.33

the windows system32 folder contains some corrupt files.

We are recovering the c:\windows\  backup from this morning

this may take several hours to complete.

We appologies for any issues this has caused.



19:04


The ETA for this to be back online is showing 20:10


19:55

this came back online at 19:35

CloudLinux3 IMAP/POP3 issue Resolvido
Prioridade - Critica

CloudLinux-3 is currently having an issue with POP3/IMAP connections.

We have had to escalate this to CPanel developers as it is in relation to a new feature in the latest CPanel that has failed to function correctly.

Please use webmail at http://[YOURDOMAIN]/Webmail or https://cloudlinux3.ukdns.biz/webmail

We expect IMAP and POP3 to be again functioning by 3pm UK Time today.

CloudServer maintenance 22nd march 9pm Resolvido
Prioridade - Critica Afectando Servidor - OnAPP User

22nd March
20:59

Schedueld Maintenance will start shortly.



22:09
Maintenance has finished.



22:30
it has come to our attention that servers on hypervisor HV2 have no internet connection.

Our senior administrators and a developer are investigating this now, we've seen this issue once before so we are confident on getting a fix applied tonight.



23:45
we replaced the network cable and everything is back online.
Maintenance closed.

CloudLinux -1 Issue Resolvido
Prioridade - Critica

Hello

Today we've found some major degraded speed on the server CloudLinux-1 with IP Address 95.215.224.40

We have identified the issue as a hard disk failurer, The server has automatically started repairing itself.  No time is given on the repair status, however we are expecting this to take up to 12 hours to resolve.

We will update this thread when we have further information.



18:16
the repair is now on 88%, stability was back to normal around 1pm today.  We will close this case once it has hit 100%

Enkompass intermitent outages today Resolvido
Prioridade - Critica

We are aware of an issue with websites on our Enkompass hosting have regular outages today for a few minutes at a time.

We have identified the issue as an issue with the Raid card on the Enkompass SAN.

We will be replacing the RAID card today in the server.

This will be replaced around 11am today.

We will update this page once the issue is resolved.



11:35
this issue has now been resolved by replacing the hardware.

Cloud Server - Reboot 5th Jan 21:00 Resolvido
Prioridade - Alta Afectando Servidor - OnAPP User

Date: 5th Jan 2015
Start Time: Approx 21:00
Finish Time: Approx 22:00

At 9pm we will be shutting down all VMs on the network to apply a fix to make hard disk data run at faster speeds across the network to fix an issue where Cloud Servers were not running at the best speeds on our new super-fast network.

At 9pm we will send a command to all HyperVisors to shut down virtual servers
Once all VMs are down (usually takes 10 mins) we will then reboot the hypervisors
They take about 15 minutes to come back up.

Around 9:30pm we will then start booting up VMs again.

Sorry for any inconvienance this may cause.



21:05
Maintenance has started. VMs are shutting down.

21:37]

VMs are now all switched on and booting up.  All Vms will be online shortly.

Maintenance finished.

Enkompass sites down - investigating Resolvido
Prioridade - Critica

14:40

We are aware of an outage for those customers using our legacy Enkompass Hosting service.
This will effect websites and unable to login to the control panel.

We are rebooting the SAN/Active Directory server which has failed to come back online.

We are investigating this as our top priority.



15:30

We have found an issue with the Raid card on the server.  We've managed to boot the server up.
We will schedule a raid card replacment in the near future.

Cloud Server - maintenance - 4th Jan 21:30 Resolvido
Prioridade - Critica Afectando Servidor - OnAPP User

We have some urgent maintenance to finalize the work carried out on friday night.

We will reboot all Hypervisors to apply the settings at 21:30

This will take approx 15-30 minutes, then all VMs will boot back up.



21:27
Maintenance will start shortly.


22:37
sorry for the delay.  The final Hypervisor is coming online now.

We expect all VMs to be up by 11pm at a new optimal speed.

23:05
Most Vms are online or booting up.
Maintenance complete.

Cloud Server Maintenance - 2nd Jan 20:00 Resolvido
Prioridade - Alta Afectando Servidor - OnAPP User


Scheduled Maintenance
Cloud Server

When: 2nd Jan 2015

Start Time: 20:00 UK Time.
Finish Time: 22:00 UK Time

We are upgrading our data storage network from 1Gbit to Dual 10Gbit, this should improve both the performance of all cloud servers by up to 40x. It will also dramatically increase everything else such as backup time and fix some other issues with building new cloud servers.

During the maintenance window virtual machines will all be shut down, the hypervisors will be taken offline while new hardware is fitted inside them.  Once all servers have been upgraded we will then start up all the virtual servers again.

During the maintenance do not attempt to login to cloud CP to make any changes to your current server or build new ones.

we will update this maintenance page when the maintenance has finished.

20:25
this maintenance has started 25 minutes behind schedule.



21:52

maintenance is still in progress. we are hoping to start booting machines up just after 10:30pm

we will update this thread when we start booting them up


22:35
we have some networking issues.  We are working on this.


22:50

VM's are now coming back online.  If your server is not online by 23:30, Login to cloudCP, if your server shows ON then click the console window to check your KVM screen incase the OS has a issue.


23:10
we are aware VMs are not accessable even though booted up.  We are working on this now.


23:45
Sorry for the extended delay.  We have a priority 1 ticket open with the cloudCP developers to help us with this issue, all VMs are booted but the network is not accessable. we will update this thread once its fixed.


00:35 3rd Jan

we are still working on this. 


04:20

Most VMs are back online.  We are aware that the cloudCP shows some VMs as offline when they are actually online.  We are working on this.  We expect everything to be fixed within 1 hour


05:20
Maintenance finished, all VMs have been online for approx 1 hour.  Sorry for any inconvienance caused.

Cloud Server - Unscheduled emergency maintena Resolvido
Prioridade - Critica Afectando Servidor - OnAPP User

25th December 2014
16:03

The Cloud Server storage network is having some unusual behavor!  We've applied a patch that requires us to reboot the Cloud Servers.

We started shutting down servers at 16:03 and expect all to be back online around 5pm.

we will keep this thread updated with updates.



16:40

Approx half the VMs are now back online.

We assume all VMs will be back online by 5pm.

backups will fail for today and some tomorrow while we do some internal maintenance to fix some disk issues causing todays/tomorrows backups to fail.

Cloud Server - Maintenance - 26th Oct - 21:00 Resolvido
Prioridade - Alta Afectando Servidor - OnAPP User

Cyber Host Pro will be upgrading our Cloud Servers on the 26th October 2014.

The maintenance will start around 9pm and last a maximum of 2 hours.  At this time we will shut down all virtual servers to upgrade the software that powers the Cloud Servers and reboot our hypervisors.  We will also be making some network changes to increase the overall speed of virtual servers and some fixs to bugs in the cloud control panel.

The longest part of our maintenance will be stopping and starting all virtual servers.

We will update this thread when the maintenance starts and completes. 

To help with the maintenance, we would like to ask that you do not contact technical support during the maintenance window for updates, if you have issues after we confirm the maintenance has finished we can assist you over a ticket at http://portal.cyberhostpro.com/

 
26th October 2014
13:28
This maintenance will start 9pm tonight. We sadly originally posted 25th when this was booked with the engineers for Sunday. This was an error at our end which we apologise for. 


26th October 2014
21:02

Tonights maintenance is going to be delayed a bit, we found some degraded virtual disks that were not showing up on our pre-checks earlier today.  These may take 60-90 minutes to repair.  Maintenance will start once these are finished.


26th October 2014
22:25

The degraded disk repair is still running. We won't begin the maintenance until this has finished.  We now expect this to finish between 23:00 - 00:00.

26th October 2014
22:54
Maintenance has now started.

26th October 2014
23:49

All Virtual machines have now shut down.  The shutdown of VMs is always the longest part of any maintenance we do.
We will now upgrade the software and reboot all hypervisors and SAN devices.

Please do not attempt to boot up your servers, ideally do not login to CloudCP via the web interface or any of our Phone or Tablet app's until after we confirm the maintenance has finished.

27th October 2014
01:12

We are on the final stages of our upgrade, we are not yet ready to boot all VMs back up.  Once we've finished, we'll boot all VMs back up and update this post.

27th October 2014
01:42

VMs are now booting back up.  Due to the number of servers all booting up, it may take some time before all Virtual machines are online.  If you are having issues or can not access your server. Login to http://cloudcp.ukdns.biz/  varify that your server is switched on and not pending, if its pending, your server is in line to boot up. 
If you see online and you are unable to access your server. Click the CONSOLE button at the top of your server page to see if your server requires your assistance.

WSPWEB-3 < DOS attack Resolvido
Prioridade - Critica

27th September 2014

Around 11pm on 26th September, we recieved a 5GBit massive DDOS attack on WSP-WEB3, this is the server with IP Address 95.215.224.191 which caused the entire shared hosting network to go down including our own site and support site.

We've made all changes possible to stop the network attack and sadly have been unsucessful, We have contacted our data centre network support team who have yet to get back to us and we may have to wait until morning.

We have now shut this server down to keep the network online for all the other servers hosted on our shared hosting network.

We will bring the server back online on saturday morning around 10am when hopefully the attack would of stopped and our data centre can put some security in place to stop the attack from happening again.

Cyber Host Pro apoligize for any inconvienance this may cause while those websites are down that are hosted on WSP-WEB3.

Please note that the outage did not effect our VPS, Dedicated Server & Cloud Server customers.




27th September 10:42

we removed the block on the wsp web 3 on the network, within 5 minutes we recieved another 5Gbit DDOS attack which again caused our entire shared hosting network to go down. 
we have now again suspended traffic to wsp web 3. Our data centre will implement DDOS protection for us on Monday. We are trying to push this forward to be setup on the weekend so we can again Re enable this server. 

CloudCP - Outage - Investigating Resolvido
Prioridade - Critica Afectando Servidor - OnAPP User

5th August 2014
11:01

We are aware of a outage on our cloud server platform.  This is being invesigated at the moment.
We will boot all client servers back up that are currently down the moment the issue is fixed.

We will update this thread as soon as we have more information



This issue has been fixed and VMs are starting back up

Cloud Server Maintenance - 5th August 2014 Resolvido
Prioridade - Alta Afectando Servidor - OnAPP User

Cyber Host Pro's Cloud Server will be going under some high priority maintenance during the night of the 5th of August starting at 04:00am.

Our developers have informed us their maybe some downtime during the early hours of the morning.  Maintenance will go on throughout the morning until mid day however their should be little or no downtime during working hours.

WebsitePanel - WSP-WEB5 - issue with harddisk Resolvido
Prioridade - Critica

29th July 2014
21:40

We have identified an issue with WSP-WEB5 which is one of the web servers used for WebsitePanel hosting.

We have rebooted the server in to scan disk to detect and repair hard disk issue.

The whole process is fully automated, once its finished the server will automatically come back online.

This may take some hours to complete, From experience a server of this size could take up to 3 hours to complete, however we have opened a maintenance window up to 8am tomorrow as the hard drive contains millions of files.

Cloud Server - Scheduled Maintenance Resolvido
Prioridade - Média Afectando Servidor - OnAPP User

Scheduled Maintenance
25th July 2014
19:30 UK Time

At 19:30 we will be shutting down all virtual machines to do some maintenance on the cloud hardware infrastructre which includes speed upgrades from the hyperVisors to the Storage network.
Once this is done, we will then upgrade the cloud control panel to the latest version.
Once this is done, all hypervisors will need rebooting.

We expect this process to take under 1 hour.
The longest part will be waiting for all virtual machines to shut down and start back up once the maintenance is done, and for this reason we've added a 2 hour maintenance window.

We are unable to do this any later in the evening, as we need help from developers oversears who are several hours ahead of us.

If your server shows offline in cloud control panel during this time, please do not attempt to boot the server up, We will start the server once ready, any VMs booted up during maintenance will corrupt and damage its virtual hard disk.

Although the upgrade should go very smoothly, please make sure you have at least 1 backup of your data if you do not have automated daily backups enabled in the cloud server control panel.



20:30
we have completed our work.  However the VMs will not start up due to it having some issues.
We are working with the developers of the cloud system to fix this now.
We will provide regular updates on this post throughout the next hour.


21:46
VMs are now booting back up

Some Enkompass Sites going slow Resolvido
Prioridade - Critica

26th June 2014

We have found some websites on enkompass are running slow.  We've spent some time investigating what is causing the slow speeds and found an issue with the SAN.  The SAN (Storage attached network) Raid battery has reset and is recharging, this is something that randomly happens every year, during this time the disk IO is very poor which causes sites to go slow.

We have spoken to dell and have been informed it can take up to 12 hours to complete and sadly their is nothing we or dell could do to stop or it speed it up.

This does not effect Email.

Cyber Host Pro apologise for any inconvenience this may cause you.



15:30
The above issue has been fixed. However we have found a further issue on Enkompass-Web1 with a hard disk failure and raid battery failure.  We have ordered some dell parts that arrive tomorrow afternoon followed by same day installation.


28th June/ 12:54

The replacement parts have now arrived.
We will be installing these parts today.  Full service should resume by 18:00


This issue is now resolved.

Reboot to Traditional Linux VPS Nodes (none c Resolvido
Prioridade - Alta

We are shortly updating all of our OpenVZ Node servers to update them to the latest linux/openVZ to apply security updates.

Outages on VPS may last up to 30 minutes, however we expect it to be around 15 minutes per VPS.

Hyper-V NODE5 Down - effecting windows VPS Resolvido
Prioridade - Critica Afectando Sistema - Traditional VPS (none cloud)

Hello
We are aware that one of our Hyper-V  hypervisor nodes has gone down. 
We have rebooted the server, but sadly it has not came back up.

We will shortly be connecting a kvm and screen up on the server to invesigate what has crashed the server.

We will update this thread by 11:30am GMT

CloudCP - hypervisors Reboot - 18th May 2014 Resolvido
Prioridade - Critica Afectando Outro - Cloud Server

01:05

We will shortly reboot all hypervisors on Cloud server to apply a patch to further optimize the performance of our servers.



02:00

most VMs are now back online.  Everything should be back up and running for 02:15-02:20

Maintenance - Cloud Server tonight Resolvido
Prioridade - Critica Afectando Outro - Cloud Server

Tonight at approx 9pm we will be taking all cloud VMs down while we perform some critical maintenance on our storage network which has caused several outages for a few customers over the past several months.

During this time we will be installing additional quadport network cards in each physical hyper-visor and moving the storage network to the new network card configured as a quad port with network bonding to make a super fast storage network which will result in faster servers, faster backups and a stable platform.

We will update this thread when the maintenance starts and finishes.

During the maintenance please do not attempt to login to the Cloud Control Panel to make any changes to your virtual machines

Once the maintenance has finished, we will boot all the cloud servers back up.


21:18
we are now starting to shut down virtual machines.  the next update will be within 45 minutes.

21:40
the maintenance has finished and the job was completed sucessfully.  All virtual machines are now booting back up and should be back up and running for 10pm if your not online already.
You can login to cloudCP to check the progress of your reboot.

Cloud Server Outage - investigating Resolvido
Prioridade - Critica Afectando Outro - Cloud Server

16:30
23rd April

We are experiencing an outage with one of our cloud server hypervisors.  We have rebooted this now and expect it to come back up within 20 minutes.

MySQL issue on CloudLinux3 Resolvido
Prioridade - Critica

Hello

MySQL on CloudLinux3 has become corrupt.  We are working on repairing the data throughout the night. This should be resolved by working hours tomorrow and hopefully much sooner.



3rd April 10:00

We have begun to recover a 24 hour old backup of data.  We have no ETA on this as of yet.  We are hoping it will be completed by the end of today.


3rd April 11:10

We have cancelled the data restore as it was showing it was going to take 24 hours.  We have restarted MySQL and it seems databases are back online, however it is causing lots of errors our side.  We will be looking to recover data out of hours back to our backup taken 2nd April 1am.  I recommend any clients with critical data to use the backup tools in CPanel to make a database backup as you may loose data if we do have to do a mass restore.


4th April 09:00
The data restore has been completed in the night.  However the MySQL Drivers automatically upgraded to 5.6 from 5.5  We have contacted CPanel to provide us with the nessesary MySQL Drivers.  We usually get a response very quick from them.

Next update 10:15. Which we hope the issue iwll be resolved by then.



4th April 10:36

This issue is still with CPanel, it is still being investigated.  We hope to have this back online later this morning.  Data is being recovered as mentioned on the 11:10 update on the 3rd of April however MySQL is still having some issues.



4th April 11:20

Some databases are back online.  We have an automated tool running that is now repairing databases.  Sadly it does not tell us how many its done and how many is left. 

4th April 13:30
The restore is still processing, some users have reported temporary login issue with cpanel, ftp and email.  This will be related to the restore and we recommend you try again later.


4th April 13:45

Databases have been recovered to the 26th March as their has been lots of failed databases since the 27th March.
This issue should now be resolved.

Cloud Server - outbound dos attack causing ne Resolvido
Prioridade - Critica Afectando Outro - Cloud Server

Hello

We identified an issue where one client has been making outbound network attacks from our network which has caused the internet connection on one of our Cloud Hypervisors to stuggle with the traffic.

We have now issolated the abusing server and shut it down which has brought our network back online.

Cyber Host Pro apologize for any inconvenience this has caused any of our customers.

Network issue effecting VPS & Dedicated S Resolvido
Prioridade - Critica

We are expeniencing a outbound network attack.  We are invesigating which VPS is causing the network attack.
Further information to follow



15:47
The attack is at large and has effected our switches that manage the legacy VPS's both windows and Linux and some dedicated servers with 100mb network connections.
We will be looking to replace the switch with a more powerful switch, however we are still trying to fix the current switch and terminate the offending vps.



15:50
The attack is growing and now effecting all VPS, Cloud & Dedicated servers.
We are shortly taking down the physical node that we believe is causing the outbound attack.


16:20
We have identified the customer causing the attack and blackholed the servers IP which has brought the network back up.

CloudServer control panel issue Resolvido
Prioridade - Critica Afectando Servidor - OnAPP User

Hello
We are currently experiencing some issues with the CloudCP control panel.   Please do not reboot any servers or try to make changes such as make or restore backups until we confirm the problem has been resolved.



09:45 - we are awaiting the developers of the product to login to invesgigate the cause.



14:00

The developers of the cloud software we use are fixing a critical issue with the storage of the cloud which has caused severe issues today.  This will give errors on reading/writing to storage. this will be fixed shortly.


15:00

this issue was resolved earlier, we also rebooted all Virtual machines to be sure all VMs were fully functional.  The developers are making some changes to the SAN storage application to avoid such issues from happening again in the future.

Networking issue [resolved] Resolvido
Prioridade - Critica Afectando Outro - NETWORK

Approx 01:15am our data centre had a network issue with their network.&nbsp; This issue was resolved around 2am.

NODE8 - Hyper-V VPS Resolvido
Prioridade - Critica Afectando Sistema - Legacy Windows VPS (Hyper-v)

On the 24th March at 21:45 We will be rebooting NODE8 that hosts several Windows Hyper-V VPS servers.  This is our annual maintenance to install windows updates to the HyperVisor.



22:20
The server is back online and Virtual machines are starting up. It could take up to 10 minutes for VMs to come online and up to 30 minutes for usual speed to resume while all VMs are coming back online

NODE7 - Hyper-V VPS Resolvido
Prioridade - Critica Afectando Outro - Legacy Windows VPS (Hyper-v)

We have identified a hardware issue on one of our Legacy Windows VPS Nodes.

We will be rebooting the server a few times between 20:15 - 23:00

During this time the small number of servers hosted on the server will go down and back up.



20:20
This has now started.  We will be rebooting the hardware node and running a windows scan disk to fix issues on Drive C.

Once back online, all VMs will come online briefly.  We will then install windows updates which will require a further reboot.

Further details to follow later this evening


21:45
This is now complete and all Virtual machines are back online.

Linux VPS (Legacy) Node maintenance Resolvido
Prioridade - Critica

On Sunday 23rd March 2014 at 19:45 we will be rebooting all our OpenVZ Legacy VPS Nodes to upgrade the Virtualization software.  All Virtual machines will go down during the maintenance.  We expect it take 15 minutes for all virtual machines to come back online.



19:57
This is now complete, their is still 1 or 2 VMs booting up which should be back online for 8pm.

CloudCP - outage Resolvido
Prioridade - Critica Afectando Servidor - OnAPP User

14th March 2014
08:30 GMT

We have an outage to our cloud hosting, this was caused by rebooting some of our cloud Hypervisors to fix an issue where some servers would not backup.  However we are now experiencing a different issue were no servers will boot back up.

Next response due 09:00



08:54 Most VMs are now back online. All Servers will be fully back online by 09:15



09:02

All VMs are back online

CloudCP Software Update Resolvido
Prioridade - Alta Afectando Servidor - OnAPP User

Scheduled for 7th March 2014 08:00

We are updating our CloudCP Software today which will start at 08:00 and finish by 11am. 
Please do not attempt to reboot any VMs during this time.


08:05 - 7th March
This has now started.


10:45 - 7th March

This is almost complete. However some VMs need to be shut down and then booted back up.  If your VM is currently down. It will be automatically booted back up once the upgrades team have finished updating your VM settings on the node. Please do not login to cloudCP or attempt to make any changes to your server during this time.

This mornings network attack Resolvido
Prioridade - Critica Afectando Sistema - Shared Hosting

Cyber Host Pro had a network outage that started around 10:35 and ended 10:57

The cause was by DNS-Recursion being enabled on one of our new cloudlinux servers that is then used to make outbound network attacks.

This only effected shared hosting network and did not effect our premium products such as cloud hosting or dedicated servers.

Changes have been put in place to stop this from happening again.

CloudLinux - 1 Migration Resolvido
Prioridade - Média

===================
CloudLinux-1 Migration
===================

This post will be updated when the migration for CloudLinux-1 Starts on the 31st January 2014



31st Jan 23:00
The migration has started at 18:00, 5hours in and so far this has only hit 8% done.  As the Cpanel migration tools makes sure everything has been perfectly migrated, it may take several days for all accounts to migrate.  If your DNS is hosted locally, you'll have no downtime or loss of service during the migration.

The next update will be added to this post within 12 hours.


1st Feb 08:05
The migration is now on 23% complete.  Next update due wbefore midnight tonight.

1st Feb 16:00
this is now 50% complete.

2nd Feb 01:20

Migration is now complete.

Inbound DOS attack Resolvido
Prioridade - Critica Afectando Outro - Dedicated / VPS network

19:18

Their is an attack on Rack I-12 which we are investigating. 

This only effects some Windows VPS servers, and dedicated servers with 100mb Network connections.

Shared Hosting / Cloud Hosting and customers with 1000mb/1Gbit network upgrades are not effected.


19:26
this issue has stopped.  We will be looking to upgrade the switch to a more powerful one that can handle attacks better in the future.



19:53

the attack has happened again.  We are working on this to find which server is causing the attack.  Once we've found the customer whos server has caused this we will immediately shut that server down to avoid any further issues to other customers.



19:56
An engineer will shortly be dispatched to the data centre to replace the switch with a more powerful one as we are unable to determine which client is causing the outage while the network on this rack is down.

Enkompass Websites - 20 minute outage Resolvido
Prioridade - Média

24th Jan 2014

We've identified a issue with one of the ram modules on the Enkompass SAN Server that stores website login details and data.

We are going to take the server down and replace the ram, we are also taking this time to double the ram in the server to improve performance.

A maximum of 20 minutes is planned. 

We've opened a long window from 5pm  - 11pm, however the total outage will not be more than 20 minutes outage to your website between these hours.

CloudServer - some VMs offline Resolvido
Prioridade - Critica Afectando Outro - Cloud Server

8th December 2013
23:28

We've been investigating an issue with a handful of VMs offline in cloud server that won't boot up.  We've contacted the support department who develop our cloud server systems, they have escalated it to their developers who may not be able to respond until 8am GMT.

We'll update this when we have an update from the developers.


9th December 00:15

this was resolved at 00:05 today.

DOS Attack - inbound attack on rack F11 - Win Resolvido
Prioridade - Critica Afectando Outro - Rack I12

Hello

our monitoring has detected several servers in rack F11 are down.
The switch is showing an inbound attack causing the network to malfunction.

We are investigating this now and hope to have an update within 30 minutes.



this has fixed itself within 5 minutes. we'll continue to monitor the situation

Enkompass Issue - websites down Resolvido
Prioridade - Critica

Hello

We currently have an issue with all enkompass websites being down.  Enkompass seems to of corrupt the ApplicationHost file.  We are working with enkompass support team now to have this fixed.



14:36

This is still down, we have the enkompass support team (who developed the cp) invesigating the cause.


15:42

Sorry for the delay in this issue, Enkompass support is in the US and no one could help us for a while due to Enkompass support staff were not present.  They are now working on this and we can see some servers are now back online.
Next uptime 16:15

16:36
We've now just got 1 more web server to fix.  Most sites are now back online.

16:42
This issue is now resolved.

MySQL Maintenance 9pm GMT 2nd Nov Resolvido
Prioridade - Alta

2nd November 2013:

MySQL will be moved to a new partition on CloudLinux-3, this is due to diskspace usage on the current MySQL Drive.
This usually takes <30 minutes.  It will start between 21:00 - 20:30.

Enkompass Cloud Hosting Sites Down Resolvido
Prioridade - Critica

Hello

We currently have a outage on our Enkompass SAN Server that delivers all the Logins and website files to our enkompass cloud servers.  We are investigating this now and hope to have a update shortly.



22:02
the Raid card has broken on the SAN and is not detecting any disks.  This may take some time to resolve.  We will post another update as soon as possible.  We have someone going on site now to look in to it.


22:59

We are awaiting a Dell Engineer coming on site to replace the broken hardware.  We've been given a 4 hour window for his arrival.  Once replaced the engineer will reimport the raid data and again the OS should load.


23:05
The Raid card has Magically started working, however we are still going to replace the hardware tonight as we can't have this happen ever again.

Hyper-V NODE 4 issue Resolvido
Prioridade - Critica Afectando Sistema - Windows VPS

We have had a Raid Failure on NODE4 that hosts around 10 Windows Virtual machines.
We have rebooted the server and imported the forign configuration and a raid rebuild will automatically take place.

All Virtual machines are now booting back up, however they may take sometime to fully boot up and performance very slow while the raid is rebuilding.

This should return to normal performance by business hours friday morning.

Outage - SAN Fault < Firmware upgrade Resolvido
Prioridade - Critica Afectando Outro - Shared Hosting (not effecting VPS or Dedicated Hosting or Linux)

Cyber Host Pro LTD



We are experiencing a issue with our SAN that hosts lots of our virtual machines.  Dell have provided us with a patch to fix this, however to be certain of no data loss dell have strongly recommended we shut down the VMs.

Machines that are down include:

All of WEBSITEPANEL hosting
Enkompass EMAIL

We will post an update once this issue is resolved.


00:47
the firmware to the disks has been complete.
The Firmware to the Raid Controllers & SAN Firmware has uploaded and installing.   This may take up to 15 minutes.

Once completed the Server will boot up back online.


00:53
Machines are not booting back up.   Everything will resume to normal (if not better) shortly.

DOS Attack - inbound attack on rack F11 Resolvido
Prioridade - Critica Afectando Outro - some VPS & Dedicated Server customers

We are currently experiencing a inbound DOS attack one of our our dedicted server racks.  We are investigating this now and will post and update at 22:30 with further information.



22:31, we have now identified which server has been attacked.  We will shortly issolate the server which will fix the issue.
Note: this only effect those customers with a 100mbit connections, customers with 1Gbit connection are not effected.



22:41, we are still working on this, we are waiting on the router NULL'ing the traffic to the server in question causing the DOS attack.

22:46, the issue is now resolved.

WSPWEB-2 95.215.224.166 - Outage Resolvido
Prioridade - Critica

27th August 2013
22:00 GMT

WSPWEB-2 is going down for emergency maintenance for a FULL scandisk and repair.  The server will automatically boot back up once its finished scanning for hard disk issues and repaired them.

Please be advised our support team can not make this go any quicker by the volume of tickets or chats for this matter.

WSPWEB-2 95.215.224.166 - websites slow Resolvido
Prioridade - Critica

Hello

We have an issue with WSPWEB-2, once client has found some hacked content on their site which we believe maybe caused by a virus or malware on the server.  We are running virus and malware scans throughout the day and expect sites on this shared hsoting server to run slower and may stop responding occasionally due to high memory/cpu and disk IO required by the scanning tools.

We will post an updatr to this ticket by 9pm with further information.



21:30
We are rebooting the server to run a full offline malware and rootkit scanner. the server will automatically run this and boot back in to windows once it has completed.

HELM - NETWORKDNS - Mail Migration Resolvido
Prioridade - Critica

Further todays Email sent to all HELM Customers on our NETWORKDNS Helm Servers, This page will be updated with Migration information once it becomes available.

 

Thursday 23:18:

The migration process will begin around 3am.  NOTE an error/typo was in the email, the mailserver IP will be 95.215.225.102 not the one shown in the email.  We will update all DNS Records with the correct IPs once the migration is started.

Friday 06:42

We are in process of updating all MX records and A record.  For the very small percent of domains not hosting nameservers with us, please point your mxrecords to:
MX Priority 10: helmmail.ukdns.biz
MX Priority 20: mail2.ukdns.biz

the secondary MX record is the same, however we've listed in incase you do not have both primary and secondary mail setup.

Email for HELM NetworkDNS users won't be able to login until 10:30 to email.  This is due to a very large file extraction.

DNS/Authentication issues:

We've set DNS 24 hours ago so ISPs only cache your IP for 1 hour, this should make the change over allot easier.  If your outlook cannot authenticate against the server, please change your incoming/outgoing mail to  helmmail.ukdns.biz to have immediate access to your inbox.

 

Friday 10:25

All services resume and back online.

Mail Down 07:50 - 08:30 Resolvido
Prioridade - Critica Afectando Sistema - Smartermail

Smartermail1 will be down from 07:50 for 40 minutes to finalize fix's to avoid any issues during office hours.  We've been working hard on this since 8pm yesterday and coming towards a resolution.

Smartermail Issues Resolvido
Prioridade - Alta Afectando Outro - SMARTERMAIL - Shared Hosting

Wedneday 24th:

Today Smartermail has has another long delay on the spool, While we are still communicating with smartertools trying to fix this, you will have a delay in your email.

Although we are confident the issue is with smartermail software, we will be running a full scandisk tonight taking the server out for approximently 1 hour.

This will take place at 05:45, during this time we will reboot the server in to scandisk & repair mode, then the server will again reboot and startup smartermail.

 

During this time you will not be able to send/receive emails, any incoming emails to your mailbox will go on our backup MX server.

 

Thursday 25th 09:31

The disk defrags and scandisks finished within the 1 hour window as expected early hours this morning, but again once 9am came and connections increased smartermails performance lags.  Smartertools have still not responded to our tickets as they are on public holiday until next week.  We've now had to purchase emergency support for the second time for them to investigate their software.  We hope to hear from them within 2 hours.

Thursday 25th 13:22

the issue remains with Smartermail.  We are moving all the HELM accounts to a new mail server we are configuring today.  all DNS will be changed to new mailserver IP 95.215.226.102 for those hosting their DNS externally should point their MX record to helmmail.ukdns.biz  do not make any changes until an official cyber host pro newsletter has been sent out.

Thursday 25th 23:20

All mail is now in every inbox, the mail server will be again taken down around 3am - 7am while 15,000 mailbox's are moved off the server on to new hardware which should help resolve this issue for now.  We believe their possibly maybe a issue with the hard disks for the DiskIO to be dramatically changed this week.  Once everythings back up and running we will look at replacing all hard disks on the mail server then restore all data.  This won't be until Dec/jan if everything is running smoothly.

 

Friday 26 00:40

Smartermail is down to high priority maintenance to try to fix this problem for good, we are compressing files ready to move to another mail server.  During this time you cannot send/receive email, any incoming mails will be stored on our backup server.  We expect this process to be complete by 6am.  we will be monitoring the server throughout the night, once its finished we will immediately re-enable mail.

 

Friday 06:01

Email will be back online around 06:45

Friday 06:40

Sorry for the delay, ETA now for mail coming live is 07:00, this will be for most users, those on the HELM Mail migration who received an email yesterday informing them of mailbox migration, your accounts will become live before 8am.

Smartermail Delay Resolvido
Prioridade - Alta Afectando Sistema - Smartermail 7

Since upgrading to Smartermail 7.3 latest stable build, we've had some issues for the last 3 days.

We are working with Smartertools support department to resolve this, due to time differences its took longer than expected, the issue seems to happen during busy hours (9am onwards) when smartertools support and development is not available.

 

We've today taken a debug log of smartermail to provide to their developers to make a patch, which we will apply out of hours once developed, hopefully today or later this week.

No email has been lost, its just delayed arriving in your mailbox, the spool has thousands of items in, and is taking allot longer than expected, this is because 1 Mailbox is corrupt and causing Smartermail to go in a frenzy, hopefully the patch will bypass that in the future to stop smartermail from behaving this way.

 

Cyber Host Pro apologise for any inconvenience caused, sadly this is something that is out of our hands, but we are working our best to provide smartertools with everything they need to resolve the issue within their software.

During some busy periods, smartermail may not allow you to connect to POP/SMTP/IMAP, this is also being looked in to, its apart of the above bug.  If our server is busy during new incoming mail, our backup mail server will accept the Email, so you will not loose any incoming mail.

Smartermail Reboot Resolvido
Prioridade - Critica Afectando Sistema - Windows Mail

Smartermail has had to be rebooted due to more issues with it today.

We expect this to be down for up to 30 minutes while smartermail rebuilds its cache. All incoming email will be held on our backup server.

 

During this time you will not be able to connect to email.

Network timeouts - shared hosting Resolvido
Prioridade - Critica Afectando Outro - ALL

Hi


we are currently experiencing network timeouts.  We have replaced the firewall midnight last night, although all worked fine during the night, it seems during busy hours the firewall is failing.  We will be replacing the firewall today.

A update will be posted on here around 3pm when we expect the issue to be resolved.

SERVER321 - WEBSERVER - WEBSITE PANEL - DOWN Resolvido
Prioridade - Critica

SERVER321

Web server 321 has been taken down for urgent hard disk maintenance, we are running a full scandisk on the server which usually takes 30 minutes or so to scan and repair any hard disk problems.

SQLSERVER2 Resolvido
Prioridade - Critica Afectando Sistema - SQLSERVER2 - MSSQL 2005 - HELM - Networkdns.biz

Hello

We have taken down SQLSERVER2 for some very high priority maintenance as this is the only server not in our cloud platform, settings need to be quickly applied with the server down due to a issue found on the server.

 

We expect no more than 60 minutes downtime.

 

12:23 - issue closed.

Smartermail Delivery Delays Resolvido
Prioridade - Critica Afectando Sistema - Smartermail - Windows Email

On 14th Sept around 18:00 Smartermail had some issues.  Since then mail has not been processing and we have spent the last 6 hours trying to fix this problem.

We are manually rebuilding the spool. any emails that have not sent/arrived between 18:00 and 23:58 may not been in our process folder and will be manually added during the night and morning.  Once cleared we will investigate further to avoid this problem occuring again in the future.

 

UPDATE 1:

02:20, all queued items have now been processed.  We are running a full disk defrag and optimize which can take 24-48 hours due to size of our drives.  this should not effect performance.

MANCLINUX1 Outage Resolvido
Prioridade - Critica Afectando Servidor - UK cPanel Reseller 6 (uk-cp-rs-6)

UPDATE 00:01:

this server has now been moved to XEN and the load is allot lower. Issue now closed as sites seem to be loading fine.

 

 

Manclinux1 seems to of crashed.  The last couple of days the performance has dramatically dropped.

 

at 16:01 today we rebooted it as nothing was responding.  However apache seems to be not responding throwing allot of server errors.

We will get this back online as soon as possible however at 12:21 today we already started restoring data from last nights backup to a new faster machine that can handle the IO that was causing the current server to crash.

For the next few hours we will have issues but this should be fine from later this evening onwards when we move MANCLINUX1 in to our cloud network.

Windows VPS Server Move Resolvido
Prioridade - Critica

at 20:30 the Windows 2008 VPS Server will be down while moved to another rack.  Maximum time 30 minutes outage however allot less time expected.

Smartermail Server Rack Move Resolvido
Prioridade - Alta Afectando Sistema - Smartermail - Windows Email

At 20:00 we will be moving the smartermail server to a new rack in our data centre.  Their will be a email outage for 30 minutes during this time.

Smartermail Outage Resolvido
Prioridade - Critica Afectando Sistema - Smartermail 7 - Windows Email

Hello,

 

We have had to reboot the windows mail server to apply a high priority fix to smartermail. this was done at 18:10 GMT, smartermail will continue installing the patch after reboot.  we expect email to be functioning again at 18:30.

Smartermail Upgrade - NOW Resolvido
Prioridade - Critica Afectando Sistema - Windows Mail

We are currently upgrade smartermail and will have a maximum of 30 minute outage. all incoming email will queue on our backup server.

 

22:48:

this is still upgrading everyones account.  we will update this ticket if not finished within a further 30 minutes.

 

22:54 upgrade complete.

MySQL Outage - Linux Resolvido
Prioridade - Critica Afectando Sistema - Linux - WHM - CPanel hosting

22/06/2010 20:40

 

Hi

We are now using litespeed technology to make websites allot faster however this has caused a issue with some sites not being able to connect to MySQL, litespeed should of been a none downtime update.  We are investigating this and expect to have a fix within a hour.

 

22/06/2010 20:42

this has been fixed on manclinux1. only manclinux2 left to fix.

MS SQL 2008 & MySQL 5.1 Scheduled Mainten Resolvido
Prioridade - Alta Afectando Sistema - SQLSERVER3

Sunday 27th June 2010 23:00 GMT (UK)

SQLServer 2008 will be taken down for essential maintenance and upgrades. SQL will be migrated to a new server on our cloud platform.  The main reason for the Migration is that the current OS has issues and will not install any windows updates, so moving data to a new OS image is required.

If your MySQL 5.1 or MS SQL 2008 website does not work after the migration urgently open a ticket up with our support team.

The migration will take around 1-2 hours however a 3 hour window has been scheduled for any unplanned issues that may popup during the migration.

 

Server120 Outage Resolvido
Prioridade - Critica Afectando Sistema - HELM Server 120

08:25am

Server120 has been taken down for urgent hard disk maintenance, a full scan disk is being scanned on the server.  We expect this to take approx 45 minutes.

 

SQL 2005 Down Resolvido
Prioridade - Critica Afectando Sistema - SQL 2005

22:35 1st June 2010

Our SQL 2005 Server for UKDNS & DNPServer is down fo urgent maintenance. We expect this to be resolved within 30 minutes.

Smartermail - not responding Resolvido
Prioridade - Critica Afectando Sistema - SMARTERMAIL

Email is currently down due to DDOS attack on a VPS on the same network IP Range as our mail server. we are investigating which VPS this is and will fix this as soon as possible.

 

Chris Danks
Cyber Host Pro Ltd

dnpserver.com - Reported Attack Site Resolvido
Prioridade - Critica

Our windows 2008 network control panel on dnpserver.com is being reported by Google that it is an attack site.

This is not strictly true as the domains mentioned which are causing this attack on the report are not hosted by Cyber Host Pro Ltd.  We are currently investigating to get this resolved.

Control Panel / FTP outage Resolvido
Prioridade - Alta Afectando Outro - DNP & HELM

Hello

HELM & DNP Control Panel & FTP will have a 1 hour 15 minute outage 7:30am - 8:45am on Saturday 1st may for maintenance.

Server321 issue Resolvido
Prioridade - Critica

Hello

 

27/04/2010 19:20

We currently have a issue with Server321, we have taken the server down to fix the disk issue, it will be back online as soon as possible, we are assuming this will take under 60 minutes.

 

27/04/2010 19:27

issue resolved and server back online.

Network issue Resolvido
Prioridade - Critica Afectando Outro - Network

Hi

We are aware of ping timeouts on our network this evening.  Our bandwidth provider are investigating this now as the issues does not appear to be related to any of the Cyber Host Pro equipment.

Once I have an update I will update this thread.

 

Time Opened 18:15 13th April.

 

UPDATE 20:00

 

The issue has recently gone worse, it seems we have a DDOS attack, we are working on this and will provide an update as soon as possible.

 

21:14

 

We have identified the DDOS is on server121, at this time we have blocked all traffic to server121 which seems to of helped allot so far.

we are still investing.

 

14th April 10:00

We are still working on this issue, we are hopefully going to be opening the IP again to see if the DDOS attack has stopped.  We are also working with cisco who will be looking at ways to stop this from happening again in the future.

 

14th April 12:47

Server121 is now back online.  It has been for the last 30 minutes but we were monitoring it to make sure it's back correctly before announcing it.  All sites should be back up and running now.  Sorry for any inconvenience caused.

 

14th April 14:15

the DDOS has continued and causing issues, we are still investigating this.

14th April 15:40

Things seem to be allot better, we've blocked traffic to the IP being attacked.  Any websites on Server121 that do not have static IPs will now have a new IP Address.
If your nameservers point to CyberHostPro then you do not need to make any changes yourself, if you do not host your DNS with us and use a 3rd party DNS company, you will need to update any records pointing to 95.215.224.57 to 95.215.224.186

 

 

14TH APRIL 15:10

The DDOS has caused more issues, we are going to reblack hole the ip being attached.  All websites on server121 using shared IP have been changed to a new IP that can be found within Helm control panel on DNS Zone editor.

 

15th April 11:15

This seems to be happening again on another IP! We are investigating this now.

15th April 13:00

We have found the website causing the attack, it was also known to google as a known site to cause issues.  we've now removed the site.

Outage Scheduled: 13th April 2010 06:15 Resolvido
Prioridade - Critica Afectando Sistema - Entire Windows Shared Hosting & Reseller Hosting Platform

When: 12th April 2010
Time Start Approx: 06:15

Expected finish: 06:45
However in case of any problems or further firmware updates, we have a 1hour window open for the upgrade.

 

A urgent scheduled outage will be taken place on our master SAN tomorrow 12th April 2010 at 6:15am to upgrade our SAN to a new firmware to fix speed issues on our Shared Hosting & Reseller Hosting with websites not running at optimal speed.  once the update has been applied approx 15 hours later our SAN will be running allot faster than before, it will also support the firmware we need for our new Cloud hosting platoform.


During this time all windows hosting will be down including DNS, I would recommend monitoring our network issues page to see when this has resolved.  I would also recommend closing outlook (or whatever application you use for email) and do not try to connect to email/website etc until you can see the maintenance is over, checking before hand will cause cache and your computer or ISP may then assume the server is down and remain that way for 24 hours until your local DNS checks again.

 

Cyber Host Pro Ltd

NODE4 - reboot tonight Resolvido
Prioridade - Alta

A reboot will be applied to the NODE4 server 12th April 00:00 to apply a firmware upgrade on recently installed hardware.

 

this reboot will take approx 15 minutes.

Smartermail Outage - 15 minutes Resolvido
Prioridade - Alta Afectando Sistema - SMARTERMAIL

Hello

We will have a 15 minute outage at 22:30 for Smartermail (Windows Hosting Email Server).  This is to replace the servers network card.  a 30 minute window has been scheduled.

Live automated server status can be found on our twitter page at http://www.twitter.com/cyberhostpro

During the downtime, all incoming emails to your domain will be held on our secondary email server, once our primary mailserver is back online, your email will automatically filter through to your inbox.

NODE4 Outage - 15 minutes Resolvido
Prioridade - Alta Afectando Sistema - NODE4- Hyper-V VPS

Hello

We will have a 15 minute outage at 22:40 for NODE4 - Hyper-V VPS Servers .  This is to replace the servers RAM .  a 30 minute window has been scheduled.

Live automated server status can be found on our twitter page at http://www.twitter.com/cyberhostpro

 

Smartermail issue Resolvido
Prioridade - Critica Afectando Sistema - Smartermail

Hello,

We have rebooted our smartermail server due to some performance issues.

This may take up to 10-15 minutes before you can connect again to your POP account or webmail.

 

http://www.twitter.com/cyberhostpro  < live monitoring on our twitter account.

Smartermail slow - 20th - 21st March 2010 Resolvido
Prioridade - Alta Afectando Outro - Windows Webmail

Hello

We are running a full disk defrag as apart of our maintenance on the mail server which we run every 6 months.

During this time webmail will run allot slower than usual at this time.

Cyber Host Pro Ltd appoligises for any inconvience this may cause.

 

Entire Windows Hosting Platform maintenance Resolvido
Prioridade - Alta Afectando Sistema - ALL Windows (not including Email)

Start Date: 14/03/2010 23:00

Total scheduled downtime 2hours (expected allot less)

 

Hello

We will be taking down our entire windows hosting platform for SAN Annual maintenance, this will take approx 30 minutes to complete including firmware upgrades to our Dell MD3000i & MD1000 series.  We have opened a 2 hour window however we expect this to be completed in under 1 hour.  During this time we will also be installing all windows updates on our servers so all machines are up to date.

 

This is to prepare towards our cloud hosting upgrade in April for High Availability hosting.

 

Chris Danks
Cyber Host Pro Ltd

Server 320 Reboot Resolvido
Prioridade - Alta Afectando Outro - Windows 2008 Hosting

14/02/2010 23:00 GMT

We will be rebooting Server320 for a hard disk scan disk to fix some disk errors detected in our latest backups.  We have a 1 hour window for this, however we expect it to be under 30 minutes.

 

 

VPS Hosting - speed issues Resolvido
Prioridade - Critica Afectando Sistema - NODE4 - VPS Hosting

03:02am

9th Feb 2009

 

Hello

VPS Customers (95% windows) may find some speed issues this morning with remote desktop.  We found one of the hard disks in the Raid currupted itself during a reboot.  We reboot the servers every 3 months to apply windows updates, during the boot we got alerts of drive failure.

Cyber Host Pro Engineers & Dell Engineers come to a solution on how to fix the current drive, the drive is now on auto repair, as Cyber Host Pro use Raid10, servers will not be down but slower than usual while the hard drive is repopulated with data.

As we have over 1TB Hard disks in our raid, it may take some hours to complete.  So far we can not see many speed issues ourselves that can cause problems to your services.

Many thanks

 

SQL Server 2008 Down Resolvido
Prioridade - Critica

Hello

 

We currently have a issue with our MS SQL 2008 server, we are working on this and expect a fix by 18:20

 

UPDATE 18:25

We installed a service pack to the SQL Server that caused the OS to currupt, we have started a BMR from a backup made just 5 minutes before the server crashed.

The reason for the delay in the restore is due to the backup manufacturer not fully supporting Hyper-V so its restoring at a very slow rate.

Currently restore is on 87% completed.

 

UPDATE 18:36

Issue resolved and server back online.

Server120 & Server220 Scheduled Maintenan Resolvido
Prioridade - Critica Afectando Sistema - SERVER120 & SERVER220

Server120 & Server220 will both be taken offline 23:30 for a maximum of 45 minutes for a hard disk optimize (speed increase)..

During this time any websites on this site will not resolve.  The process should be quick but 45 minutes has been scheduled.

Current: Windows Mail Server Upgrade Resolvido
Prioridade - Alta Afectando Outro - Windows Hosting Mail Server

UPDATE: 11th Jan 01:55am

The upgrade is complete. all standard connections will now function.

UPDATE: 11th Jan 01:23

We are expecting the upgrade to be completed approx 02:30 GMT.  This post will be updated once we have completed.

 

UPDATE: 10TH JAN 23:10

The mailserver upgrade is going very well.  We expect this to be finished <6am GMT.

 

 

UPDATE: 9TH JAN 2010  18:45 GMT

As we begun the migration, we installed are usually R1soft backup application which has currupt the OS, this happened on the last migration also.  We have placed this on hold.  We are going to reimage the server.  Migration will be placed on hold for 24 hours and will begin 10th Jan (Sunday) at 18:30

 

Our Windows Server mail upgrade has been rescheduled to January 2010

Date: Sat 9th Jan 2010 Sunday 10th Jan 2010  Time: 18:30 (GMT)

The maintenance window is 12 hours however we expect this to be allot less.  During this time you will not be able to send or receive emails on your computer.  Any incoming emails will be stored on our secondary email server which will forward the emails to the primary mailserver once back online.

This only effects Helm and Dotnetpanel customers on our Shared & Reseller hosting platform.

Windows Smartermail Service Resolvido
Prioridade - Critica

Due to ongoing issues with smartermail and a service restart not fully resolving the problem, we have restarted the server. No incoming emails will be lost during this period, however you will not be able to send/recieve email from outlook (etc) or login to webmail.

ETA under 20 minutes.

Smartermail Issue Resolvido
Prioridade - Critica Afectando Sistema - Smartermail

Hello

We have found an issue within smartermail, we have restarted the service. No incoming emails will be lost during this period, however you will not be able to send/recieve email from outlook (etc) or login to webmail.

ETA under 15 minutes.

 

ISSUE Resolved 10:34am

MANCLINUX2 - outage Resolvido
Prioridade - Critica

Hello

We currently have a outage on MANCLINUX2, we are working on this to resolve the problem.

We expect a fix within 30 minutes.

 

 

11:42am this issue is now resolved.