My LiveDrive Data Nightmare

TLDR; If you are not backing up your data, do it now. If you back up your data but have not tested if you can recover it, do it now. If you are using LiveDrive to back up your data, you might not be as prepared as you think.

My Previous Data Life

For a very long time I have stored my data in an external drive. Why? Mostly because I do not want the main output from my employment to be locked in a single computer. Often it is very convenient to be able to access the data from another computer. Also, when there is a fire alarm, my drive is the only thing I take. I know that the cloud is a good alternative, but I like to have the data locally and there is something unsettling about trusting Google or Dropbox with your entire digital life and work.

Of course, external drives fail, so I have purchased a subscription to a service which backs up my data on-line, away from my physical location, for over 12 years now.

The Incident

One day I arrive home, set up my USB hard drive on my computer, and the drive does not start. Or rather, it tries to partially start, but fails in a sequence of odd ways.
No biggie… I should be able to recover all files. It is going to take quite a while (it’s close to 1TB), but I should be covered!

I am Prepared… or am I?

Well, after wiping off the sweat from my brow, and taking a glass of water, I set out to the unpleasant and boring (but necessary) task of recovering my data. The most urgent staff first in my computer’s fixed hard drive first, and then the rest on a new external drive that I have ordered. Everything should be in my LiveDrive, right?

Well, the first unpleasant surprise is that LiveDrive downloads my files really really really slow. A full day of data recovery does not even start to make a dent in the 0.8 GB of data (approx) that I had backed up. I’m in a good connection, but maybe it is that the data is stored in Europe (where I used to live), and has to go under the water to get to me. I try a few things to solve this, including a VPN, but it turns out that this is not the problem. The service is extremely slow seemingly because it goes file by file, and it checks the status of each file individually, blocking the download until one file has been done. The download is decent when the file is large, but when you have a folder full of small files (e.g., Thunderbird’s e-mail folders, it slows down to a crawl. Unfortunately, the livedrive interface only lets you select folders, or files, recursively, but in one folder at a time. Additionally, every time you select what to download and it finishes, you have to select again from the backup set starting at the root folder. This goes on for a few days, with much effort and desperation, since my whole research is in there. It is hard and really tedious work of clicking buttons and check marks, taking notes of what is backed up and what is not, what folders should be priority, and trying to avoid those folders with lots of small files. I’m able to recover about 30% of my files this way, but with much effort.

The second unpleasant surprise is that some (important) folders simply do not download. This problem seems to be independent of the issues mentioned above. After some back and forth with LiveDrive’s help desk I am explained that some of the data stored is corrupted and therefore not downloadable. Their technical team are working on it, and they will update me of the progress. After some back and forth with them reminding them regularly for about 3 months I simply desist. After a year and a half I’m still to hear from them.

Contact with LiveDrive’s help desk results in reasonable response times, but not typically very useful. Comments about the problems of the interface are put in feature requests for the (presumably distant) future, while comments about the slow down seem to simply be above the pay grade of the helpdesk staff. They are generally pleasant. After they recognize that some of the data is corrupted, they offer to refund me what I have paid them so far “as a courtesy”.

What I Have Learned

  • Not all backup companies are the same. LiveDrive might be OK if you are just backing up only photos or videos, but the moment that you have to backup a real computer folder, e.g., with folders containing program state, e-mail folders, bookmarks, software that you have built, et cetera, the system is not viable any more.
  • The interface seems adequate at the beginning, affording most of the actions that you might expect to need (e.g., to find a file in the folder tree and ask for it to be downloaded). However, the reality is that when it comes to actual work, there are small details that can make the difference between hours of tedious work and minutes. As they say, God is in the details.
  • Losing much of your data can be debilitating. It is not only your set up of things; it is that you cannot trust any more to find the things where you left them. As an academic, I rely a lot on my drive, which is my “prosthetic memory”, for a multitude of things (creating a new talk, reporting activities, applying for tenure…). Not knowing whether you are going to find what you thought you had is sometimes even worse that knowing that you do not have it at all. It forces you to do a lot of clicking, it makes you feel insecure about your memory, and it reminds you every time of those negative feelings and the feeling of helplessness of the whole process. I’m not prone to depression, but there are very few other things that have made me feel so s****y about my work.
  • Hardware drive recovery is expensive and very disappointing when what comes back is minimal.

How I feel about the whole thing

More than a year and a half after the incident, I still have not completely recovered. My skin still crawls when I think back about it, and sometimes thinking back is unavoidable. A silver lining: I have learned to let go of some data, and perhaps not being so reliant on storing things in drives (although I still like to have most of my stuff in my own drive).

I also think that LiveDrive giving back my payments is like an insurance company giving you back your premiums if your house goes on fire. I have no animosity against the people in the helpdesk who helped me. They are probably underpaid, and it feels like the rest of the company is just in “automatic pilot mode”, without really any interest in improving the service, but more in milking their existing infrastructure and software (which is clearly not fit for purpose).

What I Recommend

If your data is not backed up, please please please please, back it up somehow now. At least the most important stuff should not be difficult to put on dropbox, google drive, etc.

If your data is backed up in a service, set aside some time to give it a serious test. Consider the following questions: how long would you consider acceptable to recover your data? How much work would you want to do for what you are investing now?

One thought on “My LiveDrive Data Nightmare

  1. Hi Miguel,
    Just to share my own experience with Livedrive.
    I have been using Livedrive for almost 7 years now on around 30 sites so I am more than the usual everyday user, and my experience with this is hit and miss, but mostly hit, may be because we backup in a different way.
    Personally I never trust everything in one basket, so I always backup to a local drive first, either using Acronis or Easeus (free for home) into backup images in incremental mode, then I use LD to backup these to the Livedrive.
    The uploads always seem ok, but some machines are also set to backup local pictures/documents, and I found a lot of the time some files are stuck as if they are opened, which they are not, LD never had an answer for these so I left it as the main backups are in image files that contain everything.

    When come to downloading, for the past 3 to 4 years, I always hit problems where some of the files are not available, they will show in the listing, you can click on them to download but the file size are always zero, to recover them I have to raise a ticket, wait many days for them to investigate and eventually they will message back to say it is now ready, but this can take many days so if the recovery is urgent, you are screwed, so this is where the local backup comes in, this is your first safety zone, only if this failed you need to restore from LD.

    As for restore speed, if you are using a web browser to restore, the speed will always be slower, using the app to restore is the best method, to be honest, our restore is fine, we have three sites, Virgin 400/40 , G.Network 600/300 and a leased line 1Gbps/1Gbps and they all seem to perform well, sometime it will start with 5MBs (50Mbps) but then after a while it will jump to 15-30MBs, and if the low speed stuck for say more than 15 mins, the best way is to cancel the restore and start again, I have seen restore speed as high as 400 and upload as high as 500 so I don’t have any issues with speed.

    The only bad point I can think of after so many years is the restore, with files going missing, as in it is not available to download can be a killer, this is why we always using local image backup to feed to Livedrive as a secondary protection, and the slow response time is also not ideal.

    To give you some ideas of our backups, they are mostly server backup images, size can vary from 500GB to 8TB, split into 20GB chunks to pace the uploading.

    We managed a lot of business sites, so backups are crucial to us, have tried many but LD seem to be the best value and more stable than most, if you check Trustpilot on iDrive and some others, you will see how bad the others are, I tested iDrive once few years ago when they had a great offer, biggest mistake, after a few weeks, it deleted almost 80% of the server files that were on the backup list, but as we always have local image backups, other than shock of horror, we easily restored them from the previous day, looking at other reviews, it happened to other users too, and their speed is the lowest of the low ever for me, 200GB backup too a week to upload, with Onedrive (90mins), Livedrive (140mins), Googledrive (70mins).

    If your storage is below 1TB, Microsoft OneDrive is the best option, especially if you have family members who uses Office suite, a Family Plan for 6 users is about £70, as well as Word/Excel/Powerpoint/Outlook each, you also get 1TB storage per user, the speed is fantastic and never had a problem with it, but if your storage/backup is 1TB+ then you need to try other alternative, such as pCloud, Mega, but for me, Livedrive can be a bit of a pain sometime but 95% of the time it is fine, the best of whats left as we call it. I wouldn’t trust anything 100%, and for most business and critical sites, we take a minimum of 2 local backups + 1 LD cloud feed,

    I were going to write an article on Cloud backups last year but I just didn’t have the time to do so, may be later this year once I am done with a bunch of cloud computing migrations.

    Reply

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s