Please Recommend Affordable And Reliable Cloud Storage For 50 TB Of Data

Home » CentOS » Please Recommend Affordable And Reliable Cloud Storage For 50 TB Of Data
CentOS 25 Comments

Hi,

Could you recommend affordable and reliable cloud storage for 50 TB of data?

Here are some important factors to consider:

1. Personal/non-commercial use.
2. Must be affordable, since I am unemployed most of the time and have super low levels of income for the past 12 years since I graduated from the National University of Singapore in 2007.
3. Cloud storage provider must not be a fly-by-night company, that is, it will not suddenly close down the next day.

Please advise.

Thank you.

==

25 thoughts on - Please Recommend Affordable And Reliable Cloud Storage For 50 TB Of Data

  • Wow. A single disk for a PC (lowest size 1 TB) usually costs more than USD$50 in retail store. Capacity for a single drive is just now available at 6 TB and 8 TB capacities, so 50 TB would require storage array network (SAN) h/w at hosting provider (which isn’t cheap).

    That amount of storage ( 50 TB ) from an online provider probably isn’t available within your stated budget. Just the disk drives alone to hold 50 TB would cost more than USD$50.

  • Hi Merka,

    I understand. I probably wanted data “redundancy” in the Cloud only.

    Thank you.

    ==

  • Yes, I have the correct unit of measure.

    I think my Singapore M1 ISP Home Fiber 1 Gbps broadband connection is capable of downloading at the speed of 60 Mega Bytes per second or more.

    ==

  • The cheapest RAID-friendly drives we’re buying these days are about US $37/TB in low quantities.

    A big data warehouser will be getting a substantial price break on their drives, but even halving the payoff time, you’re still asking the cloud storage provider to accept a payoff time in the 18 year range. And that’s ignoring the cost of rack space, computers to run the drives, networking, bandwidth, staff, redundancy, drive turnover…

    There’s nothing magical about The Cloud that makes everything cheaper. They still have to buy the same components you and I do, then they have to pay someone to manage it all, someone else to house it all, etc.

    You’re *dreaming*.

  • So, you’re already 12x higher than his budget, and it’ll be going up 20% in early April.

    On top of that, there’s certainly a transfer rate limit. I couldn’t find a reliable source saying what that limit is, but I found a related limit for G Suite here:

    https://support.google.com/a/answer/1071518

    If that applies to Google Drive as well, it’ll take about 182 years to send 50 TB.

    I can say from personal experience that Google is a bit stingy about such things. They give G Suite basic users 30 GB of storage, but if you try to put tens of GB in it, you can only pull that all down a few times a month before that user’s account gets locked. That happened to us with one user that kept blowing up his laptop, requiring a rebuild, and thus a re-download of the entire IMAP archive he insisted on keeping in the cloud.

    If they’re doing that to us, 3 orders of magnitude down from the OP’s target value, I think he’ll have a bad time trying to put 50 TB into a single Google Drive account.

  • Sorry. I read $50/month… My bad.

    True.

    OP should check if their university already offers G Suite. Most colleges in US do, and they come with unlimited storage (with all the shortcomings you mentioned above).

    —
    Elliot

  • OP – Backblaze Personal. May be like $1/extra per month than your budget. Unlimited IO and backup storage assuming you only need redundancy.

    https://www.backblaze.com/cloud-backup.html

    Still going to take a while on initial upload. (Sounds almost AWS Snowball like is what you need but too costly).

    Regards,

    R. S. Tyler Schroder Redcoded.com Cyber Intellegence

  • Warren Young wrote:

    $38/tb? Google shopping shows me a 4TB WD Red at $110. A two-drive esata bay is under $100.

    Btw, for anything like this, DO NOT BUY consumer grade drives. Make *sure*
    they’re NAS-rated, like WD Red or Seagate Ironwolf.

    mark

  • 5400 RPM.

    Red Pros are $170 at NewEgg, and we’re using WD Golds at $199. That’s $50/TB, but the $37/TB mark is for higher capacity drives.

    Even if we take your numbers and halve them again to get miracle high-quantity pricing, the payoff time at the OP’s wished-for $1/TB/year is about 14 years, and we haven’t even added in ancillary costs like the enclosure, redundancy, power, cooling, networking, staff, drive replacement…

    …which won’t hold 50 TB of data.

    Even a 4-drive enclosure isn’t enough, since even with single redundancy, the largest drives are 15/16 TB, depending on the technology, so that only gets you 45 or 48 TB. And then you’ve got to work out how to use those SMR or MAMR drives efficiently.

    Stepping back to standard technology 10 TB drives requires 7 of them to get 50 TB with dual redundancy, so even with miracle pricing, you’re probably talking about something like $750 for the raw hardware, which gets paid back in ~15 years on the OP’s schedule, and then only if all 7 drives last 15 years!

    Tell ’im ’e’s *dreamin’!*.

  • would you really backup into a system, that has closed connectivity?
    I’d prefer connecting a way I want: e.g. SFTP, SSHFS, HTTPS, … and not it is given by closed software you don’t know …

  • For non-sensitive personal data sure, I’d consider it (I consider backblaze reputable enough). However for more sensitive data or other customization options, you’re really going to have to self-host and supply, like Nextcloud running on a home NAS/SAN.

    It’s a personal call on what you are comfortable with. OP asked for a solution, and is by no means required to use it.

    Regards,

    R. S. Tyler Schroder

    —–Original Message—

  • Gigabit ethernet is capable of transfering 100 MBytes in a seond or 6
    GBytes in a minute or less than 3 hours the whole TByte but transfering this via an internet link would be a challenge;

  • Evening, Ladies and Gentlemen,

    it is Mr. Turritopsis Dohrnii Teo En Ming striking again.

    May I remind you his most successful questions were:

    — [CentOS] Which is better? Microsoft Exchange 2016 or Linux-based SMTP
    Servers?
    (discussion following with some 50 replies)

    — [CentOS] What are the differences between systemd and non-systemd Linux distros?
    (discussion with 52 replies)

    so may be we can just stop it now…

    Michael

    best regards
    —
    Michael Schumacher PAMAS Partikelmess- und Analysesysteme GmbH
    Dieselstr.10, D-71277 Rutesheim Tel +49-7152-99630
    Fax +49-7152-996333
    Gesch

  • Perhaps we’ll all be smiling at this in ten or twenty years, looking down at a handful of credit-card sized 100TB storage chips. Deja vu. Here’s hoping… :)

    Ben

    —

    Benjamin Hauger SysAdmin/CSDC-DMO
    Rm. 94
    x8371

  • the same thing was posted to the fedora user mailing list as well

    i wouldn’t be surprised if they were trolling considering what they’ve posted on here and other mailing lists.

  • I gave you a lengthy description of the Fedora lists. It’s rather rude to see your question here again.

    Met vriendelijke groet, Hans Witvliet, J, Ing., DMO/OPS/I&S/APH, Kennis Team Opensource Coldenhovelaan 1 Maasland 3531RC Coldehovelaan 1, kamer B213

    —–Original Message—