{"id":1483,"date":"2013-03-27T09:50:59","date_gmt":"2013-03-27T13:50:59","guid":{"rendered":"http:\/\/blog.nccomputertech.com\/?p=1483"},"modified":"2013-03-27T09:50:59","modified_gmt":"2013-03-27T13:50:59","slug":"what-is-false-disk-failure-and-why-is-it-a-problem","status":"publish","type":"post","link":"https:\/\/nccomputertech.com\/techtalk\/2013\/03\/27\/what-is-false-disk-failure-and-why-is-it-a-problem\/","title":{"rendered":"What is false disk failure, and why is it a problem?"},"content":{"rendered":"

I\u2019ve spent a lot of time with mega datacenters (MDCs) around the world trying to understand their problems \u2013 and I really don\u2019t care what area those problems are as long as they\u2019re important to the datacenter. What is the #1 Real Problem for many large scale mega datacenters? It\u2019s something you\u2019ve probably never heard about, and probably have not even thought about. It\u2019s called false disk failure. Some mega datacenters have crafted their own solutions \u2013 but most have not.
\nWhy is this important, you ask? Many large datacenters today have 1 million to 4 million hard disk drives (HDDs) in active operation. In anyone\u2019s book that\u2019s a lot. It\u2019s also a very interesting statistical sample size of HDDs. MDCs get great pricing on HDDs. Probably better than OEMs get, and certainly better than the $79 for buying 1 HDD at your local Fry\u2019s store. So you would imagine if a disk fails \u2013 no one cares \u2013 they\u2019re cheap and easy to replace. But the burden of a failed disk is much more than the raw cost of the disk:
\nDisk rebuild and\/or data replicate of 2TB or 3TB drive
\nPerformance overhead of a RAID rebuild makes it difficult to justify, and can take days
\nDisk capacity must be added somewhere to compensate: ~$40-$50
\nRedistribute replicated data across many servers
\nInfrastructure overhead to rebalance workloads to other distributed servers
\nPerson to service disk: remove and replace
\nAnd then ensure the HDD data cannot be accessed \u2013 wipe it or shred it
\nLet\u2019s put some scale to this problem, and you\u2019ll begin to understand the issue. One modest size MDC has been very generous in sharing its real numbers. (When I say modest, they are ~1\/4 to 1\/2 the size of many other MDCs, but they are still huge \u2013 more than 200k servers). Other MDCs I have checked with say \u2013 yep, that\u2019s about right. And one engineer I know at an HDD manufacturer said \u2013 \u201cwow \u2013 I expected worse than that. That\u2019s pretty good.\u201d To be clear \u2013 these are very good HDDs they are using, it\u2019s just that the numbers add up.<\/p>\n

\"\"<\/a><\/p>\n

Full Story: What is false disk failure, and why is it a problem? – TechSpot<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"

I\u2019ve spent a lot of time with mega datacenters (MDCs) around the world trying to understand their problems \u2013 and […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","ast-disable-related-posts":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[3,10],"tags":[201,352,458,471,1042],"class_list":["post-1483","post","type-post","status-publish","format-standard","hentry","category-hardware","category-technology","tag-cloud","tag-fail","tag-hard-drive","tag-hdd","tag-storage"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/papNkV-nV","jetpack-related-posts":[{"id":8278,"url":"https:\/\/nccomputertech.com\/techtalk\/2015\/05\/13\/venom-vulnerability-more-dangerous-than-heartbleed-targets-most-virtual-machines\/","url_meta":{"origin":1483,"position":0},"title":"Venom vulnerability more dangerous than Heartbleed, targets most virtual machines","author":"NCCT","date":"May 13, 2015","format":false,"excerpt":"Researchers have uncovered a new bug that\u2019s much more dangerous than last year\u2019s Heartbleed vulnerability. Venom, short for Virtualized Environment Neglected Operations Manipulation, could allow an attacker to infiltrate a datacenter and take over its entire network. As ZDNet notes, most datacenters use virtual machines to segregate customers, allowing the\u2026","rel":"","context":"In "Security"","block_context":{"text":"Security","link":"https:\/\/nccomputertech.com\/techtalk\/category\/security\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.techspot.com\/images2\/news\/bigimage\/2015-05-13-image-3.jpg?resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.techspot.com\/images2\/news\/bigimage\/2015-05-13-image-3.jpg?resize=350%2C200 1x, https:\/\/i0.wp.com\/www.techspot.com\/images2\/news\/bigimage\/2015-05-13-image-3.jpg?resize=525%2C300 1.5x"},"classes":[]},{"id":6943,"url":"https:\/\/nccomputertech.com\/techtalk\/2014\/11\/21\/intel-to-launch-ssds-using-3d-nand-technology-in-2015\/","url_meta":{"origin":1483,"position":1},"title":"Intel to launch SSDs using 3D NAND technology in 2015","author":"NCCT","date":"November 21, 2014","format":false,"excerpt":"Intel has announced intentions to launch solid state drives based on its 3D NAND technology sometime during the second half of next year. Developed in cooperation with flash memory specialist Micron, the tech stacks 32 planar layers which delivers 256Gb (32GB) of storage in a single MLC die. Pushing it\u2026","rel":"","context":"In "Hardware"","block_context":{"text":"Hardware","link":"https:\/\/nccomputertech.com\/techtalk\/category\/hardware\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":5625,"url":"https:\/\/nccomputertech.com\/techtalk\/2014\/05\/29\/truecrypt-is-not-secure-official-sourceforge-page-abruptly-warns\/","url_meta":{"origin":1483,"position":2},"title":"\u201cTrueCrypt is not secure,\u201d official SourceForge page abruptly warns","author":"NCCT","date":"May 29, 2014","format":false,"excerpt":"One of the official webpages for the widely used TrueCrypt encryption program says that development has abruptly ended and warns users of the decade-old tool that it isn't safe to use. \"WARNING: Using TrueCrypt is not secure as it may contain unfixed security issues,\" text in red at the top\u2026","rel":"","context":"In "Security"","block_context":{"text":"Security","link":"https:\/\/nccomputertech.com\/techtalk\/category\/security\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":5613,"url":"https:\/\/nccomputertech.com\/techtalk\/2014\/05\/23\/behind-the-curtain-how-netflix-streams-movies-to-your-tv\/","url_meta":{"origin":1483,"position":3},"title":"Behind the curtain: How Netflix streams movies to your TV","author":"NCCT","date":"May 23, 2014","format":false,"excerpt":"At peak times, Netflix accounts for around a third of the consumer Internet traffic in North America. This week, one of its senior engineers described how it gets all those movies to your screen. The company operates its own content delivery network (CDN), a global network of storage servers that\u2026","rel":"","context":"In "Networking"","block_context":{"text":"Networking","link":"https:\/\/nccomputertech.com\/techtalk\/category\/networking\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":7608,"url":"https:\/\/nccomputertech.com\/techtalk\/2015\/02\/12\/virustotal-tackles-the-tricky-false-positives-problem-plaguing-antivirus-software\/","url_meta":{"origin":1483,"position":4},"title":"VirusTotal tackles the tricky false positives problem plaguing antivirus software","author":"NCCT","date":"February 12, 2015","format":false,"excerpt":"VirusTotal, a Google-owned online malware scanning service, is creating a whitelist of products from large software vendors to reduce bad detections by antivirus programs. False positive detections are common in the antivirus industry. They occur when a benign program is wrongfully flagged as malicious due to an overly broad detection\u2026","rel":"","context":"In "Security"","block_context":{"text":"Security","link":"https:\/\/nccomputertech.com\/techtalk\/category\/security\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":5902,"url":"https:\/\/nccomputertech.com\/techtalk\/2014\/07\/09\/so-long-truecrypt-5-alternative-encryption-tools-that-can-lock-down-your-data\/","url_meta":{"origin":1483,"position":5},"title":"So long, TrueCrypt: 5 alternative encryption tools that can lock down your data","author":"NCCT","date":"July 9, 2014","format":false,"excerpt":"Open-source legend TrueCrypt may be gone, but the usefulness of full disk encryption carries on. So what's a crypto fan to do now for their encryption needs? Well, you could continue to use older versions of TrueCrypt if you already have it installed. While the security community was shocked earlier\u2026","rel":"","context":"In "Security"","block_context":{"text":"Security","link":"https:\/\/nccomputertech.com\/techtalk\/category\/security\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"https:\/\/nccomputertech.com\/techtalk\/wp-json\/wp\/v2\/posts\/1483","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/nccomputertech.com\/techtalk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/nccomputertech.com\/techtalk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/nccomputertech.com\/techtalk\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/nccomputertech.com\/techtalk\/wp-json\/wp\/v2\/comments?post=1483"}],"version-history":[{"count":0,"href":"https:\/\/nccomputertech.com\/techtalk\/wp-json\/wp\/v2\/posts\/1483\/revisions"}],"wp:attachment":[{"href":"https:\/\/nccomputertech.com\/techtalk\/wp-json\/wp\/v2\/media?parent=1483"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/nccomputertech.com\/techtalk\/wp-json\/wp\/v2\/categories?post=1483"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/nccomputertech.com\/techtalk\/wp-json\/wp\/v2\/tags?post=1483"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}