CyberAbc 290 Report post Posted January 31, 2014 Inside Facebook's Blu-ray storage rack. Facebook's hardware guru thinks Blu-ray discs might have a brighter future in the data center than in consumers' homes. We wrote on Wednesday about how Facebook has developed a prototype storage system that uses 10,000 Blu-ray discs to hold a petabyte of data. After that story posted we were able to talk to Frank Frankovsky, VP of hardware design and supply chain operations at Facebook, to find out just why he's so excited about the project. While the Blu-ray storage system is just a prototype, Facebook hopes to get it in production sometime this year and share the design with the Open Compute Project community to spur adoption elsewhere. If Facebook and others start using Blu-ray discs for long-term archival storage, Blu-ray manufacturers will see a new market opportunity and pursue it, Frankovsky said. "I think that the media suppliers, especially after all of the community excitement around it with Open Compute, they see a huge opportunity here," Frankovsky said. "Economies of scale could take over really quickly, and they could start producing those discs for the Open Compute community at much lower cost than they do today because, believe it or not, this is one of those areas where really high-capacity Blu-ray discs are in relatively low demand on the consumer side and in relatively high demand on the data center side." Facebook VP Jay Parikh discusses cold storage and Blu-rays. Facebook intends to use Blu-rays for "cold storage," data that can't be thrown out but may not be accessed for many years, if at all. The best near-term use case is backups of photos and videos, but the discs could also be used for any data that Facebook is required by law to retain for a certain number of years. Facebook's cold storage today is entirely on spinning disks. The prototype Blu-ray system is estimated to be 50 percent cheaper than the disk-based cold storage, and 80 percent more energy efficient. The discs are housed in a fancy rack that holds 24 magazines, with each magazine holding 36 cartridges, and each cartridge holding 12 Blu-ray discs, for a total of 10,368. A robot lives and works inside the rack. "We have a robotic picker that will go to a specified magazine and then locate a cartridge, it will unlock that cartridge, removing the drawer, and a picker will go down and is able to select a specified disc in that 12-disc arrangement," Facebook's Giovanni Coglitore said in a video demo posted yesterday. When the robot isn't working, the rack consumes virtually no power, he said. "Each disc is certified for 50 years of operation; you can actually get some discs that are certified for 1,000 years of reliability," Coglitore said. "Because the media is separate from the drives, if you ever have a drive issue, you simply replace the drive, and you won't have to replace the data within a disc. From a reliability and operational standpoint it's quite elegant and efficient." Facebook is careful in how it's rolling out the optical storage system to production. As Facebook does with other new technologies, "we'll start it out in what we call shadow testing," Frankovsky said. "Until it's proven, we'll take relatively small quantities, and we'll just mirror data from what's in production and shadow that data to the optical rack." While Blu-ray can't match the performance of hard disk drives, that isn't as important for cold storage. Frankovsky also said the Blu-ray system will be "far superior to tape" because of its durability and performance. It could also provide benefits in recovery from failure. Frankovsky said Facebook uses erasure encoding, which "distributes a file across multiple physical devices so that in any event of a failure of a physical device you can always recreate the file." With disk drives, "you need to have a relatively aggressive erasure encoding environment where you have a lot more physical spinning disks, so you can sustain multiple failures and be able to recreate the file in any situation," Frankovsky said. Because the predictive annual failure rate for optical discs is lower, "it's quite possible that you won't need to over-provision how much optical capacity you have to be able to get the same level of protection with the complete file rebuild. There's kind of a double goodness there. Bit for bit, it's lower cost, and if we can over-provision less with optical, you can move that needle even further on the cost-saving side." Separately, Facebook has also considered the use of substandard flash memory for cold storage. The idea is to take "partially good NAND flash which otherwise would have been sold off as thumb drives or potentially even scrap," Frankovsky said. Flash storage is often thrown out by manufacturers when just a few cells have gone bad, he said. With smart enough software algorithms, "you can be cognizant of where the weak or bad cells are and write around those cells." The bad flash initiative isn't as far along as the Blu-ray project. But both have progressed pretty quickly since Facebook revealed their existence last year, Frankovsky said. They could end up being important tools as data storage needs grow. IDC predicts that by 2020 the entire "digital universe" will grow to 40,000 exabytes, or 40 trillion gigabytes. "A large portion of that is going to be warm to cold data, and we need something better than tape and disk to store it," Frankovsky said. 1 Share this post Link to post Share on other sites
Extreme100 14 Report post Posted January 31, 2014 thnx for sharing facebook is large so nothing new...... wat abt google?? Share this post Link to post Share on other sites
CyberAbc 290 Report post Posted February 1, 2014 google is out of reach............. 1 Share this post Link to post Share on other sites
