文献知网节
  • 记笔记
摘要:Hadoop Distributed File System(HDFS) is designed for reliable storage and management of very large file and low-cost storage capability.As HDFS architecture based on master(NameNode) to handle metadata for multiple slaves(DataNode),NameNode often becomes the bottleneck,especially when handing large number of small files.It is a common solution to merge many small files into one big file about this problem.To solve the large small files problem and improve the efficiency of accessing small files,in this paper,we define Logic File Name(LFN) and propose the Small file Merge Strategy Based LFN(SMSBL).SMSBL is a new idea and a new perspective on hierarchy,it improves the correlation of small files in the same block of HDFS effectively based different file system hierarchy,so the performance is amazing facing large small files when HDFS adopted SMSBL with prefetching mechanism.The system efficiency analysis model is established and experimental results demonstrate that SMSBL can solve small file problem in HDFS and has appreciable high hit rate of prefetching files.
会议名称:

2016 4th IEEE International Conference on Cloud Computing and Intelligence Systems(IEEE CCIS2016)

会议时间:

2016-08-17

会议地点:

中国北京

  • 专辑:

    信息科技

  • 专题:

    计算机硬件技术

  • 分类号:

    TP333

  • 手机阅读
    即刻使用手机阅读
    第一步

    扫描二维码下载

    "移动知网-全球学术快报"客户端

    第二步

    打开“全球学术快报”

    点击首页左上角的扫描图标

    第三步

    扫描二维码

    手机同步阅读本篇文献

  • CAJ下载
  • PDF下载

下载手机APP用APP扫此码同步阅读该篇文章

下载:13 页码:354-358 页数:5 大小:390k

相关推荐
  • 相似文献
  • 读者推荐
  • 相关基金文献
  • 关联作者
  • 相关视频