Global AI and Data Science

Global AI & Data Science

Train, tune and distribute models with generative AI and machine learning capabilities

 View Only
Back to discussions
Expand all | Collapse all

the location of chunks aren't stored in non-volatile memory of GFS, how much time would it take for master to receive heartbeat messages and build the chunk locations table?

  • 1.  the location of chunks aren't stored in non-volatile memory of GFS, how much time would it take for master to receive heartbeat messages and build the chunk locations table?

    Posted Sat July 23, 2022 02:01 AM

    Since in GFS, we assume hardware fails a lot. Assume the master fails 10K times in 24 hrs. How much time would be wasted in receiving chunk location data?

    ------------------------------
    Prabhat Pandey
    ------------------------------



    #DataandAILearning
    #AIandDSSkills
    #AIandDSSkills