Can we store many small files in a cluster on HDFS if yes then what happen?
Well when we say about storing multiple small files, when we do this on HDFS it will generates a lot of metadata files as we are storing many files. And to store these metadata in RAM will create a challenge as each file, block or directory takes around 150 bytes for metadata. So multiple files storing will increase the cumulative size and metadata will be too large also. | |