Subscribe Now

* You will receive the latest news and updates on your favorite celebrities!

Trending News

08 Jul 2020
BigData, Hadoop, hdfs, hive, namenode

Hadoop HDFS maximum number of files 

Just a short blog about HDFS directory file and memory limits. I’ve recently faced an issue with Hive with the following error message org.apache.hadoop.ipc.RemoteException: The directory item limit of /tmp/hive/hive is exceeded: limit=1048576 items=1048576 The parameter which caused the error above is called dfs.namenode.fs-limits.max-directory-items dfs.namenode.fs-limits.max-directory-items…