Hadoop 安装，错误：仅当允许安全管理器时才支持 getSubject

Question

我尝试在我的

macOS Ventura

上使用 install Hadoop，但多次失败。我也尝试下载较低版本的 hadoop，但到目前为止还没有成功。

尝试过 Hadoop 版本：

3.4.0

和

3.3.6

Java版本：java 23

我在运行时收到的错误消息

hdfs namenode -format

是：

以状态 1 退出：java.lang.UnsupportedOperationException：仅当允许安全管理器时才支持 getSubject

类似，当我跑步后

start-all.sh

：

Starting namenodes
Starting namenodes on [Sumans-MacBook-Pro.local]
Starting datanodes
localhost: ERROR: Cannot set priority of datanode process 3556
2024-09-23 16:10:29,438 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Exception in thread "main" java.lang.UnsupportedOperationException: getSubject is supported only if a security manager is allowed
    at java.base/javax.security.auth.Subject.getSubject(Subject.java:347)
    at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:577)
    at org.apache.hadoop.hdfs.tools.GetConf.run(GetConf.java:344)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:82)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:97)
    at org.apache.hadoop.hdfs.tools.GetConf.main(GetConf.java:361)
Starting resourcemanagers on []
Starting nodemanagers
localhost: ERROR: Cannot set priority of nodemanager process 3966

我尝试的配置如下：

核心站点.xml

<configuration>
  <property>
      <name>hadoop.tmp.dir</name>
      <value>/Users/sumanbhattarai/hdfs/tmp/</value>
  </property>
  <property>
      <name>fs.default.name</name>
      <value>hdfs://127.0.0.1:9000</value>
  </property>
</configuration>

hdfs-site.xml

<configuration>
  <property>
      <name>dfs.data.dir</name>
      <value>/Users/sumanbhattarai/hdfs/namenode</value>
  </property>
  <property>
      <name>dfs.data.dir</name>
      <value>/Users/sumanbhattarai/hdfs/datanode</value>
  </property>
  <property>
      <name>dfs.replication</name>
      <value>1</value>
  </property>
</configuration>

mapred-site.xml

<configuration> 
  <property> 
    <name>mapreduce.framework.name</name> 
    <value>yarn</value> 
  </property> 
</configuration>

纱线站点.xml

<configuration>
  <property>
    <name>yarn.nodemanager.aux-services</name>
    <value>mapreduce_shuffle</value>
  </property>
  <property>
    <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
    <value>org.apache.hadoop.mapred.ShuffleHandler</value>
  </property>
  <property>
    <name>yarn.resourcemanager.hostname</name>
    <value>127.0.0.1</value>
  </property>
  <property>
    <name>yarn.acl.enable</name>
    <value>0</value>
  </property>
  <property>
    <name>yarn.nodemanager.env-whitelist</name>   
    <value>JAVA_HOME,HADOOP_COMMON_HOME,HADOOP_HDFS_HOME,HADOOP_CONF_DIR,CLASSPATH_PERPEND_DISTCACHE,HADOOP_YARN_HOME,HADOOP_MAPRED_HOME</value>
  </property>
</configuration>

Answer 1

Java 23 引入了 SecurityManager 检查

https://docs.oracle.com/en/java/javase/23/security/migration-deprecated-removal-methods-subject-getsubject-and-subject-doas-subject-current-and-subje.html

Hadoop不支持Java 11以上版本。请降级并重试，确保配置其他先决条件。