用beeline连接SparkSQL

2022-05-07 12:57:55 浏览数 (1)

1. 在$SPARK_HOME/conf/hive-site.xml文件中添加下面的属性

代码语言:javascript复制

 vi $SPARK_HOME/conf/hive-site.xml 
 <configuration>  
     <property> 
         <name>hive.metastore.uris</name> 
         <value>thrift://master:9083</value> 
         <description>Thrift URI for the remote metastore. Used by metastore client to connect to remote metastore.</description> 
     </property> 
 
     <property> 
         <name>hive.server2.thrift.bind.host</name> 
         <value>192.168.56.101</value> 
             <description>Bind host on which to run the HiveServer2 Thrift service.</description> 
     </property> 
     <property> 
         <name>hive.server2.thrift.port</name> 
         <value>10001</value> 
         <description>Port number of HiveServer2 Thrift interface when hive.server2.transport.mode is 'binary'.</description> 
     </property> 
     <property> 
         <name>hive.server2.thrift.min.worker.threads</name> 
         <value>5</value> 
         <description>Minimum number of Thrift worker threads</description> 
     </property> 
     <property> 
         <name>hive.server2.thrift.max.worker.threads</name> 
         <value>500</value> 
         <description>Maximum number of Thrift worker threads</description> 
     </property> 
  
 <property>   
 <name>hive.server2.enable.doAs</name> 
 <value>false</value> 
 </property> 
 </configuration> 

2. 复制mysql JDBC驱动文件到$SPARK_HOME/lib/ cp mysql-connector-java-5.1.31-bin.jar $SPARK_HOME/lib/ 3. 启动hive元数据存储服务 hive --service metastore > /tmp/grid/hive_metastore.log 2>&1 & 4. 启动spark thriftserver服务 $SPARK_HOME/sbin/start-thriftserver.sh --master spark://192.168.56.101:7077 --executor-memory 30g 5. 登入beeline $SPARK_HOME/bin/beeline -u jdbc:hive2://192.168.56.101:10001/ 参考: https://spark.apache.org/docs/1.5.0/sql-programming-guide.html

http://www.tuicool.com/articles/7BbiArR

http://blog.zhaishidan.cn/2015/05/15/jie-jue-beelinelian-jie-hiveserver2zhi-xing-sqlbao-cuo-de-wen-ti/

0 人点赞