鍏充簬绔栫嚎鐨勯棶棰樼敤 string.split("\\|")瑙ｅ喅銆?/p>
鍏充簬鏄熷彿鐨勯棶棰樼敤 string.split("\\*")瑙ｅ喅銆?/p>
鍏充簬鏂滅嚎鐨勯棶棰樼敤 sring.split("\\\\")瑙ｅ喅銆?/p>
鍏充簬涓嫭鍙風(fēng)殑闂鐢?sring.split("\\[\\]")瑙ｅ喅銆?br />
]]>
public class FirstSparkSql {
public static void main(String[] args) {
String masterMode = "local";//spark://master:7077
SparkConf conf = new SparkConf();
//conf.set("spark.executor.memory", "1024m");
conf.setAppName("First Spark SQL");
conf.setMaster(masterMode);
//瑙ｅ喅寮傚父錛?/span>IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI
conf.set("spark.sql.warehouse.dir","D:\\temp_files");
JavaSparkContext sc = new JavaSparkContext(conf);
SparkSession spark = SparkSession.builder().config(conf).getOrCreate();
Dataset<Row> df = spark.read().json("hdfs://master:9000/user/spark/input/persons.txt");
df.show();
sc.stop();
}
}
]]>
Intellij鎺у埗鍙拌緭鍑?guó)櫗﹀憡锛?xì)WARN TaskSchedulerImpl: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources
姝ゆ椂紼嬪簭浼?xì)涓鐩磍oading錛宺unning錛宭oading錛宺unning…鐨勫驚鐜紝騫舵寔緇嚭鐜頒笂闈㈢殑璀﹀憡銆?nbsp;
鍑虹幇榪欎釜閿欒鍙兘鏈夊嚑縐嶅師鍥狅細(xì)
- host閰嶇疆涓嶆紜?/li>
- worker鍐呭瓨涓嶈凍
- 鐩稿叧绔彛鍙瘋鍗犵敤
閽堝絎簩縐嶅師鍥狅紝閫氳繃淇敼閰嶇疆鏂囦歡涓瓀orker鍜宮aster浣跨敤鍐呭瓨璧勬簮鐨勫弬鏁板嵆鍙В鍐熾?nbsp;
閽堝絎笁縐嶅師鍥狅紝鍙互鏌ョ湅鍗犵敤绔彛鐨勭▼搴忓茍灝嗗叾鍏抽棴錛屾垨鑰呴噸鍚痵park闆嗙兢銆?/p>
瑙ｅ喅鏂規(guī)硶錛?nbsp;
1. 淇敼鏈満hosts鏂囦歡錛屽湪淇敼絎竴琛岋紝娣誨姞鑷繁鐨刪ostName錛屽錛?br />
127.0.0.1 bob-PC
2.鍦╯park闆嗙兢鐨勬墍鏈夎妭鐐圭殑hosts涓坊鍔犳湰鍦版彁浜や換鍔＄殑windows鑺傜偣鐨刬p鍜宧ostname錛屽錛?br />
192.168.189.19 bob-PC
]]>