使用 Scala 和 Spark 应用"like"多个字符串(Seq 或 Array 等)的运算符。在数据帧上

Question

val df = sc.parallelize(Seq(("Apple"),("Banana"),("Graphes"),("Pineapple"))).toDF("col1")
val s = Seq("Ban%","Grap%")

输出应如下所示

col1
香蕉
图形

val df = sc.parallelize(Seq(("Apple"),("Banana"),("Graphes"),("Pineapple"))).toDF("col1")
val s = Seq("Ban%","Grap%")
val likeString = s.map(x=> s"""col1 like "$x" or""").mkString(" ")
df.filter(likeString.substring(0, likeString.length-2)).show

输出

col1
香蕉
图形