数据湖探索 DLI-pyspark样例代码:操作前准备

时间:2024-06-20 11:23:10

操作前准备

  1. import相关依赖包
    1
    2
    3
    from __future__ import print_function
    from pyspark.sql.types import StructType, StructField, IntegerType, StringType
    from pyspark.sql import SparkSession
    
  2. 创建会话
    1
    sparkSession = SparkSession.builder.appName("datasource-dws").getOrCreate()
    
support.huaweicloud.com/devg-dli/dli_09_0087.html