Jan 15, 2021
4 min read
PySpark — Read CSV file into Dataframe
As we know that PySpark is a Python API for Apache Spark where as Apache Spark is an Analytical Processing Engine for large scale powerful distributed data processing and machine learning applications.
If you want to process a large dataset which is saved as a csv file and would like to read CSV file into spark dataframe, drop some columns, and add new columns. So, we are doing this operation…
