As part of setting up development environment for Python and Spark, we need to set up
- IDE such as Pycharm
- Setting up of WinUtils
- Integration of Pycharm and Spark
For newbies, it is a bit challenging to set up the development environment with out issues on Windows. Here is the playlist, which we have created based up on our experience addressing all the challenges.