SDO 007 - The Hidden Traps of SQL - Niko Korvenlaita
scalingdataops.substack.com
What are your thoughts on SQL? For my first data science role, I worked with massive datasets that required me to use PySpark to analyze the data. I was so excited to finally do “real” coding for my job… yet there was a problem. While I was using Spark, all of my colleagues were working twice as fast using SQL on the same data. This experience drilled into me the importance of SQL for my data career, and I quickly shifted over to doing many of my analyses with SQL over Spark.
SDO 007 - The Hidden Traps of SQL - Niko Korvenlaita
SDO 007 - The Hidden Traps of SQL - Niko…
SDO 007 - The Hidden Traps of SQL - Niko Korvenlaita
What are your thoughts on SQL? For my first data science role, I worked with massive datasets that required me to use PySpark to analyze the data. I was so excited to finally do “real” coding for my job… yet there was a problem. While I was using Spark, all of my colleagues were working twice as fast using SQL on the same data. This experience drilled into me the importance of SQL for my data career, and I quickly shifted over to doing many of my analyses with SQL over Spark.