Hi! Does anyone have experience with pyspark? I have this code: https://pastebin.com/29fkGL5w and I am trying to count how many articles in my RDD contain the name of the language. (For the sake of simplicity we check that at least one word (delimited by spaces) of the article text is equal to the given language.)
So far I have the code in the link, but when I run it, it simply returns a 0 for each item. When it should be returning much higher numbers. I feel like my occurancesOfLang method is probably doing something wrong, but I'm not sure what.