13:53
There is a problem in the reasoning of the datediff
datediff in pyspark returns different in days between two days
if we have for example a currency for a date: 2011-05-24, two currencies dates: 2011-06-01 and 2011-05-01, the datediff will pickup the date with few days to 2011-05-24, which is 2011-06-01
and this is wrong because the currency we are looking for this example is the one with 2011-05-01