« first day (916 days earlier)      last day (2450 days later) » 

user8451312
7:09 PM
I reduced max features to 10, and n_estimators to 2, and this code still never finishes executing. I can't find whats wrong. Indentation changed when i pasted code here, sorry.

#define tokenizer
def custom_tokenizer(text):
#split- space
tokens = ' '.join(post_text).split()
tokens = [token for token in tokens if len(token)>=3]
# stem tokens
for i, token in enumerate(tokens):
for key, val in d.items():
if re.match(key, token):
tokens[i] = val
break

return tokens

cv=CountVectorizer(tokenizer= custom_tokenizer,analyzer ='word',encoding='utf-8',\
 
1 message moved from Python
 

« first day (916 days earlier)      last day (2450 days later) »