如何将原始 CSV 列连同 Bigram 计数和频率导出到新的 csv?

How to export original CSV columns, alongside Bigram count and frequency to new csv?

这是我第一次使用 Python 如果这是一个愚蠢的问题,我深表歉意。我有一个 3 列 CSV,第一列称为评论(这是我操纵成双字母组的列),第二列称为评论类型,第三列称为评论日期。我对这段代码的当前输出感到满意,我将第 1 列(注释)拆分为双字母组,计算频率,然后导出到 CSV 文件中。但现在我还想将我原来的 csv 中的评论类型和评论日期列(不对它们进行任何更改)添加到我导出的 CSV 中的单词和频率列旁边。我不确定该怎么做并测试了一些想法但没有奏效。

import csv
import string
import re
from nltk.util import everygrams
import pandas as pd


from collections import Counter

from itertools import combinations

df = pd.read_csv('modified.csv', 'r', encoding="utf8",
                 names=['comment'])
top_N = 1000
stopwords = nltk.corpus.stopwords.words('english')

RE_stopwords = r'\b(?:{})\b'.format('|'.join(stopwords))

txt = df.comment.str.lower().str.replace(r'\|', ' ').str.cat(sep=' ')

words = nltk.tokenize.word_tokenize(txt)
words = [w for w in words if not w in RE_stopwords]

bigrm = list(nltk.bigrams(words))



word_dist = nltk.FreqDist([' '.join(x) for x in bigrm])
rslt = pd.DataFrame(word_dist.most_common(top_N),
                columns=['Word', 'Frequency'])

print(rslt)
rslt.to_csv('bigram3.csv')

最后添加的行,在您的 rslt 数据框中创建一个新列,并将数据从您的原始数据框中复制到此数据框中。

import csv
import string
import re
from nltk.util import everygrams
import pandas as pd


from collections import Counter

from itertools import combinations

df = pd.read_csv('modified.csv', 'r', encoding="utf8",
                 names=['comment'])
top_N = 1000
stopwords = nltk.corpus.stopwords.words('english')

RE_stopwords = r'\b(?:{})\b'.format('|'.join(stopwords))

txt = df.comment.str.lower().str.replace(r'\|', ' ').str.cat(sep=' ')

words = nltk.tokenize.word_tokenize(txt)
words = [w for w in words if not w in RE_stopwords]

bigrm = list(nltk.bigrams(words))



word_dist = nltk.FreqDist([' '.join(x) for x in bigrm])
rslt = pd.DataFrame(word_dist.most_common(top_N),
                columns=['Word', 'Frequency'])
rslt['Column_Type'] = df['comment type']
rslt['Column_Date'] = df['comment date']
print(rslt)
rslt.to_csv('bigram3.csv')