EDIT:忘记了这必须在Panda 中完成
我在将某个文件读取到pandas数据帧中时遇到了一个小问题。我试过:
import pandas as pd
import matplotlib.pyplot as plt
dataframe = pd.read_csv('/home/leon/Desktop/Uni/ML Lab/Text.txt',
delim_whitespace=True, header=None)
print(dataframe)
如果我用包含"你好,这是一个测试"之类内容的.txt进行尝试,它运行良好,但在尝试实际的readme.md时,我会收到错误信息:
---------------------------------------------------------------------------
ParserError Traceback (most recent call last)
<ipython-input-47-231496e21612> in <module>()
2 import matplotlib.pyplot as plt
3
----> 4 dataframe = pd.read_csv('/home/leon/Desktop/Uni/ML Lab/Text.txt', delim_whitespace=True, header=None)
5 print(dataframe)
~/anaconda3/lib/python3.7/site-packages/pandas/io/parsers.py in parser_f(filepath_or_buffer, sep, delimiter, header, names, index_col, usecols, squeeze, prefix, mangle_dupe_cols, dtype, engine, converters, true_values, false_values, skipinitialspace, skiprows, nrows, na_values, keep_default_na, na_filter, verbose, skip_blank_lines, parse_dates, infer_datetime_format, keep_date_col, date_parser, dayfirst, iterator, chunksize, compression, thousands, decimal, lineterminator, quotechar, quoting, escapechar, comment, encoding, dialect, tupleize_cols, error_bad_lines, warn_bad_lines, skipfooter, doublequote, delim_whitespace, low_memory, memory_map, float_precision)
676 skip_blank_lines=skip_blank_lines)
677
--> 678 return _read(filepath_or_buffer, kwds)
679
680 parser_f.__name__ = name
~/anaconda3/lib/python3.7/site-packages/pandas/io/parsers.py in _read(filepath_or_buffer, kwds)
444
445 try:
--> 446 data = parser.read(nrows)
447 finally:
448 parser.close()
~/anaconda3/lib/python3.7/site-packages/pandas/io/parsers.py in read(self, nrows)
1034 raise ValueError('skipfooter not supported for iteration')
1035
-> 1036 ret = self._engine.read(nrows)
1037
1038 # May alter columns / col_dict
~/anaconda3/lib/python3.7/site-packages/pandas/io/parsers.py in read(self, nrows)
1846 def read(self, nrows=None):
1847 try:
-> 1848 data = self._reader.read(nrows)
1849 except StopIteration:
1850 if self._first_chunk:
pandas/_libs/parsers.pyx in pandas._libs.parsers.TextReader.read()
pandas/_libs/parsers.pyx in pandas._libs.parsers.TextReader._read_low_memory()
pandas/_libs/parsers.pyx in pandas._libs.parsers.TextReader._read_rows()
pandas/_libs/parsers.pyx in pandas._libs.parsers.TextReader._tokenize_rows()
pandas/_libs/parsers.pyx in pandas._libs.parsers.raise_parser_error()
ParserError: Error tokenizing data. C error: Expected 5 fields in line 3, saw 10
我把它读到一个数据帧中,这样我就可以计算出唯一单词的数量和单词的出现次数。对于这个初学者的问题我很抱歉,但我刚开始使用Python!问候。
pandas
数据帧不适合此任务。您应该只加载文件,按行拆分,然后从中聚合计数。您可以通过读取文件、按行拆分,然后展平结果列表来实现这一点。最后,您可以使用Counter
和collections
进行聚合。
from collections import Counter
with open("README.md") as f:
file_split = [line.split() for line in f]
file_split_flatten = [val for sublist in file_split for val in sublist]
count_dict = dict(zip(Counter(file_split_flatten).keys(), Counter(file_split_flatten).values()))
然后访问计数只需执行:
print(count_dict['Tensorflow'])
看看这是否有帮助:
>>> import pandas as pd
>>> dataframe = pd.read_table('README.md.1', skip_blank_lines=True)
>>> dataframe = dataframe.rename(columns={'# Tensorflow Object Detection API':'Tensorflow'}
>>> dataframe.head()
Tensorflow
0 Creating accurate machine learning models capa...
1 multiple objects in a single image remains a c...
2 The TensorFlow Object Detection API is an open...
3 TensorFlow that makes it easy to construct, tr...
4 models. At Google we’ve certainly found this ...