是否可以在不删除 NaN 值的情况下修复'ValueError: cannot convert float NaN to integer'错误?



所以我的问题在于准备一个数据帧,用于使用熊猫和seaborn创建热图。我的问题是,在将所有对象转换为整数时,是否要将 NaN 值保留为 NaN,以便我可以像 sns.heatmap(df, mask = df.isnull()) 一样绘制它

到目前为止,我正在做的是将数据输入到我创建的新数据帧中,该数据帧在创建时如下所示 (https://i.stack.imgur.com/hS4xX.jpg)。

从那里,我使用如下所示的代码将值插入到新的数据帧中:

start = 16
end = start + 10
dates = range(start,end)
for d in dates:
str(d)
for i, row in jfk10day.iterrows():
row[f'Apr/{d}/2019'] = jfk[jfk['Pick-up Date'] == f'Apr/{d}/2019'][jfk['Supplier']==i][jfk['Car Type'] == 'Compact']['Total Price'].min()

将数据作为类型对象输入到数据帧中。此已完成的数据帧看起来像 https://i.stack.imgur.com/oQXen.jpg。

现在从这里我知道我需要将数据类型更改为 int/float 才能使用 sns.heatmap() 绘制它,但是当我尝试类似的东西时:

jfk10day = jfk10day.astype(int)

我收到错误:

---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
<ipython-input-76-45dab2567d52> in <module>
----> 1 jfk10day.astype(int)
/anaconda3/lib/python3.7/site-packages/pandas/util/_decorators.py in wrapper(*args, **kwargs)
176                 else:
177                     kwargs[new_arg_name] = new_arg_value
--> 178             return func(*args, **kwargs)
179         return wrapper
180     return _deprecate_kwarg
/anaconda3/lib/python3.7/site-packages/pandas/core/generic.py in astype(self, dtype, copy, errors, **kwargs)
4999             # else, only a single dtype is given
5000             new_data = self._data.astype(dtype=dtype, copy=copy, errors=errors,
-> 5001                                          **kwargs)
5002             return self._constructor(new_data).__finalize__(self)
5003 
/anaconda3/lib/python3.7/site-packages/pandas/core/internals.py in astype(self, dtype, **kwargs)
3712 
3713     def astype(self, dtype, **kwargs):
-> 3714         return self.apply('astype', dtype=dtype, **kwargs)
3715 
3716     def convert(self, **kwargs):
/anaconda3/lib/python3.7/site-packages/pandas/core/internals.py in apply(self, f, axes, filter, do_integrity_check, consolidate, **kwargs)
3579 
3580             kwargs['mgr'] = self
-> 3581             applied = getattr(b, f)(**kwargs)
3582             result_blocks = _extend_blocks(applied, result_blocks)
3583 
/anaconda3/lib/python3.7/site-packages/pandas/core/internals.py in astype(self, dtype, copy, errors, values, **kwargs)
573     def astype(self, dtype, copy=False, errors='raise', values=None, **kwargs):
574         return self._astype(dtype, copy=copy, errors=errors, values=values,
--> 575                             **kwargs)
576 
577     def _astype(self, dtype, copy=False, errors='raise', values=None,
/anaconda3/lib/python3.7/site-packages/pandas/core/internals.py in _astype(self, dtype, copy, errors, values, klass, mgr, **kwargs)
662 
663                 # _astype_nansafe works fine with 1-d only
--> 664                 values = astype_nansafe(values.ravel(), dtype, copy=True)
665                 values = values.reshape(self.shape)
666 
/anaconda3/lib/python3.7/site-packages/pandas/core/dtypes/cast.py in astype_nansafe(arr, dtype, copy)
707         # work around NumPy brokenness, #1987
708         if np.issubdtype(dtype.type, np.integer):
--> 709             return lib.astype_intsafe(arr.ravel(), dtype).reshape(arr.shape)
710 
711         # if we have a datetime/timedelta array of objects
pandas/_libs/lib.pyx in pandas._libs.lib.astype_intsafe()
pandas/_libs/src/util.pxd in util.set_value_at_unsafe()
ValueError: cannot convert float NaN to integer

所以我想知道是否有办法编辑我的 for 循环,以便每个条目都作为 int 输入(原始数据帧"总价"已经是 int),或者是否有办法在跳过 NaN 值时将新数据帧转换为 int 类型。我需要热图中的 NaN 值来显示供应商在该特定日期未提供任何内容。

提前感谢您的帮助,如果需要我提供更多信息,请告诉我!

从 pandas 版本 0.24.0 开始,我们nullable integer数据类型:

df = pd.DataFrame({'Col':[1.0, 2.0, 3.0, np.NaN]})
print(df)
Col
0  1.0
1  2.0
2  3.0
3  NaN 
print(df.Col.astype('Int64'))
0      1
1      2
2      3
3    NaN
Name: Col, dtype: Int64