我很难掌握Panda特殊的合并函数,如merge_asof()
。
我有两个数据帧:coords
-来自电动汽车gps的ping,以及info
-其他电动汽车属性,如导航目的地和电池电量。我的目标是合并它们,使输出数据帧的行号等于两个数据帧的行数之和。例如:
coords.shape
(10, 3)
coords
ts lat lng
2021-01-02 16:08:24.067971 58.3019 -134.4197
2021-01-06 12:54:18.535681 58.3021 -134.4195
2021-01-08 22:15:35.036423 58.3025 -134.4195
2021-01-16 01:10:39.610540 58.3029 -134.4193
2021-01-27 12:28:45.202376 58.3030 -134.4197
2021-01-30 05:32:09.404525 58.3031 -134.4190
2021-02-08 10:39:19.686159 58.3033 -134.4187
2021-02-15 01:30:16.733921 58.3039 -134.4187
2021-02-16 12:49:55.366025 58.3040 -134.4185
2021-02-19 23:57:57.369978 58.3041 -134.4181
info.shape
(3, 3)
info
ts nav_to battery
2021-01-26 12:47:52.972586 Juneau 90
2021-02-14 23:23:18.186058 Anchorage 50
2021-02-19 07:26:35.357977 Fairbanks 30
info
和coord
应该被合并,使得时间戳ts
是连续的顺序,并且使得info
行应该与coords
中具有最近的时间戳的行相匹配;在"之前";。最后,应向前填充nav_to
、battery
、lat
和lng
。以上示例的输出为:
output
ts lat lng nav_to battery
2021-01-02 16:08:24.067971 58.3019 -134.4197 None NaN
2021-01-06 12:54:18.535681 58.3021 -134.4195 None NaN
2021-01-08 22:15:35.036423 58.3025 -134.4195 None NaN
2021-01-16 01:10:39.610540 58.3029 -134.4193 None NaN
2021-01-26 12:47:52.972586 58.3029 -134.4193 Juneau 90.0
2021-01-27 12:28:45.202376 58.3030 -134.4197 Juneau 90.0
2021-01-30 05:32:09.404525 58.3031 -134.4190 Juneau 90.0
2021-02-08 10:39:19.686159 58.3033 -134.4187 Juneau 90.0
2021-02-14 23:23:18.186058 58.3033 -134.4187 Anchorage 50.0
2021-02-15 01:30:16.733921 58.3039 -134.4187 Anchorage 50.0
2021-02-16 12:49:55.366025 58.3040 -134.4185 Anchorage 50.0
2021-02-19 07:26:35.357977 58.3040 -134.4185 Fairbanks 30.0
2021-02-19 23:57:57.369978 58.3041 -134.4181 Fairbanks 30.0
我尝试过使用pd.merge_asof(coords, info, on="ts", direction="forward")
,但没有产生正确的结果,它向后填充,只保留coords
中的记录。在pandas
中产生所需结果的正确命令是什么?
尝试使用默认的direction='backward'
,然后使用第二个数据帧的concat
(pd.concat([pd.merge_asof(df1, df2, on='ts'), df2])
.sort_values('ts')
)
输出:
ts lat lng nav_to battery
0 2021-01-02 16:08:24.067971 58.3019 -134.4197 NaN NaN
1 2021-01-06 12:54:18.535681 58.3021 -134.4195 NaN NaN
2 2021-01-08 22:15:35.036423 58.3025 -134.4195 NaN NaN
3 2021-01-16 01:10:39.610540 58.3029 -134.4193 NaN NaN
0 2021-01-26 12:47:52.972586 NaN NaN Juneau 90.0
4 2021-01-27 12:28:45.202376 58.3030 -134.4197 Juneau 90.0
5 2021-01-30 05:32:09.404525 58.3031 -134.4190 Juneau 90.0
6 2021-02-08 10:39:19.686159 58.3033 -134.4187 Juneau 90.0
1 2021-02-14 23:23:18.186058 NaN NaN Anchorage 50.0
7 2021-02-15 01:30:16.733921 58.3039 -134.4187 Anchorage 50.0
8 2021-02-16 12:49:55.366025 58.3040 -134.4185 Anchorage 50.0
2 2021-02-19 07:26:35.357977 NaN NaN Fairbanks 30.0
9 2021-02-19 23:57:57.369978 58.3041 -134.4181 Fairbanks 30.0
然后,您可以选择bfill
、lat
和lng
列。或者你可以只merge_asof
两次:
(pd.concat([pd.merge_asof(df1, df2, on='ts'),
pd.merge_asof(df2, df1, on='ts')
])
.sort_values('ts')
)
输出:
ts lat lng nav_to battery
0 2021-01-02 16:08:24.067971 58.3019 -134.4197 NaN NaN
1 2021-01-06 12:54:18.535681 58.3021 -134.4195 NaN NaN
2 2021-01-08 22:15:35.036423 58.3025 -134.4195 NaN NaN
3 2021-01-16 01:10:39.610540 58.3029 -134.4193 NaN NaN
0 2021-01-26 12:47:52.972586 58.3029 -134.4193 Juneau 90.0
4 2021-01-27 12:28:45.202376 58.3030 -134.4197 Juneau 90.0
5 2021-01-30 05:32:09.404525 58.3031 -134.4190 Juneau 90.0
6 2021-02-08 10:39:19.686159 58.3033 -134.4187 Juneau 90.0
1 2021-02-14 23:23:18.186058 58.3033 -134.4187 Anchorage 50.0
7 2021-02-15 01:30:16.733921 58.3039 -134.4187 Anchorage 50.0
8 2021-02-16 12:49:55.366025 58.3040 -134.4185 Anchorage 50.0
2 2021-02-19 07:26:35.357977 58.3040 -134.4185 Fairbanks 30.0
9 2021-02-19 23:57:57.369978 58.3041 -134.4181 Fairbanks 30.0