合并最近的回溯时间戳,并在panda中向前填充



我很难掌握Panda特殊的合并函数,如merge_asof()

我有两个数据帧:coords-来自电动汽车gps的ping,以及info-其他电动汽车属性,如导航目的地和电池电量。我的目标是合并它们,使输出数据帧的行号等于两个数据帧的行数之和。例如:

coords.shape
(10, 3)
coords
ts                          lat       lng
2021-01-02 16:08:24.067971  58.3019 -134.4197
2021-01-06 12:54:18.535681  58.3021 -134.4195
2021-01-08 22:15:35.036423  58.3025 -134.4195
2021-01-16 01:10:39.610540  58.3029 -134.4193
2021-01-27 12:28:45.202376  58.3030 -134.4197
2021-01-30 05:32:09.404525  58.3031 -134.4190
2021-02-08 10:39:19.686159  58.3033 -134.4187
2021-02-15 01:30:16.733921  58.3039 -134.4187
2021-02-16 12:49:55.366025  58.3040 -134.4185
2021-02-19 23:57:57.369978  58.3041 -134.4181

info.shape
(3, 3)
info
ts                          nav_to  battery
2021-01-26 12:47:52.972586  Juneau      90
2021-02-14 23:23:18.186058  Anchorage   50
2021-02-19 07:26:35.357977  Fairbanks   30

infocoord应该被合并,使得时间戳ts是连续的顺序,并且使得info行应该与coords中具有最近的时间戳的行相匹配;在"之前";。最后,应向前填充nav_tobatterylatlng。以上示例的输出为:

output
ts                          lat      lng        nav_to  battery
2021-01-02 16:08:24.067971  58.3019 -134.4197   None    NaN
2021-01-06 12:54:18.535681  58.3021 -134.4195   None    NaN
2021-01-08 22:15:35.036423  58.3025 -134.4195   None    NaN
2021-01-16 01:10:39.610540  58.3029 -134.4193   None    NaN
2021-01-26 12:47:52.972586  58.3029 -134.4193   Juneau  90.0
2021-01-27 12:28:45.202376  58.3030 -134.4197   Juneau  90.0
2021-01-30 05:32:09.404525  58.3031 -134.4190   Juneau  90.0
2021-02-08 10:39:19.686159  58.3033 -134.4187   Juneau  90.0
2021-02-14 23:23:18.186058  58.3033 -134.4187   Anchorage   50.0
2021-02-15 01:30:16.733921  58.3039 -134.4187   Anchorage   50.0
2021-02-16 12:49:55.366025  58.3040 -134.4185   Anchorage   50.0
2021-02-19 07:26:35.357977  58.3040 -134.4185   Fairbanks   30.0
2021-02-19 23:57:57.369978  58.3041 -134.4181   Fairbanks   30.0

我尝试过使用pd.merge_asof(coords, info, on="ts", direction="forward"),但没有产生正确的结果,它向后填充,只保留coords中的记录。在pandas中产生所需结果的正确命令是什么?

尝试使用默认的direction='backward',然后使用第二个数据帧的concat

(pd.concat([pd.merge_asof(df1, df2, on='ts'), df2])
.sort_values('ts')
)

输出:

ts      lat       lng     nav_to  battery
0 2021-01-02 16:08:24.067971  58.3019 -134.4197        NaN      NaN
1 2021-01-06 12:54:18.535681  58.3021 -134.4195        NaN      NaN
2 2021-01-08 22:15:35.036423  58.3025 -134.4195        NaN      NaN
3 2021-01-16 01:10:39.610540  58.3029 -134.4193        NaN      NaN
0 2021-01-26 12:47:52.972586      NaN       NaN     Juneau     90.0
4 2021-01-27 12:28:45.202376  58.3030 -134.4197     Juneau     90.0
5 2021-01-30 05:32:09.404525  58.3031 -134.4190     Juneau     90.0
6 2021-02-08 10:39:19.686159  58.3033 -134.4187     Juneau     90.0
1 2021-02-14 23:23:18.186058      NaN       NaN  Anchorage     50.0
7 2021-02-15 01:30:16.733921  58.3039 -134.4187  Anchorage     50.0
8 2021-02-16 12:49:55.366025  58.3040 -134.4185  Anchorage     50.0
2 2021-02-19 07:26:35.357977      NaN       NaN  Fairbanks     30.0
9 2021-02-19 23:57:57.369978  58.3041 -134.4181  Fairbanks     30.0

然后,您可以选择bfilllatlng列。或者你可以只merge_asof两次:

(pd.concat([pd.merge_asof(df1, df2, on='ts'), 
pd.merge_asof(df2, df1, on='ts')
])
.sort_values('ts')
)

输出:

ts      lat       lng     nav_to  battery
0 2021-01-02 16:08:24.067971  58.3019 -134.4197        NaN      NaN
1 2021-01-06 12:54:18.535681  58.3021 -134.4195        NaN      NaN
2 2021-01-08 22:15:35.036423  58.3025 -134.4195        NaN      NaN
3 2021-01-16 01:10:39.610540  58.3029 -134.4193        NaN      NaN
0 2021-01-26 12:47:52.972586  58.3029 -134.4193     Juneau     90.0
4 2021-01-27 12:28:45.202376  58.3030 -134.4197     Juneau     90.0
5 2021-01-30 05:32:09.404525  58.3031 -134.4190     Juneau     90.0
6 2021-02-08 10:39:19.686159  58.3033 -134.4187     Juneau     90.0
1 2021-02-14 23:23:18.186058  58.3033 -134.4187  Anchorage     50.0
7 2021-02-15 01:30:16.733921  58.3039 -134.4187  Anchorage     50.0
8 2021-02-16 12:49:55.366025  58.3040 -134.4185  Anchorage     50.0
2 2021-02-19 07:26:35.357977  58.3040 -134.4185  Fairbanks     30.0
9 2021-02-19 23:57:57.369978  58.3041 -134.4181  Fairbanks     30.0

最新更新