是否可以过滤掉R中基于时间变量重叠的异常值?



如何通过检查ID列和日期/时间列与filter()之间的重叠来删除异常值?

例如ID =1的行在时间上重叠,如下面的前2行所示,因此需要删除。

tbody> <<tr>121
ID 时间开始 时间结束
12015-03-16 10:40:002015-03-16 11:10:00
2015-03-16 10:50:002015-03-16 10:59:00
2015-03-16 10:40:002015-03-16 10:45:00
2015-03-16 11:20:002015-03-16 11:28:56

尝试删除组内的任何时间重叠。请测试它与更多的数据,看看它是否做你想要的。我只试了下面的小样本。

library(tidyverse)
library(lubridate)
#> 
#> Attaching package: 'lubridate'
#> The following objects are masked from 'package:base':
#> 
#>     date, intersect, setdiff, union
library(slider)
tribble(
~id, ~start, ~end,
1, "2015-03-16 10:40:00", "2015-03-16 11:10:00",
1, "2015-03-16 10:50:00", "2015-03-16 10:59:00",
1, "2015-03-16 11:09:00", "2015-03-16 11:11:00",
2, "2015-03-16 10:40:00", "2015-03-16 10:45:00",
1, "2015-03-16 11:20:00", "2015-03-16 11:28:56",
1, "2015-03-16 11:27:00", "2015-03-16 11:30:56",
2, "2015-03-16 10:44:00", "2015-03-16 11:45:00"
) |>
mutate(
start = ymd_hms(start, tz = Sys.timezone()),
end = ymd_hms(end, tz = Sys.timezone())
) |>
arrange(id, start, end) |>
group_by(id) |>
mutate(
roll_start = slide_vec(start, min, .before = Inf),
roll_end = slide_vec(end, max, .before = Inf),
overlap = if_else((start >= lag(roll_start) & start <= lag(roll_end)) |
(end >= lag(roll_start) & end <= lag(roll_end)), "yes", "no")
) |>
filter(overlap == "no" | is.na(overlap)) |> 
select(- c(starts_with("roll_"), overlap))
#> # A tibble: 3 × 3
#> # Groups:   id [2]
#>      id start               end                
#>   <dbl> <dttm>              <dttm>             
#> 1     1 2015-03-16 10:40:00 2015-03-16 11:10:00
#> 2     1 2015-03-16 11:20:00 2015-03-16 11:28:56
#> 3     2 2015-03-16 10:40:00 2015-03-16 10:45:00

由reprex包(v2.0.1)于2022-04-30创建

最新更新