Pandas 按自定义频率分组并获取索引组
Pandas group by custom frequency and get groups of indexes
我有一个 pandas 时间序列 auctions 是这样的：
problemStart
2018-12-19 13:00:00 1
2018-12-19 14:00:00 0
2018-12-19 15:00:00 0
2018-12-19 16:00:00 0
2018-12-19 17:00:00 0
... ...
2021-10-29 12:00:00 0
2021-10-29 13:00:00 0
2021-10-29 14:00:00 0
2021-10-29 15:00:00 0
2021-10-29 16:00:00 1
[25084 rows x 1 columns]
按年份分组给出预期的输出，它是一个字典，首先是组键，然后是组中数据帧的所有索引的列表。
auctions.groupby(auctions.index.year).groups
{2018: [2018-12-19 13:00:00, 2018-12-19 14:00:00, 2018-12-19 15:00:00, 2018-12-19 16:00:00, 2018-12-19 17:00:00, 2018-12-19 18:00:00, 2018-12-19 19:00:00, 2018-12-19 20:00:00, 2018-12-19 21:00:00, 2018-12-19 22:00:00, 2018-12-19 23:00:00, 2018-12-20 00:00:00, 2018-12-20 01:00:00, 2018-12-20 02:00:00, 2018-12-20 03:00:00, 2018-12-20 04:00:00, 2018-12-20 05:00:00, 2018-12-20 06:00:00, 2018-12-20 07:00:00, 2018-12-20 08:00:00, 2018-12-20 09:00:00, 2018-12-20 10:00:00, 2018-12-20 11:00:00, 2018-12-20 12:00:00, 2018-12-20 13:00:00, 2018-12-20 14:00:00, 2018-12-20 15:00:00, 2018-12-20 16:00:00, 2018-12-20 17:00:00, 2018-12-20 18:00:00, 2018-12-20 19:00:00, 2018-12-20 20:00:00, 2018-12-20 21:00:00, 2018-12-20 22:00:00, 2018-12-20 23:00:00, 2018-12-21 00:00:00, 2018-12-21 01:00:00, 2018-12-21 02:00:00, 2018-12-21 03:00:00, 2018-12-21 04:00:00, 2018-12-21 05:00:00, 2018-12-21 06:00:00, 2018-12-21 07:00:00, 2018-12-21 08:00:00, 2018-12-21 09:00:00, 2018-12-21 10:00:00, 2018-12-21 11:00:00, 2018-12-21 12:00:00, 2018-12-21 13:00:00, 2018-12-21 14:00:00, 2018-12-21 15:00:00, 2018-12-21 16:00:00, 2018-12-21 17:00:00, 2018-12-21 18:00:00, 2018-12-21 19:00:00, 2018-12-21 20:00:00, 2018-12-21 21:00:00, 2018-12-21 22:00:00, 2018-12-21 23:00:00, 2018-12-22 00:00:00, 2018-12-22 01:00:00, 2018-12-22 02:00:00, 2018-12-22 03:00:00, ...
但是我不明白当我用 pd.Grouper:
做同样的事情时得到的输出
auctions.groupby(pd.Grouper(freq="Y")).groups
{Timestamp('2018-12-31 00:00:00', freq='A-DEC'): 299,
Timestamp('2019-12-31 00:00:00', freq='A-DEC'): 9059,
Timestamp('2020-12-31 00:00:00', freq='A-DEC'): 17843,
Timestamp('2021-12-31 00:00:00', freq='A-DEC'): 25084}
这里的词典条目是什么？ 299 是多少？
我想做的是按半年间隔分组，我需要 pd.Grouper，但我不明白它产生的输出，并希望它产生与简单分组相同的输出index.year.
这里是 auctions file：
https://gist.github.com/charelF/96b5e6fb765be28377794ed27fd20ad6
显然有比 groups 更好的方法来获取索引，即 indices:
auctions.groupby(pd.Grouper(freq='Y', key="problemStart")).indices
如我所愿：
{k:auctions.index[v] for k,v in auctions.groupby(pd.Grouper(freq='Y')).indices.items()}
returns
{Timestamp('2018-12-31 00:00:00', freq='A-DEC'): DatetimeIndex(['2018-12-19 13:00:00', '2018-12-19 14:00:00', '2018-12-19 15:00:00', '2018-12-19 16:00:00', '2018-12-19 17:00:00', '2018-12-19 18:00:00', ...
因为这与所需的非常相似：
{2018: [2018-12-19 13:00:00, 2018-12-19 14:00:00, 2018-12-19 15:00:00, 2018-12-19 16:00:00, 2018-12-19 17:00:00, 2018-12-19 18:00:00, 2018-12-19 19:00:00, 2018-12-19 20:00:00, 2018-12-19 21:00:00, 2018-12-19 22:00:00, 2018-12-19 23:00:00, 2018-12-20 00:00:00, 2018-12-20 01:00:00, 2018-12-20 02:00:00, 2018-12-20 03:00:00, 2018-12-20 04:00:00, 2018-12-20 05:00:00, 2018-12-20 06:00:00, 2018-12-20 07:00:00, 2018-12-20 08:00:00, 2018-12-20 09:00:00, 2018-12-20 10:00:00, 2018-12-20 11:00:00, 2018-12-20 12:00:00, 2018-12-20 13:00:00, 2018-12-20 14:00:00, 2018-12-20 15:00:00, 2018-12-20 16:00:00, 2018-12-20 17:00:00, 2018-12-20 18:00:00, 2018-12-20 19:00:00, 2018-12-20 20:00:00, 2018-12-20 21:00:00, 2018-12-20 22:00:00, 2018-12-20 23:00:00, 2018-12-21 00:00:00, 2018-12-21 01:00:00, 2018-12-21 02:00:00, 2018-12-21 03:00:00, 2018-12-21 04:00:00, 2018-12-21 05:00:00, 2018-12-21 06:00:00, 2018-12-21 07:00:00, 2018-12-21 08:00:00, 2018-12-21 09:00:00, 2018-12-21 10:00:00, 2018-12-21 11:00:00, 2018-12-21 12:00:00, 2018-12-21 13:00:00, 2018-12-21 14:00:00, 2018-12-21 15:00:00, 2018-12-21 16:00:00, 2018-12-21 17:00:00, 2018-12-21 18:00:00, 2018-12-21 19:00:00, 2018-12-21 20:00:00, 2018-12-21 21:00:00, 2018-12-21 22:00:00, 2018-12-21 23:00:00, 2018-12-22 00:00:00, 2018-12-22 01:00:00, 2018-12-22 02:00:00, 2018-12-22 03:00:00, ...
我有一个 pandas 时间序列 auctions 是这样的：
problemStart
2018-12-19 13:00:00 1
2018-12-19 14:00:00 0
2018-12-19 15:00:00 0
2018-12-19 16:00:00 0
2018-12-19 17:00:00 0
... ...
2021-10-29 12:00:00 0
2021-10-29 13:00:00 0
2021-10-29 14:00:00 0
2021-10-29 15:00:00 0
2021-10-29 16:00:00 1
[25084 rows x 1 columns]
按年份分组给出预期的输出，它是一个字典，首先是组键，然后是组中数据帧的所有索引的列表。
auctions.groupby(auctions.index.year).groups
{2018: [2018-12-19 13:00:00, 2018-12-19 14:00:00, 2018-12-19 15:00:00, 2018-12-19 16:00:00, 2018-12-19 17:00:00, 2018-12-19 18:00:00, 2018-12-19 19:00:00, 2018-12-19 20:00:00, 2018-12-19 21:00:00, 2018-12-19 22:00:00, 2018-12-19 23:00:00, 2018-12-20 00:00:00, 2018-12-20 01:00:00, 2018-12-20 02:00:00, 2018-12-20 03:00:00, 2018-12-20 04:00:00, 2018-12-20 05:00:00, 2018-12-20 06:00:00, 2018-12-20 07:00:00, 2018-12-20 08:00:00, 2018-12-20 09:00:00, 2018-12-20 10:00:00, 2018-12-20 11:00:00, 2018-12-20 12:00:00, 2018-12-20 13:00:00, 2018-12-20 14:00:00, 2018-12-20 15:00:00, 2018-12-20 16:00:00, 2018-12-20 17:00:00, 2018-12-20 18:00:00, 2018-12-20 19:00:00, 2018-12-20 20:00:00, 2018-12-20 21:00:00, 2018-12-20 22:00:00, 2018-12-20 23:00:00, 2018-12-21 00:00:00, 2018-12-21 01:00:00, 2018-12-21 02:00:00, 2018-12-21 03:00:00, 2018-12-21 04:00:00, 2018-12-21 05:00:00, 2018-12-21 06:00:00, 2018-12-21 07:00:00, 2018-12-21 08:00:00, 2018-12-21 09:00:00, 2018-12-21 10:00:00, 2018-12-21 11:00:00, 2018-12-21 12:00:00, 2018-12-21 13:00:00, 2018-12-21 14:00:00, 2018-12-21 15:00:00, 2018-12-21 16:00:00, 2018-12-21 17:00:00, 2018-12-21 18:00:00, 2018-12-21 19:00:00, 2018-12-21 20:00:00, 2018-12-21 21:00:00, 2018-12-21 22:00:00, 2018-12-21 23:00:00, 2018-12-22 00:00:00, 2018-12-22 01:00:00, 2018-12-22 02:00:00, 2018-12-22 03:00:00, ...
但是我不明白当我用 pd.Grouper:
auctions.groupby(pd.Grouper(freq="Y")).groups
{Timestamp('2018-12-31 00:00:00', freq='A-DEC'): 299,
Timestamp('2019-12-31 00:00:00', freq='A-DEC'): 9059,
Timestamp('2020-12-31 00:00:00', freq='A-DEC'): 17843,
Timestamp('2021-12-31 00:00:00', freq='A-DEC'): 25084}
这里的词典条目是什么？ 299 是多少？
我想做的是按半年间隔分组，我需要 pd.Grouper，但我不明白它产生的输出，并希望它产生与简单分组相同的输出index.year.
这里是 auctions file：
https://gist.github.com/charelF/96b5e6fb765be28377794ed27fd20ad6
显然有比 groups 更好的方法来获取索引，即 indices:
auctions.groupby(pd.Grouper(freq='Y', key="problemStart")).indices
如我所愿：
{k:auctions.index[v] for k,v in auctions.groupby(pd.Grouper(freq='Y')).indices.items()}
returns
{Timestamp('2018-12-31 00:00:00', freq='A-DEC'): DatetimeIndex(['2018-12-19 13:00:00', '2018-12-19 14:00:00', '2018-12-19 15:00:00', '2018-12-19 16:00:00', '2018-12-19 17:00:00', '2018-12-19 18:00:00', ...
因为这与所需的非常相似：
{2018: [2018-12-19 13:00:00, 2018-12-19 14:00:00, 2018-12-19 15:00:00, 2018-12-19 16:00:00, 2018-12-19 17:00:00, 2018-12-19 18:00:00, 2018-12-19 19:00:00, 2018-12-19 20:00:00, 2018-12-19 21:00:00, 2018-12-19 22:00:00, 2018-12-19 23:00:00, 2018-12-20 00:00:00, 2018-12-20 01:00:00, 2018-12-20 02:00:00, 2018-12-20 03:00:00, 2018-12-20 04:00:00, 2018-12-20 05:00:00, 2018-12-20 06:00:00, 2018-12-20 07:00:00, 2018-12-20 08:00:00, 2018-12-20 09:00:00, 2018-12-20 10:00:00, 2018-12-20 11:00:00, 2018-12-20 12:00:00, 2018-12-20 13:00:00, 2018-12-20 14:00:00, 2018-12-20 15:00:00, 2018-12-20 16:00:00, 2018-12-20 17:00:00, 2018-12-20 18:00:00, 2018-12-20 19:00:00, 2018-12-20 20:00:00, 2018-12-20 21:00:00, 2018-12-20 22:00:00, 2018-12-20 23:00:00, 2018-12-21 00:00:00, 2018-12-21 01:00:00, 2018-12-21 02:00:00, 2018-12-21 03:00:00, 2018-12-21 04:00:00, 2018-12-21 05:00:00, 2018-12-21 06:00:00, 2018-12-21 07:00:00, 2018-12-21 08:00:00, 2018-12-21 09:00:00, 2018-12-21 10:00:00, 2018-12-21 11:00:00, 2018-12-21 12:00:00, 2018-12-21 13:00:00, 2018-12-21 14:00:00, 2018-12-21 15:00:00, 2018-12-21 16:00:00, 2018-12-21 17:00:00, 2018-12-21 18:00:00, 2018-12-21 19:00:00, 2018-12-21 20:00:00, 2018-12-21 21:00:00, 2018-12-21 22:00:00, 2018-12-21 23:00:00, 2018-12-22 00:00:00, 2018-12-22 01:00:00, 2018-12-22 02:00:00, 2018-12-22 03:00:00, ...