大熊猫是指具有条件的地方的值

问题描述 投票:0回答:1

我想计算不包括值99的年龄平均值。在现实生活中,数据帧要大得多,我还有其他可能的变量。

有没有更有效的方法(更快或更优雅)呢?也许使用数据透视表或分组或函数?

data = {'age': [99,45,34,32,34,67,5,6,7,8,3,5]}
df = pd.DataFrame(data, columns = ['age'])

not99 = df['age'] != 99

mean_for_age = df.loc[not99, 'age'].mean()
python pandas group-by pivot
1个回答
0
投票

numpy解决方案更快 - 首先创建数组然后过滤:

arr = df['age'].values
not99 = arr != 99

mean_for_age = arr[not99].mean()

但如果需要一般解决方案可能选择另一列使用您的解决方案:

not99 = df['age'] != 99
mean_for_age = df.loc[not99, 'age'].mean()

mean_for_age = df.loc[not99, 'another col'].mean()

计时(取决于数据,最佳测试与实际数据):

data = {'age': [99,45,34,32,34,67,5,6,7,8,3,5]}
df = pd.DataFrame(data, columns = ['age'])

df = pd.concat([df] * 10000, ignore_index=True)


In [14]: %%timeit
    ...: arr = df['age'].values
    ...: not99 = arr != 99
    ...: 
    ...: mean_for_age = arr[not99].mean()
    ...: 
496 µs ± 36.1 µs per loop (mean ± std. dev. of 7 runs, 1000 loops each)

In [15]: %%timeit
    ...: not99 = df['age'] != 99
    ...: mean_for_age = df.loc[not99, 'age'].mean()
    ...: 
1.82 ms ± 40.4 µs per loop (mean ± std. dev. of 7 runs, 1000 loops each)

In [16]: %%timeit
    ...: df.query("age != 99")['age'].mean()
    ...: 
4.26 ms ± 40.5 µs per loop (mean ± std. dev. of 7 runs, 100 loops each)
© www.soinside.com 2019 - 2024. All rights reserved.