今日目标:
上午
- 1
chao! massif太好用了!
18.25% nbrs 67
07.98% offset 66
07.98% label 29
07.97% spines 354
05.32% agg_owner 106
05.32% aggs[].push_back 51
31.90% aggs.emplace_back 46
- 内存分布,修改aggs结构
- 2
- 测试新修改
- 看逐渐增长的内存来源
- 3
- 根据分析结果调整
- 还是感叹,massif太牛了!!
- get新的分析
- 根据分析结果调整
- 4
- 继续优化
01.28% lf_can_reach_spine[lf].assign(jed, 0); 576
18.65% nbrs 93
08.16% offset 92
08.16% label 29
05.44% aggs 66
03.50% agg_offset 58
04.24% agg_owner 138
12.10%([])+09.08%(emplace_back) patterns 652
04.66%(reserve 369)+01.55%(emplace_back 376) leaf2fault 369 376
02.12% spines 363
01.06% leaves 365
02.37% batches 389
- 优化后1500x重新massif测试
更新后,test3_10000x:
加载完图划分完batch之后是峰值:
Graph.cpp
23.86% nbrs 93
10.44% offset 92
10.44% label 29
06.96% aggs 66
04.47% agg_offset 58
06.52% agg_owner 138
IndexFree.cpp
03.26%(push_back 386) leaf2fault 386
03.26% spines 363
01.63% leaves 365
tools.h
11.93% list.emplace_back in knapsack 131
01.91% batches.back().leafs.emplace_back() 132
02.61% merge batch, push_back one batch to another 176
04.89% to_del 175
稳定运行时:
32.04% nbrs 93
14.02% offset 92
14.02% label 29
09.34% aggs 66
06.01% agg_offset 58
08.75% agg_owner 138
04.37%(push_back) leaf2fault 386
01.34%(reserve) leaf2fault_offset 370
04.37% spines 363
02.19% leaves 365
01.25% lf_can_reach_spine[lf].assign(jed, 0) 595
最后:
32.44% nbrs 93
14.19% offset 92
14.19% label 29
09.46% aggs 66
06.08% agg_offset 58
08.86% agg_owner 138
04.43%(push_back) leaf2fault 386
01.35%(reserve) leaf2fault_offset 370
04.43% spines 363
02.21% leaves 365
下午
- 1
- 改划分Batch的内存消耗list为vector
- 可能在读完顶点就进行,然后再读CSR
- 改划分Batch的内存消耗list为vector
- 2
- 测试new batches
- profile新的
- 3
- 分析profile
- 发现仍然有bug
晚上
- 1
- batches新的优化code+debug
- git push问题解决
- 2
- 分析优化list后的内存分布(主要看list那块的占用有没有下来)
- 确实有噢
- 服务器上跑test3_1000000xr
- 分析优化list后的内存分布(主要看list那块的占用有没有下来)
- 3(half)
- 分析test3_1000000xr内存占用(评估跑5*10^7xr的可能性)
test3_1000000xr快到最后峰值运行时(n==23)
- 分析test3_1000000xr内存占用(评估跑5*10^7xr的可能性)
41.32% nbrs 93
18.08% offset 92
18.08% label 29
12.05% aggs 66
07.75% agg_offset 58
02.71% agg_owner 138
n==33(趋势同n==23) 502,431KB
n==61(peak) 569,535KB
图存储类上
08.84% spines 363
- 4
- 上大图跑
test3_50000000xr
最后heap
- 上大图跑
42.48% nbrs 93
18.58% offset 92
18.58% label 29
12.39% aggs 66
07.96% agg_offset 58
- 回顾index方法代码