Sorry, your browser cannot access this site
This page requires browser support (enable) JavaScript
Learn more >

今日目标:

上午

  • 1
    chao! massif太好用了!
18.25% nbrs 67
07.98% offset 66
07.98% label 29
07.97% spines 354
05.32% agg_owner 106
05.32% aggs[].push_back 51
31.90% aggs.emplace_back 46
- 内存分布,修改aggs结构
  • 2
    • 测试新修改
    • 看逐渐增长的内存来源
  • 3
    • 根据分析结果调整
      • 还是感叹,massif太牛了!!
    • get新的分析
  • 4
    • 继续优化
01.28% lf_can_reach_spine[lf].assign(jed, 0); 576
18.65% nbrs 93
08.16% offset 92
08.16% label 29
05.44% aggs 66
03.50% agg_offset 58
04.24% agg_owner 138
12.10%([])+09.08%(emplace_back) patterns 652
04.66%(reserve 369)+01.55%(emplace_back 376) leaf2fault 369 376
02.12% spines 363
01.06% leaves 365
02.37% batches 389
- 优化后1500x重新massif测试

更新后,test3_10000x:
加载完图划分完batch之后是峰值:

Graph.cpp
23.86% nbrs 93
10.44% offset 92
10.44% label 29
06.96% aggs 66
04.47% agg_offset 58
06.52% agg_owner 138

IndexFree.cpp
03.26%(push_back 386) leaf2fault 386
03.26% spines 363
01.63% leaves 365

tools.h
11.93% list.emplace_back in knapsack 131
01.91% batches.back().leafs.emplace_back() 132
02.61% merge batch, push_back one batch to another 176
04.89% to_del 175

稳定运行时:

32.04% nbrs 93
14.02% offset 92
14.02% label 29
09.34% aggs 66
06.01% agg_offset 58
08.75% agg_owner 138

04.37%(push_back) leaf2fault 386
01.34%(reserve) leaf2fault_offset 370
04.37% spines 363
02.19% leaves 365

01.25% lf_can_reach_spine[lf].assign(jed, 0) 595

最后:

32.44% nbrs 93
14.19% offset 92
14.19% label 29
09.46% aggs 66
06.08% agg_offset 58
08.86% agg_owner 138

04.43%(push_back) leaf2fault 386
01.35%(reserve) leaf2fault_offset 370
04.43% spines 363
02.21% leaves 365

下午

  • 1
    • 改划分Batch的内存消耗list为vector
      • 可能在读完顶点就进行,然后再读CSR
  • 2
    • 测试new batches
    • profile新的
  • 3
    • 分析profile
    • 发现仍然有bug

晚上

  • 1
    • batches新的优化code+debug
    • git push问题解决
  • 2
    • 分析优化list后的内存分布(主要看list那块的占用有没有下来)
      • 确实有噢
    • 服务器上跑test3_1000000xr
  • 3(half)
    • 分析test3_1000000xr内存占用(评估跑5*10^7xr的可能性)
      test3_1000000xr快到最后峰值运行时(n==23)
41.32% nbrs 93
18.08% offset 92
18.08% label 29
12.05% aggs 66
07.75% agg_offset 58
02.71% agg_owner 138

n==33(趋势同n==23) 502,431KB
n==61(peak) 569,535KB

图存储类上
08.84% spines 363
  • 4
    • 上大图跑
      test3_50000000xr
      最后heap
42.48% nbrs 93
18.58% offset 92
18.58% label 29
12.39% aggs 66
07.96% agg_offset 58
  • 回顾index方法代码

评论