# cephfs-mds-rpmem-mock-test

**Repository Path**: smdsbz/cephfs-mds-rpmem-mock-test

## Basic Information

- **Project Name**: cephfs-mds-rpmem-mock-test
- **Description**: 独立模拟上下文，测试将CephFS MDS元数据池放在pmempool上的理论性能上限
- **Primary Language**: C++
- **License**: LGPL-2.1
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2022-06-23
- **Last Updated**: 2023-06-20

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

Benchmarking in-house Ceph Objecter on remote replicated pmemobj pool.


Adding new benchmark
--------------------

`src/debug_test_nop.cc` is a template implementation of a _TestSet_.

Every benchmark unit should export variable `TestSetBase exported_testset`, which
will be linked against by the executing framework `src/main_testing_frame.cc`.


Performance
-----------

### Original benchmark data

```console
root@aep11-ib:/mnt/zxg/cephfs-mds-rpmem-mock-test# screenfetch 
                          ./+o+-       root@aep11-ib
                  yyyyy- -yyyyyy+      OS: Ubuntu 21.10 impish
               ://+//////-yyyyyyo      Kernel: x86_64 Linux 5.13.0-51-generic
           .++ .:/++++++/-.+sss/`      Uptime: 6d 20h 0m
         .:++o:  /++++++++/:--:/-      Packages: 2533
        o:+o+:++.`..```.-/oo+++++/     Shell: bash 5.1.8
       .:+o:+o/.          `+sssoo+/    Disk: 921G / 1.4T (68%)
  .++/+:+oo+o:`             /sssooo.   CPU: Intel Xeon Gold 6240 @ 72x 3.9GHz [37.0°C]
 /+++//+:`oo+o               /::--:.   GPU: ASPEED Technology, Inc. ASPEED Graphics Family (rev 41)
 \+/+o+++`o++o               ++////.   RAM: 9341MiB / 128555MiB
  .++.o+++oo+:`             /dddhhh.  
       .+.o+oo:.          `oddhhhh+   
        \+.++o+o``-````.:ohdhhhhh+    
         `:o+++ `ohhhhhhhhyo++os:     
           .o:`.syhhhhhhh/.oo++o`     
               /osyyyyyyo++ooo+++/    
                   ````` +oo+++o\:    
                          `oo++.      
root@aep11-ib:/mnt/zxg/cephfs-mds-rpmem-mock-test# ipmctl show -dimm
 DimmID | Capacity    | LockState | HealthState | FWVersion    
===============================================================
 0x0001 | 126.422 GiB | Disabled  | Healthy     | 01.02.00.5355
 0x0011 | 126.422 GiB | Disabled  | Healthy     | 01.02.00.5355
 0x1001 | 126.422 GiB | Disabled  | Healthy     | 01.02.00.5355
 0x1011 | 126.422 GiB | Disabled  | Healthy     | 01.02.00.5355
root@aep11-ib:/mnt/zxg/cephfs-mds-rpmem-mock-test# 
```

__workload: nothing__

| thrd | total time /s | total ops | iops     | avg lat /us |
|------|---------------|-----------|----------|-------------|
| 1    | 1.00007       | 100997781 | 1.01E+08 | 9.90E-03    |
| 4    | 1.00006       | 16389760  | 1.64E+07 | 2.44E-01    |
| 8    | 1.00007       | 13399071  | 1.34E+07 | 5.97E-01    |
| 16   | 1.00007       | 13325975  | 1.33E+07 | 1.20E+00    |
| 32   | 1.00008       | 13966196  | 1.40E+07 | 2.29E+00    |
| 64   | 1.00009       | 23375078  | 2.34E+07 | 2.74E+00    |

__workload: sleep 10us__

| thrd | total time /s | total ops | iops    | avg lat (us) |
|------|---------------|-----------|---------|--------------|
| 1    | 1.00007       | 14875     | 14874   | 67.23141051  |
| 4    | 1.00004       | 59563     | 59560.9 | 67.15815241  |
| 8    | 1.00004       | 117978    | 117974  | 67.8115517   |
| 16   | 1.00006       | 235402    | 235389  | 67.97259005  |
| 32   | 1.00007       | 469476    | 469441  | 68.16618063  |

__workload: sleep 30us__

| thrd | total time /s | total ops | iops    | avg lat (us) |
|------|---------------|-----------|---------|--------------|
| 1    | 1.00007       | 11423     | 11422.2 | 87.54880846  |
| 4    | 1.00006       | 45619     | 45616.2 | 87.68814588  |
| 8    | 1.00007       | 90944     | 90937.2 | 87.97279881  |
| 16   | 1.00007       | 181950    | 181938  | 87.94204619  |
| 32   | 1.00007       | 363312    | 363286  | 88.08486977  |

__workload: sleep 50us__

| thrd | total time /s | total ops | iops    | avg lat (us) |
|------|---------------|-----------|---------|--------------|
| 1    | 2.00013       | 18593     | 9295.88 | 107.5745384  |
| 4    | 1.00007       | 37125     | 37122.6 | 107.7510735  |
| 8    | 1.00006       | 74435     | 74430.9 | 107.4822419  |
| 16   | 1.00006       | 148368    | 148359  | 107.8465075  |
| 32   | 1.00007       | 295959    | 295938  | 108.1307571  |


Enable `perf` for performance debugging
---------------------------------------

Uncomment the following line in `src/BenchmarkWorkloadBase.cc` to re-enable `perf` injecting.

```c++
tpool.push_back(std::thread(__thread_perf));
```