18c2ecf20Sopenharmony_ciWhat: /sys/class/rtrs-client 28c2ecf20Sopenharmony_ciDate: Feb 2020 38c2ecf20Sopenharmony_ciKernelVersion: 5.7 48c2ecf20Sopenharmony_ciContact: Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com> 58c2ecf20Sopenharmony_ciDescription: When a user of RTRS API creates a new session, a directory entry with 68c2ecf20Sopenharmony_ci the name of that session is created under /sys/class/rtrs-client/<session-name>/ 78c2ecf20Sopenharmony_ci 88c2ecf20Sopenharmony_ciWhat: /sys/class/rtrs-client/<session-name>/add_path 98c2ecf20Sopenharmony_ciDate: Feb 2020 108c2ecf20Sopenharmony_ciKernelVersion: 5.7 118c2ecf20Sopenharmony_ciContact: Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com> 128c2ecf20Sopenharmony_ciDescription: RW, adds a new path (connection) to an existing session. Expected format is the 138c2ecf20Sopenharmony_ci following:: 148c2ecf20Sopenharmony_ci 158c2ecf20Sopenharmony_ci <[source addr,]destination addr> 168c2ecf20Sopenharmony_ci *addr ::= [ ip:<ipv4|ipv6> | gid:<gid> ] 178c2ecf20Sopenharmony_ci 188c2ecf20Sopenharmony_ciWhat: /sys/class/rtrs-client/<session-name>/max_reconnect_attempts 198c2ecf20Sopenharmony_ciDate: Feb 2020 208c2ecf20Sopenharmony_ciKernelVersion: 5.7 218c2ecf20Sopenharmony_ciContact: Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com> 228c2ecf20Sopenharmony_ciDescription: Maximum number reconnect attempts the client should make before giving up 238c2ecf20Sopenharmony_ci after connection breaks unexpectedly. 248c2ecf20Sopenharmony_ci 258c2ecf20Sopenharmony_ciWhat: /sys/class/rtrs-client/<session-name>/mp_policy 268c2ecf20Sopenharmony_ciDate: Feb 2020 278c2ecf20Sopenharmony_ciKernelVersion: 5.7 288c2ecf20Sopenharmony_ciContact: Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com> 298c2ecf20Sopenharmony_ciDescription: Multipath policy specifies which path should be selected on each IO: 308c2ecf20Sopenharmony_ci 318c2ecf20Sopenharmony_ci round-robin (0): 328c2ecf20Sopenharmony_ci select path in per CPU round-robin manner. 338c2ecf20Sopenharmony_ci 348c2ecf20Sopenharmony_ci min-inflight (1): 358c2ecf20Sopenharmony_ci select path with minimum inflights. 368c2ecf20Sopenharmony_ci 378c2ecf20Sopenharmony_ciWhat: /sys/class/rtrs-client/<session-name>/paths/ 388c2ecf20Sopenharmony_ciDate: Feb 2020 398c2ecf20Sopenharmony_ciKernelVersion: 5.7 408c2ecf20Sopenharmony_ciContact: Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com> 418c2ecf20Sopenharmony_ciDescription: Each path belonging to a given session is listed here by its source and 428c2ecf20Sopenharmony_ci destination address. When a new path is added to a session by writing to 438c2ecf20Sopenharmony_ci the "add_path" entry, a directory <src@dst> is created. 448c2ecf20Sopenharmony_ci 458c2ecf20Sopenharmony_ciWhat: /sys/class/rtrs-client/<session-name>/paths/<src@dst>/state 468c2ecf20Sopenharmony_ciDate: Feb 2020 478c2ecf20Sopenharmony_ciKernelVersion: 5.7 488c2ecf20Sopenharmony_ciContact: Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com> 498c2ecf20Sopenharmony_ciDescription: RO, Contains "connected" if the session is connected to the peer and fully 508c2ecf20Sopenharmony_ci functional. Otherwise the file contains "disconnected" 518c2ecf20Sopenharmony_ci 528c2ecf20Sopenharmony_ciWhat: /sys/class/rtrs-client/<session-name>/paths/<src@dst>/reconnect 538c2ecf20Sopenharmony_ciDate: Feb 2020 548c2ecf20Sopenharmony_ciKernelVersion: 5.7 558c2ecf20Sopenharmony_ciContact: Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com> 568c2ecf20Sopenharmony_ciDescription: Write "1" to the file in order to reconnect the path. 578c2ecf20Sopenharmony_ci Operation is blocking and returns 0 if reconnect was successful. 588c2ecf20Sopenharmony_ci 598c2ecf20Sopenharmony_ciWhat: /sys/class/rtrs-client/<session-name>/paths/<src@dst>/disconnect 608c2ecf20Sopenharmony_ciDate: Feb 2020 618c2ecf20Sopenharmony_ciKernelVersion: 5.7 628c2ecf20Sopenharmony_ciContact: Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com> 638c2ecf20Sopenharmony_ciDescription: Write "1" to the file in order to disconnect the path. 648c2ecf20Sopenharmony_ci Operation blocks until RTRS path is disconnected. 658c2ecf20Sopenharmony_ci 668c2ecf20Sopenharmony_ciWhat: /sys/class/rtrs-client/<session-name>/paths/<src@dst>/remove_path 678c2ecf20Sopenharmony_ciDate: Feb 2020 688c2ecf20Sopenharmony_ciKernelVersion: 5.7 698c2ecf20Sopenharmony_ciContact: Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com> 708c2ecf20Sopenharmony_ciDescription: Write "1" to the file in order to disconnected and remove the path 718c2ecf20Sopenharmony_ci from the session. Operation blocks until the path is disconnected 728c2ecf20Sopenharmony_ci and removed from the session. 738c2ecf20Sopenharmony_ci 748c2ecf20Sopenharmony_ciWhat: /sys/class/rtrs-client/<session-name>/paths/<src@dst>/hca_name 758c2ecf20Sopenharmony_ciDate: Feb 2020 768c2ecf20Sopenharmony_ciKernelVersion: 5.7 778c2ecf20Sopenharmony_ciContact: Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com> 788c2ecf20Sopenharmony_ciDescription: RO, Contains the the name of HCA the connection established on. 798c2ecf20Sopenharmony_ci 808c2ecf20Sopenharmony_ciWhat: /sys/class/rtrs-client/<session-name>/paths/<src@dst>/hca_port 818c2ecf20Sopenharmony_ciDate: Feb 2020 828c2ecf20Sopenharmony_ciKernelVersion: 5.7 838c2ecf20Sopenharmony_ciContact: Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com> 848c2ecf20Sopenharmony_ciDescription: RO, Contains the port number of active port traffic is going through. 858c2ecf20Sopenharmony_ci 868c2ecf20Sopenharmony_ciWhat: /sys/class/rtrs-client/<session-name>/paths/<src@dst>/src_addr 878c2ecf20Sopenharmony_ciDate: Feb 2020 888c2ecf20Sopenharmony_ciKernelVersion: 5.7 898c2ecf20Sopenharmony_ciContact: Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com> 908c2ecf20Sopenharmony_ciDescription: RO, Contains the source address of the path 918c2ecf20Sopenharmony_ci 928c2ecf20Sopenharmony_ciWhat: /sys/class/rtrs-client/<session-name>/paths/<src@dst>/dst_addr 938c2ecf20Sopenharmony_ciDate: Feb 2020 948c2ecf20Sopenharmony_ciKernelVersion: 5.7 958c2ecf20Sopenharmony_ciContact: Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com> 968c2ecf20Sopenharmony_ciDescription: RO, Contains the destination address of the path 978c2ecf20Sopenharmony_ci 988c2ecf20Sopenharmony_ciWhat: /sys/class/rtrs-client/<session-name>/paths/<src@dst>/stats/reset_all 998c2ecf20Sopenharmony_ciDate: Feb 2020 1008c2ecf20Sopenharmony_ciKernelVersion: 5.7 1018c2ecf20Sopenharmony_ciContact: Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com> 1028c2ecf20Sopenharmony_ciDescription: RW, Read will return usage help, write 0 will clear all the statistics. 1038c2ecf20Sopenharmony_ci 1048c2ecf20Sopenharmony_ciWhat: /sys/class/rtrs-client/<session-name>/paths/<src@dst>/stats/cpu_migration 1058c2ecf20Sopenharmony_ciDate: Feb 2020 1068c2ecf20Sopenharmony_ciKernelVersion: 5.7 1078c2ecf20Sopenharmony_ciContact: Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com> 1088c2ecf20Sopenharmony_ciDescription: RTRS expects that each HCA IRQ is pinned to a separate CPU. If it's 1098c2ecf20Sopenharmony_ci not the case, the processing of an I/O response could be processed on a 1108c2ecf20Sopenharmony_ci different CPU than where it was originally submitted. This file shows 1118c2ecf20Sopenharmony_ci how many interrupts where generated on a non expected CPU. 1128c2ecf20Sopenharmony_ci 1138c2ecf20Sopenharmony_ci "from:" 1148c2ecf20Sopenharmony_ci is the CPU on which the IRQ was expected, but not generated. 1158c2ecf20Sopenharmony_ci "to:" 1168c2ecf20Sopenharmony_ci is the CPU on which the IRQ was generated, but not expected. 1178c2ecf20Sopenharmony_ci 1188c2ecf20Sopenharmony_ciWhat: /sys/class/rtrs-client/<session-name>/paths/<src@dst>/stats/reconnects 1198c2ecf20Sopenharmony_ciDate: Feb 2020 1208c2ecf20Sopenharmony_ciKernelVersion: 5.7 1218c2ecf20Sopenharmony_ciContact: Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com> 1228c2ecf20Sopenharmony_ciDescription: Contains 2 unsigned int values, the first one records number of successful 1238c2ecf20Sopenharmony_ci reconnects in the path lifetime, the second one records number of failed 1248c2ecf20Sopenharmony_ci reconnects in the path lifetime. 1258c2ecf20Sopenharmony_ci 1268c2ecf20Sopenharmony_ciWhat: /sys/class/rtrs-client/<session-name>/paths/<src@dst>/stats/rdma 1278c2ecf20Sopenharmony_ciDate: Feb 2020 1288c2ecf20Sopenharmony_ciKernelVersion: 5.7 1298c2ecf20Sopenharmony_ciContact: Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com> 1308c2ecf20Sopenharmony_ciDescription: Contains statistics regarding rdma operations and inflight operations. 1318c2ecf20Sopenharmony_ci The output consists of 6 values:: 1328c2ecf20Sopenharmony_ci 1338c2ecf20Sopenharmony_ci <read-count> <read-total-size> <write-count> \ 1348c2ecf20Sopenharmony_ci <write-total-size> <inflights> <failovered> 135