18c2ecf20Sopenharmony_ciWhat:		/sys/class/rtrs-client
28c2ecf20Sopenharmony_ciDate:		Feb 2020
38c2ecf20Sopenharmony_ciKernelVersion:	5.7
48c2ecf20Sopenharmony_ciContact:	Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com>
58c2ecf20Sopenharmony_ciDescription:	When a user of RTRS API creates a new session, a directory entry with
68c2ecf20Sopenharmony_ci		the name of that session is created under /sys/class/rtrs-client/<session-name>/
78c2ecf20Sopenharmony_ci
88c2ecf20Sopenharmony_ciWhat:		/sys/class/rtrs-client/<session-name>/add_path
98c2ecf20Sopenharmony_ciDate:		Feb 2020
108c2ecf20Sopenharmony_ciKernelVersion:	5.7
118c2ecf20Sopenharmony_ciContact:	Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com>
128c2ecf20Sopenharmony_ciDescription:	RW, adds a new path (connection) to an existing session. Expected format is the
138c2ecf20Sopenharmony_ci		following::
148c2ecf20Sopenharmony_ci
158c2ecf20Sopenharmony_ci		    <[source addr,]destination addr>
168c2ecf20Sopenharmony_ci		    *addr ::= [ ip:<ipv4|ipv6> | gid:<gid> ]
178c2ecf20Sopenharmony_ci
188c2ecf20Sopenharmony_ciWhat:		/sys/class/rtrs-client/<session-name>/max_reconnect_attempts
198c2ecf20Sopenharmony_ciDate:		Feb 2020
208c2ecf20Sopenharmony_ciKernelVersion:	5.7
218c2ecf20Sopenharmony_ciContact:	Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com>
228c2ecf20Sopenharmony_ciDescription:	Maximum number reconnect attempts the client should make before giving up
238c2ecf20Sopenharmony_ci		after connection breaks unexpectedly.
248c2ecf20Sopenharmony_ci
258c2ecf20Sopenharmony_ciWhat:		/sys/class/rtrs-client/<session-name>/mp_policy
268c2ecf20Sopenharmony_ciDate:		Feb 2020
278c2ecf20Sopenharmony_ciKernelVersion:	5.7
288c2ecf20Sopenharmony_ciContact:	Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com>
298c2ecf20Sopenharmony_ciDescription:	Multipath policy specifies which path should be selected on each IO:
308c2ecf20Sopenharmony_ci
318c2ecf20Sopenharmony_ci		round-robin (0):
328c2ecf20Sopenharmony_ci		    select path in per CPU round-robin manner.
338c2ecf20Sopenharmony_ci
348c2ecf20Sopenharmony_ci		min-inflight (1):
358c2ecf20Sopenharmony_ci		    select path with minimum inflights.
368c2ecf20Sopenharmony_ci
378c2ecf20Sopenharmony_ciWhat:		/sys/class/rtrs-client/<session-name>/paths/
388c2ecf20Sopenharmony_ciDate:		Feb 2020
398c2ecf20Sopenharmony_ciKernelVersion:	5.7
408c2ecf20Sopenharmony_ciContact:	Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com>
418c2ecf20Sopenharmony_ciDescription:	Each path belonging to a given session is listed here by its source and
428c2ecf20Sopenharmony_ci		destination address. When a new path is added to a session by writing to
438c2ecf20Sopenharmony_ci		the "add_path" entry, a directory <src@dst> is created.
448c2ecf20Sopenharmony_ci
458c2ecf20Sopenharmony_ciWhat:		/sys/class/rtrs-client/<session-name>/paths/<src@dst>/state
468c2ecf20Sopenharmony_ciDate:		Feb 2020
478c2ecf20Sopenharmony_ciKernelVersion:	5.7
488c2ecf20Sopenharmony_ciContact:	Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com>
498c2ecf20Sopenharmony_ciDescription:	RO, Contains "connected" if the session is connected to the peer and fully
508c2ecf20Sopenharmony_ci		functional.  Otherwise the file contains "disconnected"
518c2ecf20Sopenharmony_ci
528c2ecf20Sopenharmony_ciWhat:		/sys/class/rtrs-client/<session-name>/paths/<src@dst>/reconnect
538c2ecf20Sopenharmony_ciDate:		Feb 2020
548c2ecf20Sopenharmony_ciKernelVersion:	5.7
558c2ecf20Sopenharmony_ciContact:	Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com>
568c2ecf20Sopenharmony_ciDescription:	Write "1" to the file in order to reconnect the path.
578c2ecf20Sopenharmony_ci		Operation is blocking and returns 0 if reconnect was successful.
588c2ecf20Sopenharmony_ci
598c2ecf20Sopenharmony_ciWhat:		/sys/class/rtrs-client/<session-name>/paths/<src@dst>/disconnect
608c2ecf20Sopenharmony_ciDate:		Feb 2020
618c2ecf20Sopenharmony_ciKernelVersion:	5.7
628c2ecf20Sopenharmony_ciContact:	Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com>
638c2ecf20Sopenharmony_ciDescription:	Write "1" to the file in order to disconnect the path.
648c2ecf20Sopenharmony_ci		Operation blocks until RTRS path is disconnected.
658c2ecf20Sopenharmony_ci
668c2ecf20Sopenharmony_ciWhat:		/sys/class/rtrs-client/<session-name>/paths/<src@dst>/remove_path
678c2ecf20Sopenharmony_ciDate:		Feb 2020
688c2ecf20Sopenharmony_ciKernelVersion:	5.7
698c2ecf20Sopenharmony_ciContact:	Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com>
708c2ecf20Sopenharmony_ciDescription:	Write "1" to the file in order to disconnected and remove the path
718c2ecf20Sopenharmony_ci		from the session.  Operation blocks until the path is disconnected
728c2ecf20Sopenharmony_ci		and removed from the session.
738c2ecf20Sopenharmony_ci
748c2ecf20Sopenharmony_ciWhat:		/sys/class/rtrs-client/<session-name>/paths/<src@dst>/hca_name
758c2ecf20Sopenharmony_ciDate:		Feb 2020
768c2ecf20Sopenharmony_ciKernelVersion:	5.7
778c2ecf20Sopenharmony_ciContact:	Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com>
788c2ecf20Sopenharmony_ciDescription:	RO, Contains the the name of HCA the connection established on.
798c2ecf20Sopenharmony_ci
808c2ecf20Sopenharmony_ciWhat:		/sys/class/rtrs-client/<session-name>/paths/<src@dst>/hca_port
818c2ecf20Sopenharmony_ciDate:		Feb 2020
828c2ecf20Sopenharmony_ciKernelVersion:	5.7
838c2ecf20Sopenharmony_ciContact:	Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com>
848c2ecf20Sopenharmony_ciDescription:	RO, Contains the port number of active port traffic is going through.
858c2ecf20Sopenharmony_ci
868c2ecf20Sopenharmony_ciWhat:		/sys/class/rtrs-client/<session-name>/paths/<src@dst>/src_addr
878c2ecf20Sopenharmony_ciDate:		Feb 2020
888c2ecf20Sopenharmony_ciKernelVersion:	5.7
898c2ecf20Sopenharmony_ciContact:	Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com>
908c2ecf20Sopenharmony_ciDescription:	RO, Contains the source address of the path
918c2ecf20Sopenharmony_ci
928c2ecf20Sopenharmony_ciWhat:		/sys/class/rtrs-client/<session-name>/paths/<src@dst>/dst_addr
938c2ecf20Sopenharmony_ciDate:		Feb 2020
948c2ecf20Sopenharmony_ciKernelVersion:	5.7
958c2ecf20Sopenharmony_ciContact:	Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com>
968c2ecf20Sopenharmony_ciDescription:	RO, Contains the destination address of the path
978c2ecf20Sopenharmony_ci
988c2ecf20Sopenharmony_ciWhat:		/sys/class/rtrs-client/<session-name>/paths/<src@dst>/stats/reset_all
998c2ecf20Sopenharmony_ciDate:		Feb 2020
1008c2ecf20Sopenharmony_ciKernelVersion:	5.7
1018c2ecf20Sopenharmony_ciContact:	Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com>
1028c2ecf20Sopenharmony_ciDescription:	RW, Read will return usage help, write 0 will clear all the statistics.
1038c2ecf20Sopenharmony_ci
1048c2ecf20Sopenharmony_ciWhat:		/sys/class/rtrs-client/<session-name>/paths/<src@dst>/stats/cpu_migration
1058c2ecf20Sopenharmony_ciDate:		Feb 2020
1068c2ecf20Sopenharmony_ciKernelVersion:	5.7
1078c2ecf20Sopenharmony_ciContact:	Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com>
1088c2ecf20Sopenharmony_ciDescription:	RTRS expects that each HCA IRQ is pinned to a separate CPU. If it's
1098c2ecf20Sopenharmony_ci		not the case, the processing of an I/O response could be processed on a
1108c2ecf20Sopenharmony_ci		different CPU than where it was originally submitted.  This file shows
1118c2ecf20Sopenharmony_ci		how many interrupts where generated on a non expected CPU.
1128c2ecf20Sopenharmony_ci
1138c2ecf20Sopenharmony_ci		"from:"
1148c2ecf20Sopenharmony_ci		    is the CPU on which the IRQ was expected, but not generated.
1158c2ecf20Sopenharmony_ci		"to:"
1168c2ecf20Sopenharmony_ci		    is the CPU on which the IRQ was generated, but not expected.
1178c2ecf20Sopenharmony_ci
1188c2ecf20Sopenharmony_ciWhat:		/sys/class/rtrs-client/<session-name>/paths/<src@dst>/stats/reconnects
1198c2ecf20Sopenharmony_ciDate:		Feb 2020
1208c2ecf20Sopenharmony_ciKernelVersion:	5.7
1218c2ecf20Sopenharmony_ciContact:	Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com>
1228c2ecf20Sopenharmony_ciDescription:	Contains 2 unsigned int values, the first one records number of successful
1238c2ecf20Sopenharmony_ci		reconnects in the path lifetime, the second one records number of failed
1248c2ecf20Sopenharmony_ci		reconnects in the path lifetime.
1258c2ecf20Sopenharmony_ci
1268c2ecf20Sopenharmony_ciWhat:		/sys/class/rtrs-client/<session-name>/paths/<src@dst>/stats/rdma
1278c2ecf20Sopenharmony_ciDate:		Feb 2020
1288c2ecf20Sopenharmony_ciKernelVersion:	5.7
1298c2ecf20Sopenharmony_ciContact:	Jack Wang <jinpu.wang@cloud.ionos.com> Danil Kipnis <danil.kipnis@cloud.ionos.com>
1308c2ecf20Sopenharmony_ciDescription:	Contains statistics regarding rdma operations and inflight operations.
1318c2ecf20Sopenharmony_ci		The output consists of 6 values::
1328c2ecf20Sopenharmony_ci
1338c2ecf20Sopenharmony_ci		    <read-count> <read-total-size> <write-count> \
1348c2ecf20Sopenharmony_ci		    <write-total-size> <inflights> <failovered>
135