{"id":528,"date":"2023-10-11T10:05:48","date_gmt":"2023-10-11T10:05:48","guid":{"rendered":"https:\/\/www.aixperts.co.uk\/?p=528"},"modified":"2023-10-11T10:50:36","modified_gmt":"2023-10-11T10:50:36","slug":"graphing-ilcs-in-grafana","status":"publish","type":"post","link":"https:\/\/www.aixperts.co.uk\/?p=528","title":{"rendered":"Graphing ilcs in Grafana"},"content":{"rendered":"\n

Graphing of ilcs in AIX is not included in the nimon data output because ilcs comes from the mpstat command and ilcs is not part of the perfstat library that njmon uses.<\/p>\n\n\n\n

ilcs is “Involuntary Logical CPU switches” and occurs when the LPAR is running on processor time in the shared pool, but is suddenly kicked off the processor due to contention. This seriously hurts performance.<\/p>\n\n\n\n

The script below will run mpstat -d in the background and send the data to the ‘mpstat’ database and ‘mpstat’ measurements table. You will need to adopt this to your environment.<\/p>\n\n\n\n

Run as ‘python mpstat.py 5 17420’ to get 5 second data points for 24h.<\/p>\n\n\n\n

\nfrom influxdb import InfluxDBClient     # For InfluxDB connection\nimport subprocess       # For background process piping\nimport re               # For regexp matching\nimport sys              # For reading command line arguments\nimport socket           # For gethostname function\n\n\"\"\"\nProgram name : mpstat.py\n\nSyntax       : mpstat.py {interval} {count}\n\nAuthor       : Henrik Morsing\n\nDate         : 09\/10\/2023\n\nDescription  : Script starts mpstat in the background and\n               Sends ilcs data to the \"mpstat\" database for Grafana,\n               in the \"mpstat\" measurements.\n\n               It sends data with the tag \"cswitch=ilcs\" and\n               parameter \"switches\".\n\n               The interval parameter is in seconds.\n\"\"\"\n\nhost=socket.gethostname()\nserver=<server>\n\n# Load command arguments\ncount = sys.argv[2]\ninterval = sys.argv[1]  # In seconds\n\n# Define the connection string\nconn = InfluxDBClient(host=server, port='8086', username='user', password='password123')\n\n# Define function to run and return mpstat values continuously\ndef mpstat(interval, count):\n    \"\"\"\n    This function calls mpstat to pick out ilcs values.\n    It then returns them via 'yield', which enables the function\n    to continue listening, and returning, mpstat output.\n    \"\"\"\n\n    # Define process handle\n    popen = subprocess.Popen([\"\/usr\/bin\/mpstat\", \"-d\", str(interval), str(count)], stdout=subprocess.PIPE, universal_newlines=True)\n\n    # Now we can read the output lines from the mpstat function.\n    for line in iter(popen.stdout.readline, \"\"):\n        match = re.search(\"ALL\", line)          # \"match\" becomes true if line contains the word \"ALL\"\n\n        if match:\n            list = line.split() # Split the string line into a list of words\n            ilcs = list[15]     # Field 15 in mpstat output is ilcs\n            yield ilcs          # Return ilcs\n\n    popen.stdout.close()\n\n\n\nfor ilcs in mpstat(interval, count):\n    line = 'mpstat,host=%s,cswitch=ilcs switches=%s' % (host,ilcs)\n    conn.write([line], {'db': 'mpstat'}, 204, 'line')\n<\/code><\/pre>\n\n\n\n
\n\n\n\n
The guideline for performance impact is given in Earl Jew’s POWER VUG presentation ‘Simplest starting tactic for Power10 AIX exploitation V1.2<\/strong>‘:<\/p>\n\n\n\n
\"\"<\/a><\/figure>\n\n\n\n
Relieving the performance impact is done by increasing processor entitlement until the ilcs numbers drop.<\/p>\n","protected":false},"excerpt":{"rendered":"
Graphing of ilcs in AIX is not included in the nimon data output because ilcs comes from the mpstat command and ilcs is not part of the perfstat library that njmon uses. ilcs is “Involuntary Logical CPU switches” and occurs … Continue reading →<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3,147,146,148],"tags":[7,182,178,177,141,179,180,181],"class_list":["post-528","post","type-post","status-publish","format-standard","hentry","category-aix","category-ibm-power","category-performance-tuning","category-scripting","tag-aix","tag-ibm-power","tag-ilcs","tag-perfomance","tag-power","tag-processor-pool","tag-processor-switches","tag-shared-processor-pools"],"_links":{"self":[{"href":"https:\/\/www.aixperts.co.uk\/index.php?rest_route=\/wp\/v2\/posts\/528","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.aixperts.co.uk\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.aixperts.co.uk\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.aixperts.co.uk\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.aixperts.co.uk\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=528"}],"version-history":[{"count":5,"href":"https:\/\/www.aixperts.co.uk\/index.php?rest_route=\/wp\/v2\/posts\/528\/revisions"}],"predecessor-version":[{"id":534,"href":"https:\/\/www.aixperts.co.uk\/index.php?rest_route=\/wp\/v2\/posts\/528\/revisions\/534"}],"wp:attachment":[{"href":"https:\/\/www.aixperts.co.uk\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=528"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.aixperts.co.uk\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=528"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.aixperts.co.uk\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=528"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}