Communities

Writing
Writing
Codidact Meta
Codidact Meta
The Great Outdoors
The Great Outdoors
Photography & Video
Photography & Video
Scientific Speculation
Scientific Speculation
Cooking
Cooking
Electrical Engineering
Electrical Engineering
Judaism
Judaism
Languages & Linguistics
Languages & Linguistics
Software Development
Software Development
Mathematics
Mathematics
Christianity
Christianity
Code Golf
Code Golf
Music
Music
Physics
Physics
Linux Systems
Linux Systems
Power Users
Power Users
Tabletop RPGs
Tabletop RPGs
Community Proposals
Community Proposals
tag:snake search within a tag
answers:0 unanswered questions
user:xxxx search by author id
score:0.5 posts with 0.5+ score
"snake oil" exact phrase
votes:4 posts with 4+ votes
created:<1w created < 1 week ago
post_type:xxxx type of post
Search help
Notifications
Mark all as read See all your notifications »
Q&A

Welcome to Software Development on Codidact!

Will you help us build our independent community of developers helping developers? We're small and trying to grow. We welcome questions about all aspects of software development, from design to code to QA and more. Got questions? Got answers? Got code you'd like someone to review? Please join us.

Comments on How to manage CPU capabilities of Jenkins nodes?

Parent

How to manage CPU capabilities of Jenkins nodes?

+5
−0

We use Jenkins Pipeline to build and test some C++ software. The pipeline script runs the tests on 10 different nodes in a parallel way in order to save time. All of these nodes are real (not virtual) computers on the network.

Some of the computers have old CPUs, which don't support modern instruction sets (e.g. AVX2). I want to use the correct build script for each node - if it supports AVX2, use the corresponding script, and if not, use a fall-back script.

I wonder how I should manage that in the Jenkins controller and in my Jenkins Pipeline script. I am not allowed to install programs like Coreinfo on the nodes, so the Jenkins Pipeline script cannot determine directly which build script to run. Instead of that, I imagine the Jenkins controller could support some "properties" for each node, which I could set manually, using trial and error (i.e. try to run the AVX2 script; if it fails, mark the node as "old"). I tried but couldn't find such a feature. Does Jenkins have it?

If not, which other feature could I use to record such information for each node? How can the Pipeline script then get this information?

Below is a sketch of the Pipeline script we use. It uses "label" to force the system to run it on a specific node.

pipeline {
    agent {label 'specific-computer-name'}
    stages {
        stage('build') {
            steps {
                bat 'whatever'
            }
        }
        stage('test') {
            steps {
                bat 'whatever'
            }
        }
    }
}
History
Why does this post require attention from curators or moderators?
You might want to add some details to your flag.
Why should this post be closed?

0 comment threads

Post
+2
−0

You shouldn't need coreinfo. Run the following Powershell command:

(Get-WmiObject -Class Win32_Processor).Caption

The result will be a processor ID string like:

Intel64 Family 6 Model 94 Stepping 3

The AVX2 features were introduced in the Haswell family of chips, which I believe will show up as family 6, model 195. Models older than that can use the non-AVX2 build.

Since this feature support information isn't something that will change over time, you can also manually determine which node supports the feature and hard-code a list of which nodes should use which build.

History
Why does this post require attention from curators or moderators?
You might want to add some details to your flag.

1 comment thread

Low-power CPUs and AMD... (2 comments)
Low-power CPUs and AMD...
elgonzo‭ wrote almost 3 years ago · edited almost 3 years ago

The AVX2 features were introduced in the Haswell family of chips, which I believe will show up as family 6, model 195. Models older than that can use the non-AVX2 build.

With respect to Intel, if it only were that easy. Not all Intel processors in the same family/architecture do support AVX2. For some CPU families >= gen 6, Celeron and Pentium branded low-power/perf CPUs do not feature AVX2 (link https://en.wikipedia.org/wiki/Advanced_Vector_Extensions#CPUs_with_AVX2).

With respect to AMD, I don't know whether all AMD CPUs with Excavator, Zen or newer architectures support AVX2, or whether certain CPUs in those generations lack AVX2 (which, similar to Intel's case, could be the case when looking at low-power CPUs)

While i would agree that the probability of the asker utilizing nodes with low-power low-performance CPUs such as Pentium or Celeron (or even mobile CPUs) is rather low, i still think it worth pointing this out... ;-)

elgonzo‭ wrote almost 3 years ago · edited almost 3 years ago

All in all, without making sweeping assumptions about what specific CPU SKUs are in the nodes the asker is using, i think the Win32_Processor caption string provided by WMI is not that practical, unless you already have a table that maps CPU family/generation + (extended) model number to feature set. Which is perhaps(?) hard to get or labourious to make. Because at least with Intel's ark, most available and easily digestible technical documentation wrt the feature set of a processor identify the CPU by the SKU model name (like for example i7-7770K; the "processor number" as Intel's ark calls it), not by family/generation + model numbers...