{"id":2659,"date":"2019-09-06T15:15:07","date_gmt":"2019-09-06T03:15:07","guid":{"rendered":"https:\/\/www.deltics.co.nz\/blog\/?p=2659"},"modified":"2019-09-06T15:36:53","modified_gmt":"2019-09-06T03:36:53","slug":"azure-devops-and-delphi-build-agents","status":"publish","type":"post","link":"https:\/\/www.deltics.co.nz\/blog\/posts\/2659\/","title":{"rendered":"Azure DevOps and Delphi – Build Agents"},"content":{"rendered":"[Estimated Reading Time: <\/span> 6<\/span> minutes]<\/span><\/span>

I recently returned to Delphi for the first time in years, to work on a project that I’ve had at the back of my mind for a long time and whose time I thought had come. Before I get into that though, I decided to bring the old and new together for this project, using Azure DevOps to host the code and provide build and test automation.<\/p>\n

<\/p>\n

In Azure DevOps you can run your build processes on Microsoft hosted servers.  This is very convenient but comes with some drawbacks not least of which is that those hosted build servers only support the build tools that Microsoft feel worth making available.<\/p>\n

Delphi isn’t one of them (at least not at time of writing).<\/p>\n

Fortunately you can connect your own build machine to the Azure DevOps infrastructure very simply by installing an incredibly simple piece of software on it called an “Agent”.<\/p>\n

Note:<\/strong> Azure DevOps also supports using containers for builds which could conceivably have been used but was not the object of this exercise.  If you’re interested in that approach, this article may be of interest<\/a>.<\/em><\/p>\n

On a self-hosted build machine, the agent serves two purposes:<\/p>\n

    \n
  1. First, it identifies your build machine capabilities to Azure DevOps.  This enables Azure DevOps to send your machine only those build tasks that your build machine is capable of.  If you don’t have an Android SDK installed then you won’t be sent Android builds, for example.<\/li>\n
  2. Second it polls for build tasks that it can run for you, executes those tasks and communicates the results (and potentially resulting artefacts) back to the Azure DevOps service.<\/li>\n<\/ol>\n

    For the first part, there are capabilities that are defined by Azure DevOps to identify things such as MSBuild or Visual Studio, Java and Android SDK’s, Xcode (your build machine may be a Mac) etc etc.<\/p>\n

    These capabilities are identified automatically when you configure the agent software on your build machine by scanning for known software on the machine.  In addition you can define your own capabilities, things that the agent does not know to look for itself.  Delphi falls into that camp.<\/p>\n

    But we’ll get into that later.  Let’s get started.<\/p>\n

    First, I’m assuming you already have an Azure DevOps account (its free!) but if you don’t go ahead and sign up now<\/a>.  I’ll wait here…<\/p>\n

    Back?  Cool.  \ud83d\ude42<\/p>\n

    Enrolling a New Agent<\/h3>\n

    On your Azure DevOps organization landing page, go to Organization Settings<\/strong>:<\/p>\n

    \"\"<\/p>\n

    Then navigate to the Agent Pools<\/strong> settings in the Pipelines<\/strong> section.  Here you will see a pool already exists for builds to run on the hosted infrastructure (the Azure Pipelines<\/strong> pool).<\/p>\n

    Add a new pool using the Add Pool<\/strong> button (top right) and name it however you wish.  I have two build machines that I’m using in my den<\/em> at home, so I added a pool called The Den<\/strong>:<\/p>\n

    \"\"<\/p>\n

    With the pool created, you can now select that pool to see all the agents in that pool.  The default view actually shows the history of jobs run on those agents, but since there are no agents there are no jobs either.<\/p>\n

    Either way, we use the New Agent<\/strong> button to add a new agent.<\/p>\n

    Actually, we don’t.<\/p>\n

    When you select New Agent<\/strong> what you actually get is a dialog with a link to download the agent software for the detected browser OS – you can change this if (e.g. like me) you’re using a Mac but intending to setup a Windows build machine:<\/p>\n

    \"\"<\/p>\n

    Everything you need to get your agent up and running is in this one dialog and the links it provides.  It really is straightforward.  The most important step is creating the PAT (Personal Access Token) which is used to configure the agent and needs the scope Agent Pools (Read & Manage)<\/strong>.<\/p>\n

    This is only used when setting up the agent so you don’t need to worry about keeping it around afterward.  You also need a PAT when removing an agent, but it doesn’t need to be the same PAT used to configure the agent; you can create these PAT’s and revoke them when you’re done with them instead of worrying about how to manage them.<\/p>\n

    When the agent is configured you will be asked for the pool the agent should be part of, a name for the agent (which will default to the system\/host name) and whether you want to run it as a service (Yes<\/strong> is a good answer if you want your build machine to auto-connect to the pool after a restart, for example).  You will also need to identify an account for the agent to run under, though a default is provided if you don’t want to have to think too much).<\/p>\n

    Finally, you will need to specify a folder where work files are downloaded and acted upon by the tasks sent to your agent.<\/p>\n

    Oh, and all of this has to be done in an elevated command prompt.<\/p>\n

    Once all of this has been done and assuming everything has gone smoothly, your agent will now be registered with your pool:<\/p>\n

    \"\"<\/p>\n

    As you can see, my build machine is an Intel NUC, unimaginatively named NUC<\/strong>.  And we can see that everything so far is working as Azure DevOps is both aware of the machine (so the machine can talk to the service – it has to, to have been able to register) and Azure DevOps has determined that the machine is online (so the agent service on the machine is contactable).<\/p>\n

    Great, but so far this machine isn’t capable of very much.  Well, actually it is.<\/p>\n

    I already had Visual Studio 2017<\/strong> installed on this machine along with JDK<\/strong> and the Android SDK<\/strong>.  All of this, along with a bunch of other things were detected by the auto-scan performed by the agent config which we can see by selecting the agent and then browsing the detected capabilities.<\/p>\n

    There are way too many capabilities to show here, but I’ve highlighted some of the more interesting ones.<\/p>\n

    \"\"<\/a>You can click to view the larger image if you’re interested.  A key thing to note with these capabilities is that they are not just a yes\/no indicator but have a value associated with them which could be useful to any task which relies on these capabilities.<\/p>\n

    For example, the JAVA<\/strong> capability not only identifies that the Java Runtime is present on the machine, but also identifies the path<\/em> to the installed runtime.  Similarly all of the different .NET framework version paths are identified along with each version as a distinct capability.<\/p>\n

    But no Delphi.<\/p>\n

    I can assure you that Delphi is on this machine however.  In fact, every version from Delphi 7 thru XE4 (except 2005 and 2006).  All of these versions are present in a folder c:\\dcc<\/strong> on the machine:<\/p>\n

    \"\"<\/p>\n

    These are not full installs but just enough needed to run command line compiles.  That is, the bin<\/strong> and lib<\/strong> folders, donated from my Delphi development VM where I do have these versions fully installed.<\/p>\n

    So I’m going to add some user defined capabilities to my agent, to identify these locations and the presence of Delphi on this machine:<\/p>\n

    \"\"<\/p>\n

    It doesn’t matter what I call these capabilities (as long as they aren’t confused with any system defined capabilities).  Nor does it matter what value I give them.  At least not yet.<\/p>\n

    It will<\/em> matter when we come to make use of these capabilities later, but for now these are having no effect what-so-ever.  Azure DevOps could care less about these capabilities – it still has no idea what to do with them.  That’s up to us.<\/p>\n

    Testing The Agent<\/h3>\n

    To test the agent we will need some code to build and something to tell the agent how to build it.<\/p>\n

    We’ll do that in the next post.<\/p>\n\n\n

    <\/p>\n","protected":false},"excerpt":{"rendered":"

    [Estimated Reading Time: <\/span> 6<\/span> minutes]<\/span><\/span> The first in a series of posts exploring build and test automation for Delphi projects using Azure DevOps.<\/p>\n","protected":false},"author":2,"featured_media":2689,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"jetpack_publicize_message":"","jetpack_is_tweetstorm":false,"jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":[]},"categories":[324,322,323,4,321],"tags":[325,326,251,327,292,328],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/www.deltics.co.nz\/blog\/wp-content\/uploads\/pipelines-hero-1-1024x256.jpg?fit=1024%2C256&ssl=1","jetpack_shortlink":"https:\/\/wp.me\/p1TKYv-GT","jetpack_sharing_enabled":true,"jetpack-related-posts":[{"id":2861,"url":"https:\/\/www.deltics.co.nz\/blog\/posts\/2861\/","url_meta":{"origin":2659,"position":0},"title":"Azure DevOps – Building Some Code","date":"09 Sep 2019","format":false,"excerpt":"In this post we create a (very!) simple project, build it using Delphi (7) and run it. All with Azure DevOps.","rel":"","context":"In "automation"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.deltics.co.nz\/blog\/wp-content\/uploads\/pipelines-hero-code-1024x256.jpg?fit=1024%2C256&ssl=1&resize=350%2C200","width":350,"height":200},"classes":[]},{"id":2919,"url":"https:\/\/www.deltics.co.nz\/blog\/posts\/2919\/","url_meta":{"origin":2659,"position":1},"title":"Azure DevOps – Now You Too Can Use My Template(s)","date":"14 Sep 2019","format":false,"excerpt":"Learn how you too can use my Delphi build template in your own Azure DevOps pipelines, and a sneak preview of something special coming soon...","rel":"","context":"In "automation"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.deltics.co.nz\/blog\/wp-content\/uploads\/github-512.png?fit=512%2C512&ssl=1&resize=350%2C200","width":350,"height":200},"classes":[]},{"id":2968,"url":"https:\/\/www.deltics.co.nz\/blog\/posts\/2968\/","url_meta":{"origin":2659,"position":2},"title":"Azure DevOps + GitHub = GitHub++","date":"23 Sep 2019","format":false,"excerpt":"A look at some of the integrations that \"just work\" when you combine Azure DevOps and GitHub","rel":"","context":"In "automation"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.deltics.co.nz\/blog\/wp-content\/uploads\/azure-devopsgithub.png?fit=1024%2C341&ssl=1&resize=350%2C200","width":350,"height":200},"classes":[]},{"id":2936,"url":"https:\/\/www.deltics.co.nz\/blog\/posts\/2936\/","url_meta":{"origin":2659,"position":3},"title":"Azure DevOps – Iterative Insertion Fixed!","date":"19 Sep 2019","format":false,"excerpt":"I figured out the iterative insertion problem and my build pipeline is now TIGHT! Fixing it was super-easy in fact, barely an inconvenience.","rel":"","context":"In "automation"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.deltics.co.nz\/blog\/wp-content\/uploads\/pipelines-hero-code-1024x256.jpg?fit=1024%2C256&ssl=1&resize=350%2C200","width":350,"height":200},"classes":[]},{"id":2878,"url":"https:\/\/www.deltics.co.nz\/blog\/posts\/2878\/","url_meta":{"origin":2659,"position":4},"title":"Azure DevOps – Template for Builds + Running Tests and Capturing Results","date":"12 Sep 2019","format":false,"excerpt":"A more complete build script, re-usable in the form of a template, that caters for different Delphi versions, combined with a demonstration of running unit tests and capturing results for reporting and analysis in Azure DevOps Pipelines.","rel":"","context":"In "automation"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.deltics.co.nz\/blog\/wp-content\/uploads\/Screen-Shot-2019-09-12-at-14.25.20.jpg?fit=386%2C386&ssl=1&resize=350%2C200","width":350,"height":200},"classes":[]},{"id":2950,"url":"https:\/\/www.deltics.co.nz\/blog\/posts\/2950\/","url_meta":{"origin":2659,"position":5},"title":"Azure DevOps – Great, But I Use GitHub!","date":"22 Sep 2019","format":false,"excerpt":"If you were thinking that Azure DevOps has nothing to offer if your code is in github, think again!","rel":"","context":"In "Azure DevOps"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.deltics.co.nz\/blog\/wp-content\/uploads\/github-512.png?fit=512%2C512&ssl=1&resize=350%2C200","width":350,"height":200},"classes":[]}],"_links":{"self":[{"href":"https:\/\/www.deltics.co.nz\/blog\/wp-json\/wp\/v2\/posts\/2659"}],"collection":[{"href":"https:\/\/www.deltics.co.nz\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.deltics.co.nz\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.deltics.co.nz\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.deltics.co.nz\/blog\/wp-json\/wp\/v2\/comments?post=2659"}],"version-history":[{"count":10,"href":"https:\/\/www.deltics.co.nz\/blog\/wp-json\/wp\/v2\/posts\/2659\/revisions"}],"predecessor-version":[{"id":2690,"href":"https:\/\/www.deltics.co.nz\/blog\/wp-json\/wp\/v2\/posts\/2659\/revisions\/2690"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.deltics.co.nz\/blog\/wp-json\/wp\/v2\/media\/2689"}],"wp:attachment":[{"href":"https:\/\/www.deltics.co.nz\/blog\/wp-json\/wp\/v2\/media?parent=2659"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.deltics.co.nz\/blog\/wp-json\/wp\/v2\/categories?post=2659"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.deltics.co.nz\/blog\/wp-json\/wp\/v2\/tags?post=2659"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}