{"id":2919,"date":"2019-09-14T12:16:06","date_gmt":"2019-09-14T00:16:06","guid":{"rendered":"https:\/\/www.deltics.co.nz\/blog\/?p=2919"},"modified":"2019-09-22T10:00:03","modified_gmt":"2019-09-21T22:00:03","slug":"azure-devops-now-you-too-can-use-my-templates","status":"publish","type":"post","link":"https:\/\/www.deltics.co.nz\/blog\/posts\/2919\/","title":{"rendered":"Azure DevOps – Now You Too Can Use My Template(s)"},"content":{"rendered":"[Estimated Reading Time: <\/span> 5<\/span> minutes]<\/span><\/span>\n

I’ve continued to enhance and refine my Delphi build template for Azure DevOps pipelines and am now hosting that in a new repository I’ve created on GitHub. This means that anyone can now use this template in their own build pipelines.<\/p>\n\n\n\n

Here’s how.<\/p>\n\n\n\n\n\n\n\n

In the previous post on this subject<\/a>, the template I created was in the same repo as the build pipeline that consumed it. This made it very simple to re-use within that repo, but things get a bit more complicated when sharing between\/across repos. In particular, templates in Azure<\/em> repos can only be shared with other repos within the same <\/em>Organization<\/em><\/strong>.<\/p>\n\n\n\n

e.g. a build pipeline for a project in the ACME Organization<\/strong> may reference templates held in any other repo for any project also in the <\/em>ACME Organization<\/em><\/strong>. But repos in projects that are part of the Spectre Organization<\/em><\/strong> cannot reference any of those ACME Organization<\/strong> templates.<\/p>\n\n\n\n

Clear ?<\/p>\n\n\n\n

In essence, it allows organizations to share templates among their own projects but not with other organizations. Sharing templates privately in this way is of course a perfectly valid use case, but this doesn’t work for templates intended to be shared with a broader community. <\/p>\n\n\n\n

Fortunately, Azure DevOps pipelines also support referencing templates hosted on repositories other than Azure DevOps itself. The only slight catch is that this only works if those repos are on GitHub (also now Microsoft owned<\/a>, in case you missed that piece of news<\/a>).<\/p>\n\n\n\n

To do this, the first thing you need to do this is create a Service Connection<\/strong> in your Azure Project. This will be used to authenticate any requests to obtain templates held in GitHub repos. This is done in Project Settings, in the Service Connections area:<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

GitHub<\/strong> is a specific service connection type recognised and supported by Azure DevOps. When configuring the connection you need to specify a name and the authentication type. I set mine up using a PAT<\/strong> (Personal Access Token). The name is used in consuming pipelines so you’ll want to keep it short-ish, meaningful and memorable.<\/p>\n\n\n\n

If you reference a template that in turn references other GitHub hosted templates then you may need additional Service Connections with names that satisfy the endpoints configured in those references.<\/p>\n\n\n\n

To create the PAT itself you need to go to GitHub. PAT’s are created and managed in the Developer Settings<\/strong> area of your GitHub profile:<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Now we can create a build pipeline that references my GitHub repo. Here’s an example:<\/p>\n\n\n\n

trigger:\n- develop\n- master\n\nresources:\n  repositories:\n    - repository: templates\n      type: github\n      name: deltics\/azure-pipeline-templates\n      endpoint: GitHubTemplates\n\npool:\n  name: 'The Den'\n\nsteps:\n- template: delphi-build.yml@templates\n  parameters:\n    delphiVersion: 7\n    project: tests\\Tests\n    preBuildInline: duget restore --updateCfg\n    postBuildInline: .bin\\Tests -f=.results\\TestResults.xml<\/code><\/pre>\n\n\n\n
The most significant addition here compared to the earlier pipeline is the addition of the resources:<\/code> section.  This is where we identify any resource this pipeline needs.  A GitHub repo is one of those and needs to be added in a repositories:<\/code> section of the resources<\/strong>.<\/p>\n\n\n\n
Now, some of the names for the properties of a GitHub repository resource can be a little confusing, so bear with me…<\/p>\n\n\n\n
The repository:<\/code> has a value which is the name by which this resource is referenced elsewhere in the pipeline.  In this case templates<\/strong>.<\/p>\n\n\n\n
We then identify the type of repository, which is github<\/strong>.  For an Azure repo we would use git<\/strong>.  (It seems to me that <\/em>azure<\/em><\/strong> or <\/em>azuregit<\/em><\/strong> would have been a better choice here, but Microsoft clearly don’t agree – Ed)<\/em>.<\/p>\n\n\n\n
The name:<\/code> for the repository identifies the GitHub repository itself, in the form <account>\/<repo><\/code>.  My GitHub account is deltics<\/strong> and the repo I created to host my template(s) is azure-pipeline-templates<\/strong>.  Hence the ‘name’ for this repository is deltics\/azure-pipeline-templates<\/code>.<\/p>\n\n\n\n
Finally, the endpoint:<\/code> property identifies the Service Connection<\/strong> used to communicate with the GitHub repo.<\/p>\n\n\n\n
There is an additional optional property which may be set including a ref:<\/code> property which can be used to ‘pin’ the referenced template to a specific tagged version.  By default if no ref:<\/code> is specified, master\/HEAD<\/code> will be used (i.e. latest version). <\/p>\n\n\n\n
All of these properties, as well as other resource types, are explained further in the Microsoft documentation<\/a>.<\/p>\n\n\n\n
The build step that consumes the template is also changed slightly from before<\/a>:<\/p>\n\n\n\n
steps:\n- template: delphi-build.yml@templates\n  parameters:\n    delphiVersion: 7\n    project: tests\\Tests\n    preBuildInline: duget restore --updateCfg\n    postBuildInline: .bin\\Tests -f=.results\\TestResults.xml<\/code><\/pre>\n\n\n\n
The template reference which previously simply referenced a path within the same repo, now identifies a file (delphi-build.yml<\/code>) within a named resource (@templates<\/code>).<\/p>\n\n\n\n
Everything else is just as before although much simplified in this case as a result of that preBuildInline:<\/code> property.<\/p>\n\n\n\n
preBuildInline<\/code> and postBuildInline<\/code> are some additional properties that I’ve added to my template.  These allow me to specify some Powershell script to be executed immediately before<\/em> and immediately after<\/em> the invocation of the compiler.  postBuildInline<\/code> will only be executed if the build is successful.<\/p>\n\n\n\n
postBuild<\/code> still exists and functions as before, running as a separate step after the successful completion of the build step.  I’ve also added preBuild<\/code> which is also a separate step which executes before the build step.<\/p>\n\n\n\n
The key distinction between these Inline<\/code> parameters and the non-inline versions is that the inline parameters must be Powershell statements where-as the non-inline parameters are YAML steps which could be any valid build pipeline step, Powershell or otherwise. <\/p>\n\n\n\n
\n\n\n\n
The overall build in this case is greatly simplified by the preBuildInline<\/code> command.  Where-as before I had a cumbersome step which manually constructed a search path and passed that in via parameters to the template, all of that work is replaced by a single command in the preBuildInline<\/code> script.<\/p>\n\n\n\n
The duget restore<\/code> command constructs the required paths and the --updateCfg<\/code> switch additionally instructs the command to add those paths to any dcc32.cfg<\/code> or dcc64.cfg<\/code> that it may find.<\/p>\n\n\n\n
This is why this command must be performed as an Inline<\/code> script.  It is only at the point, immediately before the compiler is invoked, that the build has created the initial dcc32\/dcc64 config file that this command can then update.<\/p>\n\n\n\n
The duget<\/code> command is an exe<\/strong> pre-installed on the build machine.  It doesn’t just work out the required paths, it also ensures that any dependencies that my project has are available for compilation.<\/p>\n\n\n\n
For now however, the build template itself is available for use by anyone so inclined.  It doesn’t rely on or make direct use of duget<\/strong>.  Just follow the above steps to reference my GitHub repo, pull this template into your pipelines and you’re good to go.<\/p>\n\n\n\n
Don’t forget, you will of course need a build agent connected to DevOps<\/a>.<\/p>\n\n\n\n
Let me know how you get on using the template or, better yet, contribute to the template yourself!<\/p>\n\n\n\n
Of particular interest would be testing for and supporting builds for FMX and non-Windows platforms.  These are not areas that I use Delphi for myself so wouldn’t be confident in tackling those aspects of the template.<\/p>\n\n\n\n
Enjoy! \ud83d\ude42<\/p>\n","protected":false},"excerpt":{"rendered":"
[Estimated Reading Time: <\/span> 5<\/span> minutes]<\/span><\/span> Learn how you too can use my Delphi build template in your own Azure DevOps pipelines, and a sneak preview of something special coming soon…<\/p>\n","protected":false},"author":2,"featured_media":2922,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"jetpack_publicize_message":"Azure DevOps - Now You Too Can Use My Template(s).  This post also includes a sneak-peek at something I'm currently working which I'm very excited about!","jetpack_is_tweetstorm":false,"jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":[]},"categories":[324,322,323,4,321],"tags":[326,251,292,337,328],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/www.deltics.co.nz\/blog\/wp-content\/uploads\/github-512.png?fit=512%2C512&ssl=1","jetpack_shortlink":"https:\/\/wp.me\/p1TKYv-L5","jetpack_sharing_enabled":true,"jetpack-related-posts":[{"id":2936,"url":"https:\/\/www.deltics.co.nz\/blog\/posts\/2936\/","url_meta":{"origin":2919,"position":0},"title":"Azure DevOps – Iterative Insertion Fixed!","date":"19 Sep 2019","format":false,"excerpt":"I figured out the iterative insertion problem and my build pipeline is now TIGHT! Fixing it was super-easy in fact, barely an inconvenience.","rel":"","context":"In "automation"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.deltics.co.nz\/blog\/wp-content\/uploads\/pipelines-hero-code-1024x256.jpg?fit=1024%2C256&ssl=1&resize=350%2C200","width":350,"height":200},"classes":[]},{"id":2950,"url":"https:\/\/www.deltics.co.nz\/blog\/posts\/2950\/","url_meta":{"origin":2919,"position":1},"title":"Azure DevOps – Great, But I Use GitHub!","date":"22 Sep 2019","format":false,"excerpt":"If you were thinking that Azure DevOps has nothing to offer if your code is in github, think again!","rel":"","context":"In "Azure DevOps"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.deltics.co.nz\/blog\/wp-content\/uploads\/github-512.png?fit=512%2C512&ssl=1&resize=350%2C200","width":350,"height":200},"classes":[]},{"id":2968,"url":"https:\/\/www.deltics.co.nz\/blog\/posts\/2968\/","url_meta":{"origin":2919,"position":2},"title":"Azure DevOps + GitHub = GitHub++","date":"23 Sep 2019","format":false,"excerpt":"A look at some of the integrations that \"just work\" when you combine Azure DevOps and GitHub","rel":"","context":"In "automation"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.deltics.co.nz\/blog\/wp-content\/uploads\/azure-devopsgithub.png?fit=1024%2C341&ssl=1&resize=350%2C200","width":350,"height":200},"classes":[]},{"id":2861,"url":"https:\/\/www.deltics.co.nz\/blog\/posts\/2861\/","url_meta":{"origin":2919,"position":3},"title":"Azure DevOps – Building Some Code","date":"09 Sep 2019","format":false,"excerpt":"In this post we create a (very!) simple project, build it using Delphi (7) and run it. All with Azure DevOps.","rel":"","context":"In "automation"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.deltics.co.nz\/blog\/wp-content\/uploads\/pipelines-hero-code-1024x256.jpg?fit=1024%2C256&ssl=1&resize=350%2C200","width":350,"height":200},"classes":[]},{"id":2931,"url":"https:\/\/www.deltics.co.nz\/blog\/posts\/2931\/","url_meta":{"origin":2919,"position":4},"title":"‘Sorry, this script is too long…’","date":"18 Sep 2019","format":false,"excerpt":"An object lesson on the importance of defensive programming and providing helpful error messages to your users.","rel":"","context":"In "Azure DevOps"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.deltics.co.nz\/blog\/wp-content\/uploads\/Mark_Twain_life_1900s.jpg?fit=883%2C331&ssl=1&resize=350%2C200","width":350,"height":200},"classes":[]},{"id":2659,"url":"https:\/\/www.deltics.co.nz\/blog\/posts\/2659\/","url_meta":{"origin":2919,"position":5},"title":"Azure DevOps and Delphi – Build Agents","date":"06 Sep 2019","format":false,"excerpt":"The first in a series of posts exploring build and test automation for Delphi projects using Azure DevOps.","rel":"","context":"In "automation"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.deltics.co.nz\/blog\/wp-content\/uploads\/pipelines-hero-1-1024x256.jpg?fit=1024%2C256&ssl=1&resize=350%2C200","width":350,"height":200},"classes":[]}],"_links":{"self":[{"href":"https:\/\/www.deltics.co.nz\/blog\/wp-json\/wp\/v2\/posts\/2919"}],"collection":[{"href":"https:\/\/www.deltics.co.nz\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.deltics.co.nz\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.deltics.co.nz\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.deltics.co.nz\/blog\/wp-json\/wp\/v2\/comments?post=2919"}],"version-history":[{"count":7,"href":"https:\/\/www.deltics.co.nz\/blog\/wp-json\/wp\/v2\/posts\/2919\/revisions"}],"predecessor-version":[{"id":2930,"href":"https:\/\/www.deltics.co.nz\/blog\/wp-json\/wp\/v2\/posts\/2919\/revisions\/2930"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.deltics.co.nz\/blog\/wp-json\/wp\/v2\/media\/2922"}],"wp:attachment":[{"href":"https:\/\/www.deltics.co.nz\/blog\/wp-json\/wp\/v2\/media?parent=2919"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.deltics.co.nz\/blog\/wp-json\/wp\/v2\/categories?post=2919"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.deltics.co.nz\/blog\/wp-json\/wp\/v2\/tags?post=2919"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
As I teased last time<\/a>, if you’re at all familiar with nuget<\/a><\/strong> then you already have a good idea of what duget<\/strong> is all about.  This is what I am busy working on right now and will talk more about where this project is at in future posts.<\/p>\n\n\n\n